Logo for Bridgenext

Senior Data Engineer

Role overview

Summary

This role focuses on building and maintaining data infrastructure to enable effective data utilization for business insights at Bridgenext. You will contribute to the development of a robust data platform while collaborating with a team to address data-related challenges.

Qualifications

  • Strong knowledge of the Microsoft stack.
  • Experience with Microsoft Fabric.
  • Experience with SQL.
  • Previous working experience with Spark and Notebooks.
  • Understanding of ETL processes.

Responsibilities

  • Develop and maintain data pipelines using MS Fabric
  • Implement transformation using notebooks (python, pyspark, sql)
  • Collaborate with the team to troubleshoot and resolve data-related issues
  • Contribute to architectural decisions and improvements

Key facts

Hard skills

Key skills for this role

Other skills

  • Communication
  • Collaboration
  • Problem Solving
  • Professionalism

About the company

Bridgenext logo

Bridgenext

  • IT Services & Consulting
  • Large
  • 1,001–5,000
Bridgenext is a global digital consultancy that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams across the U.S., Canada and India facilitate highly strategic digital initiatives through digital product engineering, automation, data engineering, and infrastructure modernization services, while elevating brands through digital experience, creative content, and customer data analytics services.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Company Overview:

Bridgenext is a digital consulting services leader that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product engineering, automation, data engineering, and infrastructure modernization services, while elevating brands through digital experience, creative content, and customer data analytics services.

Don't just work, thrive. At Bridgenext, you have an opportunity to make a real difference - driving tangible business value for clients, while simultaneously propelling your own career growth. Our flexible and inclusive work culture provides you with the autonomy, resources, and opportunities to succeed. 

Position Description:

We are seeking a talented Data Engineer to join our team and assist our sales agency / CPG broker client. As a Data Engineer, you will play a key role in building and maintaining our data infrastructure, enabling us to leverage our data effectively for business insights. This is an exciting opportunity to be part of a growing organization and contribute to building a robust data platform from the ground up. .

Key Responsibilities:

  • Develop and maintain data pipelines using MS Fabric
  • Implement transformation using notebooks (python, pyspark, sql)
  • Experience with medallion data architecture
  • Experience building a datalakehouse (data lake + delta tables)
  • Work with various data sources including CSVs, APIs, and automated activities
  • Implement ETL processes from OneDrive to bronze, silver, and gold layers using Delta tables
  • Persist the gold layer data to a SQL endpoint for Power BI users
  • Assist in data architecture and design decisions
  • Implement auditing and error handling mechanisms in data pipelines
  • Collaborate with the team to troubleshoot and resolve data-related issues
  • Participate in code reviews and ensure code quality
  • Support the testing phase and help resolve tickets
  • Contribute to architectural decisions and improvements

Tech Stack: Microsoft Stack, Fabric Notebooks, Delta Tables, SQL Endpoints, Power BI, OneDrive, CSVs, APIs, Data Volume, Approximately 25 to 50  gigabytes per week, Expected growth to terabytes over time, 225 clients with 8-10 CSVs per week, each CSV roughly 30-50 megabytes.

Workplace:  Remote position for candidates based in LATAM, preferably Argentina.

Must Have Skills:

  • Strong knowledge of the Microsoft stack
  • Experience with Microsoft Fabric
  • Experience with SQL
  • Previous working experience with Spark and Notebooks
  • Familiarity with Python
  • Understanding of ETL processes
  • Experience with data warehousing concepts
  • Ability to work with various data formats such as CSVs and APIs
  • Basic understanding of Power BI

Preferred Skills:

  • Familiarity with Delta tables
  • Understanding of data partitioning
  • Experience with Azure DevOps or GitHub
  • Previous experience working with data volumes in the range of gigabytes to terabytes

Professional Skills:

  • Good English communication and collaboration skills
  • Ability to work hands-on and solve problems independently
  • Maintains composure during all types of situations and is collaborative by nature
  • High standards of professionalism, consistently producing high quality results
  • Self-sufficient, independent requiring very little supervision or intervention
  • Demonstrate flexibility and openness to bring creative solutions to address issues
     

Bridgenext is an Equal Opportunity Employer

Related jobs

See all Data Engineer jobs

Other jobs at Bridgenext