Logo for NIR-YU

Data Engineer (Databricks + Fabric)

Role overview

Qualifications

  • Hands-on Databricks in production.
  • Microsoft Fabric in production, across the full platform.
  • Advanced SQL and Python.
  • A current DP-900 or DP-700 certification.

Responsibilities

  • Build and run production data platforms for our clients.
  • Design and build ETL/ELT pipelines in Databricks and Fabric.
  • Set up lakehouses with Medallion architecture (Bronze, Silver, Gold) on Delta Lake.
  • Govern data with Unity Catalog: permissions, lineage and quality.

Key facts

Hard skills

Other skills

  • Communication
  • Teamwork

About the company

NIR-YU logo

NIR-YU

  • Staffing & Recruiting
  • Scaleup
  • 201–500
Nir-Yu specializes in helping Small and Medium Enterprises unlock the potential of their business. Our typical customer is worried about not being able to make enough progress on their product(s) or project(s) with their current team; they need additional team-members to deliver work on-time and with the required quality. Tight budgets also make it necessary to lower average wage costs, making it necessary to consider hiring internationally to lower costs. We help these companies by providing a bespoke service that finds and hires remote workers from Mexico, Colombia, Argentina, Chile, Brazil and other countries in LatAm based on the company’s specific job descriptions to work as an extension of their team and perform the required functions. Unlike many other companies, we don’t have a bench of contractors to be hired out, instead each team is hired specifically to meet specific requirements and to work exclusively as a remote employee.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Responsibilities:

  • Build and run production data platforms for our clients. This is hands-on work, not an architect who only reviews.

  • Design and build ETL/ELT pipelines in Databricks and Fabric.

  • Set up lakehouses with Medallion architecture (Bronze, Silver, Gold) on Delta Lake.

  • Govern data with Unity Catalog: permissions, lineage and quality.

  • Automate deployments with CI/CD and infrastructure as code.

  • Gather requirements with the client and with other teams.

  • Spot improvements in the client's platforms that could turn into new projects.

Requirements:

  • Hands-on Databricks in production. PySpark, Delta Lake, Workflows and Unity Catalog (catalogs, permissions and lineage), with Medallion architecture.

  • Microsoft Fabric in production, across the full platform. Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2 and Warehouse. A proof of concept does not count.

  • Advanced SQL and Python.

  • A current DP-900 or DP-700 certification, with a commitment to earn the other one within the first 60 days. Verify it with the Microsoft Learn link.

  • English B2 or higher and fluent Spanish.

Related jobs

See all Data Engineer jobs

Other jobs at NIR-YU