Logo for Wire IT

Senior Databricks Data Engineer

Roles & Responsibilities

  • 5+ years of experience building data engineering solutions
  • Databricks platform expertise: workspaces, security controls, repos, clusters; notebooks in Python, SQL, and PySpark; Databricks jobs, workflows, repos, and Unity Catalog
  • Azure data platform technologies: ADLS Gen2, Key Vault, Monitor/Log Analytics, Azure Entra ID for RBAC
  • Experience with Delta Lake/Delta Live Tables (DLT) and MLflow asset tracking; data security, governance, and CI/CD for secure deployments (Azure DevOps or GitHub Actions)

Requirements:

  • Design, develop, and maintain data engineering solutions using Databricks, Delta Lake, DLT, and MLflow
  • Manage and configure Databricks environments, including workspaces, security controls, repos, clusters, and Unity Catalog
  • Implement data security and governance practices (ABAC, table/column-level security, masking, row-level access, data lineage, auditability) and secure credential handling with Key Vault
  • Build and maintain CI/CD pipelines for Databricks assets and optimize Spark performance; collaborate on AI/ML lifecycle management and data modeling

Job description

Based in Portugal, Wire IT is your specialized IT consulting partner with 18 years of experience driven by an experienced and senior team that helps clients make the right decisions in a fast-moving market.

Wire IT's ambition is to grow while keeping true to its nature: agile, people-centered, and fun. As we like to say: Its not only what we do, its how we manage that truly make the difference..

If you're looking for more than just a job - if you're looking for a place where you can truly make a difference - you might be the next person to join WIRE IT.

Role: Senior Databricks Data Engineer

Location: 100% Remote, Occasional travel within Europe.

Required skills:

  • 5+ Years of Experience building Data engineering solutions
  • Databricks Workspaces (configuration, security controls, repos, clusters)
  • Databricks Notebooks (Python, SQL, PySpark)
  • Databricks Jobs, Workflows, Repos, Unity Catalog
  • Delta Lake, Delta Live Tables (DLT), MLflow (asset tracking)
  • Azure Data Platform Technologies
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Key Vault, Azure Monitor, Azure Log Analytics
  • Azure Entra ID (AAD) for identity & RBAC
  • Previous experience with Databricks Terraform provider is a plus.
  • Data Security & Governance
  • Unity Catalog (catalogs, schemas, managed tables, access policies)
  • Table and column-level security, masking, row-level access
  • Governed tags & ABAC
  • Secure credential handling via Key Vault
  • Data lineage & auditability practices
  • CI/CD for secure deployments (Azure DevOps or GitHub Actions)
  • Python, SQL, PySpark
  • Source code version control (i.e. git)
  • CI/CD pipelines for Databricks (i.e. Databricks Asset Bundle)
  • Performance tuning of Spark clusters and distributed workflows
  • Strong understanding of data modelling and distributed compute concepts
  • AI Engineering & Software Skills
  • AI model lifecycle management
  • MLFlow experiments access control
  • MLFlow serving

We offer:

  • ­No-term full-time contract;
  • Health Insurance;
  • 22 days of paid vacation;
  • 4 extra days annually (Carnival, Christmas Eve, New Year's Eve, Birthday);
  • Meal Allowance on card (Coverflex);
  • Referral Bonus;
  • Special discounts and flex options;
  • Training annual budget;
  • A great team-oriented culture;
  • Chance to become a part of a dynamically growing international company;
  • Challenging projects giving the unique opportunity to grow and learn.

Following the EU General Data Protection Regulation No. 2016/679, we inform you that by responding to this announcement, you consent to the use of your data by Wire IT, for as long as necessary. In case of doubt or request for elimination of your personal data, please send an email to info@wireit.pt

Data Engineer Related jobs

Other jobs at Wire IT

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.