Nexaminds is looking for a Senior Databricks Engineer to lead the development, optimization, and scaling of our data solutions. The ideal candidate has hands-on expertise building end-to-end pipelines on Databricks and enjoys working in a fast-paced, highly collaborative environment.
Location: CANADA
Qualifications we are looking for:
- 5+ years of experience in data engineering or similar roles.
- Strong expertise with Databricks (Spark, Delta Lake, Workflows, SQL).
- Experience building production-grade ETL/ELT pipelines.
- Proficiency in Azure DevOps (ADO) pipelines and enterprise secret
management. - Solid understanding of the Microsoft ecosystem and cloud platforms, with a
focus on Azure architecture, authentication, and identity concepts. - Proficiency in Python and/or Scala.
- Experience with data modeling, data warehousing, and distributed computing.
Job duties:
- Design, build, and maintain scalable data pipelines using Databricks (SQL,
Python, Spark). - Develop and manage CI/CD workflows using Azure Pipelines, integrating Azure
Key Vault (KV) for secure secret and credential management. - Optimize ETL/ELT processes for performance, reliability, and cost efficiency.
- Implement best practices for data quality, governance, and cloud security.
- Collaborate with data engineers, analysts, and stakeholders to define data
requirements. - Troubleshoot and resolve issues across data workflows and distributed systems.
- Support migration, modernization, or cloud data platform initiatives.
