Databricks Data Engineer

Job Title: Databricks Data Engineer

Location:  Remote

About the Role

We are looking for a skilled Databricks Data Engineerto design, develop, and optimize scalable data solutions using Databricks SQL. The ideal candidate should have strong expertise in SQL, performance tuning, and cloud-based data platforms such as AWS, Azure, or GCP.

Key Responsibilities

• Develop, maintain, and optimize SQL queries and notebooks in Databricks for data transformation, aggregation, and analytics.
  
• Optimize Databricks SQL workloads for performance, scalability, and cost efficiency.
  
• Monitor, debug, and troubleshoot SQL queries, dashboards, and workflows.
  
• Work with large-scale datasets in distributed computing environments.
  
• Collaborate with data engineers, analysts, and stakeholders to deliver data-driven solutions.
  
• Implement best practices for query performance tuning, caching, and indexing strategies.
  
• Build and maintain data pipelines using Databricks Workflows and Delta Live Tables.
  

Required Qualifications

• 6years of hands-on experience in SQL development and query optimization.
  
• Strong expertise in Databricks SQL, Delta Lake, and Lakehouse architecture.
  
• Experience with cloud platforms such as AWS, Azure, or GCP (preferably Azure Databricks or AWS Databricks).
  
• Good understanding of performance tuning, caching strategies, and query optimization techniques.
  
• Familiarity with ETL/ELT frameworks, Data Warehousing, and BI tools.
  
• Hands-on experience with:

• Databricks Notebooks
  
• Databricks Workflows
  
• Delta Live Tables
  
• Ability to handle large datasets and distributed systems.
  
• Strong analytical, problem-solving, and communication skills.
  

Preferred Qualifications

• Experience using SQL for advanced data processing and analytics.
  
• Knowledge of Medallion Architecture (Bronze, Silver, Gold layers).
  
• Exposure to data visualization tools like Power BI, Tableau, or similar.