Offer summary

Qualifications:

Minimum of 5 years of experience in data engineering or similar roles., Proficiency in Spark/Pyspark, Databricks, and Azure Data Factory., Strong understanding of data warehousing, ETL processes, and data pipeline design., Excellent problem-solving, analytical skills, and effective communication abilities..

Key responsibilities:

Design and implement data pipelines using Spark and Databricks.

Collaborate with teams to optimize data processing frameworks.

Manage and maintain data warehousing solutions and ETL processes.

Ensure effective communication and teamwork throughout projects.

Job description

Job Description:
Minimum of 5 years of experience in data engineering or similar roles.
1) Spark/Pyspark,
2) Databricks
3) Azure Data Factory
4) Python

Technical Skills - SQL, Spark/Pyspark, Databricks, Python/Scala, SparkSQL

Proven expertise with Databricks and data processing frameworks.
Strong understanding of data warehousing, ETL processes, and data pipeline design.
Experience with SQL, Python, and Spark.
Excellent problem-solving and analytical skills.
Effective communication and teamwork abilities.
Experience and knowledge of Azure SQL Database, Azure Data Factory, ADLS