Offer summary

Qualifications:

3+ years of experience with Azure Data Factory and Databricks, 5+ years of experience in data engineering or backend/fullstack software development, Strong SQL skills and proficiency in Python scripting, Experience with data transformation tools and CI/CD tooling..

Key responsibilities:

Designing, building, and deploying at-scale infrastructure with a focus on distributed systems

Building and maintaining architecture patterns for data processing and system integrations

Collaborating with analysts and data scientists to enhance downstream data models

Writing efficient software and promoting good engineering practices across the team.

Job description

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Senior Azure Data Engineer with Databricks

B2B - 140 - 160 PLN/h

Start: June

Responsibilities

Being responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems
Building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies
Evaluating and translating technical design to workable technical solutions/code and technical specifications at par with industry standards
Driving creation of re-usable artifacts
Establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation
Working closely with analysts/data scientists to understand impact to the downstream data models
Writing efficient and well-organized software to ship products in an iterative, continual release environment
Contributing and promoting good software engineering practices across the team
Communicating clearly and effectively to technical and non-technical audiences
Defining data retention policies
Monitoring performance and advising any necessary infrastructure changes

Requirements

3+ years’ experience with Azure Data Factory and Databricks
5+ years’ experience with data engineering or backend/fullstack software development
Strong SQL skills
Python scripting proficiency
Experience with data transformation tools - Databricks and Spark
Experience in structuring and modelling data in both relational and non-relational forms
Experience with CI/CD tooling
Working knowledge of Git
English level: B2/C1

Nice to have