Senior Data Engineer

🚀 We are looking for a Data Engineer with expertise in AWS & Databricks to join an exciting project for our client – a leading Swedish provider of transport solutions.

You will be part of a small, agile team responsible for the end-to-end implementation of optimization and machine learning projects, as well as maintaining and improving a cutting-edge Databricks data processing platform.

In the role of Data Engineer you will:

• Maintaining, developing, and optimizing tools (framework) and ELT (DataOps) processes built and managed in Databricks using Python.
• Supporting and improving CI/CD solutions, with a strong emphasis on Data Engineering (DataOps) workflows.
• Collaborating with Data Scientists to prepare data for optimization applications and machine learning projects.
• Developing and maintaining the analytical platform based on AWS and Databricks, troubleshooting issues, and enhancing platform efficiency.
• Participating in data processing projects using an internal ELT framework or alternative technical solutions, depending on project needs, to support ML and business process optimization.
• Monitoring ELT process performance and proposing improvements in data processing workflows.
• Working closely with business teams to understand their needs and deliver high-quality data processing solutions.
• Taking ownership of tasks with a strong emphasis on independent work and self-planning.

You might be the perfect match if you possess the following competencies:

• 5+ years of experience as a Data Engineer, ideally with open-source technologies.
• Hands-on experience with AWS Cloud.
• Strong Python skills, including PySpark, Pandas, and Polars.
• Extensive experience with Databricks & Apache Spark.
• A solid understanding of DataOps workflows and CI/CD pipelines.
• Fluent English skills for seamless communication.

🙌 Nice to have:

• Experience with Machine Learning and optimization projects
• Knowledge of ELT/ETL strategies and frameworks
• Experience with GitLab

By joining Holisticon Insight you will get:

• Life insurance
• Multisport card
• Fully remote job
• Private medical care
• Flexible working hours
• B2B or contract of employment
• Amazing integration events on a regular basis
• Training budget (e.g. Microsoft Azure Certifications)
• Opportunity to impact our company culture build-up
• Work equipment (laptop, 2 monitors, and accessories)

🔍 Our Recruitment Process

1️⃣ Initial chat with Joanna, our recruiter – 30 minutes

2️⃣ Technical interview with our expert – 30-45 minutes

3️⃣ Final interview with the client – 1 hour

Ready to take your Data Engineering career to the next level? Apply now! 🚀