Logo for Interval Group

Lead Data Platform Engineer (AWS) – Freelance

Role overview

Summary

This role is for a Lead Data Platform Engineer focused on designing and enhancing an AWS-based analytics platform for an enterprise company. You will be responsible for leading development efforts and making architectural decisions while mentoring Data Engineers.

Qualifications

  • Extensive hands-on AWS data platform engineering experience.
  • Strong AWS analytics expertise, particularly Glue, Athena, Redshift and EMR.
  • Experience with Spark, Kafka and modern Lakehouse technologies.
  • Strong Python and SQL development skills.
  • Experience with Terraform, CI/CD and DataOps.

Responsibilities

  • Lead the hands-on development of scalable AWS data platforms, including Data Lakes, Lakehouses and Data Warehouses.
  • Design and implement data pipelines using AWS Glue, Athena, Redshift, EMR and Kinesis.
  • Build batch and streaming solutions with Spark, Kafka and Apache Iceberg or Delta Lake.
  • Make architectural decisions around platform design, data integration and semantic layers.

Key facts

Hard skills

Key skills for this role

Other skills

  • Communication

About the company

Interval Group logo

Interval Group

  • Management Consulting
  • SME
  • 51–200
We provide high quality consulting and recruitment services to solve complex problems. Our wide range of services includes management consulting, programme delivery, technology transformation, digital, PR, training and more. At Interval, we believe in taking a fresh approach to helping organisations create the value they are looking for. We understand not only how to help clients achieve their goals, but also how to maintain and build upon them in the long-run.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

This is a remote position.

We are supporting an enterprise company seeking a highly experienced Lead Data Platform Engineer to design, build and enhance a modern AWS-based analytics platform.

This is a fully remote freelance assignment with full-time hours. A daily rate is available.

Key Responsibilities

  • Lead the hands-on development of scalable AWS data platforms, including Data Lakes, Lakehouses and Data Warehouses.

  • Design and implement data pipelines using AWS Glue, Athena, Redshift, EMR and Kinesis.

  • Build batch and streaming solutions with Spark, Kafka and Apache Iceberg or Delta Lake.

  • Make architectural decisions around platform design, data integration and semantic layers.

  • Implement orchestration with Airflow/MWAA, Step Functions and dbt.

  • Establish security, governance and compliance practices using IAM, KMS and GDPR principles.

  • Automate infrastructure and deployments using Terraform, CI/CD and DataOps.

  • Lead technical delivery, conduct code reviews and mentor Data Engineers.



Requirements

Essential Experience

  • Extensive hands-on AWS data platform engineering experience.

  • Strong AWS analytics expertise, particularly Glue, Athena, Redshift and EMR.

  • Experience with Spark, Kafka and modern Lakehouse technologies.

  • Strong Python and SQL development skills.

  • Experience with Terraform, CI/CD and DataOps.

  • Ability to make architectural decisions while remaining actively involved in engineering.

  • Experience leading technical teams and reviewing code.

  • Very good English communication skills.

Desirable

  • Ontologies and semantic data modelling.

  • AWS certifications.

  • German language skills are nice to have.



Benefits

As a freelancer / contractor with us, you will enjoy flexible working hours and the freedom to choose your own projects. Our platform gives you access to exciting projects in various industries and supports you in advancing your career. You'll benefit from a dedicated team to help you with any questions you may have. Work independently and utilise our strong network to achieve your professional goals.



Related jobs

See all Data Platform Engineer jobs

Other jobs at Interval Group