Logo for SoftServe

Technical Lead Big Data Engineer (AWS)

Role overview

Summary

This role focuses on supporting and enhancing a modern AWS-based data platform within SoftServe's Data & Analytics Center of Excellence. You will work with healthcare data in a regulated environment, collaborating with a distributed engineering team to ensure platform reliability and data quality.

Qualifications

  • 5+ years of experience in Big Data or Data Engineering, including supporting production data platforms.
  • Strong proficiency in Python, PySpark, and Apache Spark for large-scale data processing.
  • Hands-on experience with AWS data services such as Glue, S3, Athena, Aurora PostgreSQL, and Lambda.
  • Experience with Apache Airflow for data pipeline orchestration and scheduling.
  • Upper-intermediate or higher level of English, with strong communication and problem-solving skills.

Responsibilities

  • Support, maintain, and enhance an existing AWS-based data platform and data ingestion pipelines
  • Develop and optimize data processing workflows using Python, PySpark, Apache Spark, and AWS Glue
  • Monitor and troubleshoot data pipelines, ensuring reliability, performance, and data quality
  • Collaborate with remote engineering teams to resolve technical issues, implement improvements, and ensure platform stability

Key facts

Hard skills

Key skills for this role

Other skills

  • Communication
  • Problem Solving

About the company

SoftServe logo

SoftServe

  • IT Services & Consulting
  • XLarge
  • 10,001+
SoftServe is a premier IT consulting and digital services provider. We expand the horizon of new technologies to solve today's complex business challenges and achieve meaningful outcomes for our clients. Our boundless curiosity drives us to explore and reimagine the art of the possible. Clients confidently rely on SoftServe to architect and execute mature and innovative capabilities, such as digital engineering, data and analytics, cloud, and AI/ML. Our global reputation is gained from more than 30 years of experience delivering superior digital solutions at exceptional speed by top-tier engineering talent to enterprise industries, including high tech, financial services, healthcare, life sciences, retail, energy, and manufacturing. At SoftServe, we live by our values. Trust, teamwork, growth, innovation, willingness to help, and exceeding expectations are engrained in everything we do. We partner with major technology players, such as Google Cloud Platform, Amazon Web Services, Microsoft Azure, Salesforce, NVIDIA, MuleSoft, VMware, and Odoo, to give clients a competitive advantage in the market. Founded in 1993, our global firm is headquartered in Austin, Texas, USA, and Lviv, Ukraine. Visit our website, blog, media, and news pages for more information. Blog: softserveinc.com/blog Media: softserveinc.com/media News: softserveinc.com/news

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

SoftServe is a global digital services and consulting company with over 30 years of experience and more than 11,000 professionals across 16 countries, helping businesses worldwide solve complex challenges through technology.

Our Data & Analytics Center of Excellence (CoE) brings together data specialists to drive excellence in data, analytics, and business intelligence. We deliver solutions across Data Strategy & Governance, Data Platform Engineering, Data Migration, and Reporting & BI.

In this role, you’ll support and enhance a modern AWS-based data platform, focusing on data ingestion, processing, and platform reliability. You’ll use Python, PySpark, and Apache Spark to maintain and optimize existing data pipelines while collaborating with a distributed engineering team. You’ll work with healthcare data in a regulated environment, and the role includes a three-month business trip to the United States in Q1 2027.


Responsibilities
  • Support, maintain, and enhance an existing AWS-based data platform and data ingestion pipelines
  • Develop and optimize data processing workflows using Python, PySpark, Apache Spark, and AWS Glue
  • Monitor and troubleshoot data pipelines, ensuring reliability, performance, and data quality
  • Work with AWS services such as S3, Aurora PostgreSQL, Athena, Lambda, SQS, SNS, and EventBridge
  • Maintain and improve workflow orchestration using Apache Airflow
  • Support infrastructure and deployment processes using Docker, Terraform, and Amazon EKS
  • Apply software engineering best practices, including automated testing, code quality checks, and CI/CD processes
  • Utilize AI-assisted development tools such as Claude Code to support implementation, testing, and code reviews
  • Collaborate with remote engineering teams to resolve technical issues, implement improvements, and ensure platform stability
  • Support data security, governance, and compliance practices within a regulated healthcare environment

Requirements
  • 5+ years of experience in Big Data or Data Engineering, including supporting production data platforms
  • Strong proficiency in Python, PySpark, and Apache Spark for large-scale data processing
  • Hands-on experience with AWS data services such as Glue, S3, Athena, Aurora PostgreSQL, and Lambda
  • Experience with Apache Airflow for data pipeline orchestration and scheduling
  • Strong knowledge of SQL, data ingestion, ETL processes, and data quality practices
  • Experience with Docker, Terraform, and CI/CD pipelines using GitHub Actions or similar tools
  • Familiarity with Python development and testing tools such as pytest, Pydantic, ruff, or mypy
  • Understanding of healthcare data regulations such as HIPAA/HITRUST, multi-tenant architectures, or data retention requirements is a plus
  • Readiness to travel to the United States for a three-month business trip in Q1 2027
  • Upper-intermediate or higher level of English, with strong communication and problem-solving skills

Some of our benefits
  • SoftServe University: Access continuous learning opportunities, certification support, and leadership development programs to grow your skills and advance your career
  • Medical insurance: Health coverage for you and your family
  • Food vouchers: Additional support for your everyday expenses
  • Extra days off: Enjoy additional time off to rest, recharge, and maintain a healthy work-life balance
  • Dare to Care: Our holistic well-being program, designed to support your overall wellness
  • Anniversary Program: Celebrating your milestones and recognizing your journey with SoftServe

Related jobs

See all Data Platform Engineer jobs

Other jobs at SoftServe