Staff Data Engineer

Work set-up: 
Full Remote
Contract: 
Experience: 
Senior (5-10 years)
Work from: 

Offer summary

Qualifications:

8-10+ years of experience building and maintaining data pipelines in production environments., Strong knowledge of AWS data services such as Glue, S3, Athena, and Aurora., Proficiency in Python, Spark, and SQL-based query engines for data transformation., Experience with infrastructure management using OpenTofu or Terraform..

Key responsibilities:

  • Develop and maintain data pipelines and transformations across the data stack.
  • Optimize performance, storage, and cost-efficiency of data systems.
  • Design and implement new data ingestion patterns and improve platform reliability.
  • Collaborate with cross-functional teams to deliver trustworthy data for various use cases.

Thoughtful AI logo
Thoughtful AI Scaleup http://www.thoughtful.ai/
51 - 200 Employees
See all jobs

Job description

Join Our Mission to Revolutionize Healthcare

Thoughtful is pioneering a new approach to automation for all healthcare providers! Our AIpowered Revenue Cycle Automation platform enables the healthcare industry to automate and improve its core business operations.

Were looking for Staff Data Engineers to help scale and strengthen our data platform.

Our data stack today consists of Aurora RDS, AWS Glue, Apache Iceberg, S3 (Parquet), Spark and Athena supporting a range of use cases from operational reporting to downstream services. We’re looking to grow the team with engineers who can help improve performance, increase reliability, and expand the platforms capabilities as our data volume and complexity continue to grow.

You’ll work closely with other engineers to evolve our existing pipelines, improve observability and data quality, and enable faster, more flexible access to data across the company. The platform is deployed on AWS using OpenTofu, and we’re looking for engineers who bring strong cloud infrastructure fundamentals alongside deep experience in data engineering.

Your Role:

Required profile

Experience

Level of experience: Senior (5-10 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Systems Thinking
  • Success Driven
  • Collaboration
  • Problem Solving

Data Engineer Related jobs