Logo for TalentBurst, an Inc 5000 company

Senior Data Engineer | Remote- Temp To Hire

Key Facts

Remote From: 
Category:  Data Engineer
Freelance
Senior (5-10 years)
English

Roles & Responsibilities

  • Proven experience in data engineering testing / data QA / ETL validation.
  • Strong hands-on experience with AWS data services (Redshift, Glue, DMS).
  • Proficiency in Python for test automation and validation.
  • Experience with Airflow and orchestration testing.

Requirements:

  • Define the end-to-end testing scope based on solution architecture and project documentation.
  • Design and implement a comprehensive testing strategy and plan aligned with organizational QA standards.
  • Develop and maintain test scripts and frameworks for the Redshift serverless platform.
  • Build and implement automated testing solutions to ensure end-to-end data validation.

Job description

Position: Data Engineer 
Location: Reston VA (Remote) 
Duration: 6+ Months
 
Job Description
Position: Senior Data Engineer (data analytics and AI focused)
Mode: Temp to Hire (no visa or 1099 candidates)
Location: Remote (please note that FTE conversion salaries are based on cost-of-living locations)
 
Team:

  • Team is Client delivery platform and Cumulus – lots of data exchanges: AWS platform using Redshift as data warehouse – Dynamo of meta-data.
  • They are working on evolving code for digital SAT products and need dynamic Senior Data engineer who will also design, build and write test automation.
 
Technology Some Awareness (1) Novice (2) Intermediate (3) Advanced (4) Expert (5)
RedShift/SQL       4  
BI Tool       4  
AWS - Dynamo       4  
Gen AI       4  
AWS Step Function       4  
Data Lake       4  
AWS - Lambda     3    
AWS - S3     3    
AWS - SNS/SQS     3    
AWS - CloudFormation     3    
Python     3    
node.js Development     3    
JavaScript (ES6)    2      
 
Overview:
  • We are seeking a highly skilled Data Engineering – Quality Engineer to define and implement end-of-the-end testing strategies for a modern data platform built on AWS.
  • This role will be responsible for ensuring data quality, reliability, and performance across the entire pipeline; from ingestion to transformation and reporting.
 
Process:
  • Hiring team appreciates it when suppliers add the tech-stack grid to the resume (vs just in submission comments).
  • Remote Interview Protocol (share document w/candidate to set expectations and upload image upon accepting invitation).
  • .5 interview w/mgr> 90 mins w/panel > - remote onboarding each Tues 8:45 EST - 9:00 EST.
 
Key Responsibilities:
  • Define the end-to-end testing scope based on solution architecture and project documentation.
  • Design and implement a comprehensive testing strategy and plan aligned with organizational QA standards.
  • Develop and maintain test scripts and frameworks for the Redshift serverless platform.
 
Perform testing across key technologies, including:
  • AWS Redshift
  • AWS DMS (Data Migration Service)
  • AWS Glue
  • PySpark Deequ
  • Event Bridge
  • Data Lakes
  • Python-based data pipelines
  • Apache Airflow
  • dbt (data build tool)
 
Build and implement automated testing solutions to ensure:
  • End-to-end data validation.
  • Data ingestion accuracy.
  • Transformation logic integrity.
  • Data pipeline reliability.
  • Conduct test coverage analysis and ensure adequate validation across all data engineering workflows.
  • Prepare and manage test data.
 
Review and provide feedback on:
  • Solution architecture.
  • Data models.
  • Design and technical documentation.
 
Collaborate with cross-functional teams (Data Engineering, BI, DevOps, Product) to:
  • Identify testing impacts.
  • Mitigate risks.
  • Ensure high-quality deliverables.
 
Required Qualifications:
  • Proven experience in data engineering testing / data QA / ETL validation.
  • Strong hands-on experience with AWS data services (Redshift, Glue, DMS).
  • Proficiency in Python for test automation and validation.
  • Experience with Airflow and orchestration testing.
  • Hands-on experience with dbt and data transformation validation.
  • Familiarity with CDK for infrastructure validation.
  • Experience in BI testing in Quicksuite will be highly beneficial.
  • Experience with data quality tools such as PySpark Deequ or similar.
 
Strong understanding of:
  • Data warehousing concepts.
  • ETL/ELT pipelines.
  • Data validation techniques (schema, reconciliation, anomaly detection).
 
Preferred Qualifications:
  • Experience designing enterprise-level test strategies for data platforms.
  • Knowledge of CI/CD pipelines for data and test automation.
  • Experience working in Agile / Scrum environments.
  • Familiarity with data observability frameworks.

Why TalentBurst?
At TalentBurst, we deliver more than talent, we deliver outcomes. We partner with you to move quickly and connect you to opportunities aligned with your skills and long term growth.

Backed by precision, transparency, and results, we connect top talent with leading organizations through trusted partnerships.

We offer competitive compensation and comprehensive benefits, including medical, dental, vision, and retirement options.

TalentBurst is an equal opportunity employer committed to an inclusive and diverse workforce.

Data Engineer Related jobs

Other jobs at TalentBurst, an Inc 5000 company

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.