Data Engineer

Work set-up: 
Full Remote
Contract: 
Experience: 
Senior (5-10 years)
Work from: 

Offer summary

Qualifications:

Bachelor's degree in Computer Science, Data Engineering, or related field., At least 5 years of experience in data pipeline development and data engineering., Expertise in AWS data services such as S3, Glue, and Kinesis., Proficiency in Python, SQL, and data processing frameworks like Spark or EMR..

Key responsibilities:

  • Design and implement an S3-based data lake with proper organization.
  • Build data ingestion pipelines for batch and streaming data sources.
  • Develop ETL processes for data cleaning, normalization, and correlation.
  • Collaborate with ML engineers on feature engineering pipelines.

Element logo
Element
11 - 50 Employees
See all jobs

Job description

Who is Element?

We serve as a partner at the intersection of innovation and our clients needs, efficiently crafting meaningful user experiences for government and commercial customers. By breaking down complex problems to their fundamental elements, we create modern digital solutions that drive efficiencies, maximize taxpayer dollars, and deliver essential outcomes that serve the people.

Why Work at Element?

Make an impact that resonatesjoin our vibrant team and discover how you can improve lives through digital transformation. Our talented professionals bring unparalleled energy engagement, setting a higher standard for impactful work. Come be a part of our team and shape a better future.

Position Overview

We are looking for a driven and experienced, permanentfulltime Data Engineer to join our team. As a Data Engineer you will build and maintain the Unified Data Fabric serving as the foundation for a misleading marketing motoring and oversight system, responsible for ingesting, processing, and standardizing data from multiple sources including internal data sources and social media advertising platforms. As a member of this project, you will help ensure the delivery of healthcare to millions of Americans by monitoring and preventing fraud, waste, and abuse.

Key Responsibilities
  • Design and implement an S3based data lake with proper zonebased organization (Raw, Curated, Features, Serving).
  • Build robust data ingestion pipelines for batch and streaming data sources.
  • Develop ETL processes for data cleaning, normalization, and correlation across disparate sourcesImplement data quality validation and monitoring systems.
  • Create and maintain data catalogs and metadata management systems.
  • Design partitioning strategies and optimize data storage for performance.
  • Establish data retention and archival policies.
  • Collaborate with ML Engineer on feature engineering pipelines.

  • Minimal Requirements
  • Bachelors degree in Computer Science, Data Engineering, or related field.
  • 5+ years of experience in data engineering and pipeline development.
  • Expertlevel experience with AWS data services (S3, Glue, Kinesis).
  • Proficiency in Python, SQL, and data processing frameworks (Spark, EMR).
  • Experience with data lake architectures and modern data stack.
  • Strong understanding of data modeling and schema design.
  • Experience with workflow orchestration tools (Airflow or similar).
  • Knowledge of data governance and quality practices.
  • US Citizenship or Permanent Residency required.
  • Must reside in the Continental US.
  • Depending on the government agency, specific requirements may include public trust background check or security clearance.

  • Preferred Qualifications
  • Experience with healthcare or insurance industry data.
  • Familiarity with streaming data architectures.
  • AWS Data Engineer certification.
  • Experience with Parquet, Delta Lake,Iceberg, or other open table formats.
  • Location
    Be in your Element residing anywhere in the Continental US. We are a remotefirst company based in Washington, DC.

    Element is an Equal Opportunity Employer all qualified applicants will receive consideration for employment without regard to age, ancestry, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status, marital status, protected veteran status, or any other legally protected class.

    We believe in a world where solutions we build improve the lives of those who use them.
  • Required profile

    Experience

    Level of experience: Senior (5-10 years)
    Spoken language(s):
    English
    Check out the description to know which languages are mandatory.

    Data Engineer Related jobs