Match score not available

Big Data Engineer

Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

3-6 years experience in data engineering, Strong expertise in Python, Java, or Scala, Advanced SQL querying skills, Experience building data pipelines and optimizing algorithms, Knowledge of AWS EMR and Spark.

Key responsabilities:

  • Design, build, and optimize data pipelines
  • Collaborate with stakeholders to enhance analytics capabilities
  • Optimize algorithms and work on complex SQL queries
  • Manage and process large data sets in AWS environment
  • Implement test-driven development and maintain unit tests
ASCENDING logo
ASCENDING Startup https://ascendingdc.com/
11 - 50 Employees
See more ASCENDING offers

Job description

Job Title: Big Data Engineer (Junior-Mid Level)
Location: 100% Remote DMV Area (Preferred) 

Our client is seeking a talented Big Data Engineer to work on internal technical initiatives in data engineering, data analytics, and software integration. This is a highly technical role in a true big data environment hosted on AWS Cloud. The ideal candidate will have 3-6 years of experience, with a strong focus on building data pipelines, optimizing algorithms, and advanced SQL querying, rather than traditional ETL pipelines.

Responsibilities:
  • Design, build, and optimize data pipelines to support business initiatives.
  • Collaborate with the internal business stakeholders to improve data engineering and analytics capabilities.
  • Optimize algorithms and work on complex SQL queries for data solutions.
  • Work within an AWS environment, particularly EMR, to manage and process large data sets.
  • Use Python, Java, or Scala for development, alongside test-driven development practices.
  • Build and maintain unit tests to ensure code quality.
Required Skills:
  • 3-6 years of hands-on experience in data engineering.
  • Strong expertise in Python (or Java/Scala), with proven coding proficiency.
  • Advanced experience in SQL, specifically for structuring complex queries.
  • Experience building data pipelines (not ETL) and optimizing algorithms.
  • Knowledge of AWS EMR and working in a big data environment.
  • Familiarity with Spark and test-driven development.
Preferred Qualifications:
  • Bachelor's degree in Computer Science, Mathematics, Physics, or Electrical Engineering.
  • DMV area candidates preferred, though remote options may be available for exceptional candidates.

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Collaboration
  • Mathematics

Data Engineer Related jobs