AI Data Engineer

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Deep experience in building and scaling data infrastructure for large-scale ML systems, ideally for video or multi-modal models., Solid background in ML engineering with hands-on experience in training and optimizing classifiers., Expertise in Python, Spark, Airflow, or similar data frameworks., Understanding of modern infrastructure such as Kubernetes, Terraform, and distributed computing environments..

Key responsabilities:

  • Build scalable, high-throughput data pipelines optimized for multi-modal video model training.
  • Develop systems for data ingestion, deduplication, quality assessment, validation, filtering, and labeling.
  • Optimize distributed data processing frameworks like Apache Spark, Ray, and Airflow.
  • Implement strong observability and telemetry for all aspects of the data lifecycle.

Moonvalley logo
Moonvalley Startup https://moonvalley.ai/
2 - 10 Employees
See all jobs

Job description

Moonvalley is developing cutting-edge generative AI models designed to power Superbowl-worthy commercials and award-winning cinematic experiences. Our inaugural, cutting-edge HD model, Marey, is built on exclusively licensed and owned data for professional use in Hollywood and enterprise applications.

Our team is an unprecedented convergence of talent across industries. Our elite AI scientists from DeepMind, Microsoft, Snap and Meta, have decades of collective experience in machine learning and computational creativity. We have also established the first AI-enabled movie studio in Hollywood, filled with accomplished filmmakers and visionary creative talent. We work with the top producers, actors, and filmmakers in Hollywood as well as creative-driven global brands. So far we’ve raised over $70M from world-class investors including General Catalyst, Bessemer, Khosla Ventures & YCombinator – and we’re just getting started.

Role Summary:

We're looking for a Data Engineer to build the data pipelines driving our next-generation generative video models. This role is central to our mission of training models exclusively on clean, high-quality data.

In this role, you'll collaborate with the Data Engineering Lead to develop data ingestion pipelines, captioning systems, and high-throughput, distributed architectures for large-scale data processing and curation.

What You'll Do:

  • Build scalable, high-throughput data pipelines optimized for multi-modal video model training.

  • Build systems for data ingestion, deduplication, quality assessment, validation, filtering, and labeling to ensure only clean, high-quality data flows through the pipeline.

  • Optimize distributed data processing frameworks (e.g., Apache Spark, Ray, Airflow).

  • Work with infrastructure teams to scale pipelines across thousands of GPUs.

  • Implement strong observability and telemetry for all aspects of the data lifecycle.

What We're Looking For

  • Deep experience in building and scaling data infrastructure for large-scale ML systems, ideally for video or multi-modal models.

  • Solid background in ML engineering, including hands-on experience in training and optimizing classifiers.

  • Experience managing large-scale datasets and pipelines in production.

  • Expertise in Python, Spark, Airflow, or similar data frameworks.

  • Understanding of modern infrastructure: Kubernetes, Terraform, object stores (e.g. S3, GCS), and distributed computing environments.

  • Skilled at balancing rapid, iterative delivery with a focus on long-term technical vision, ensuring solutions are both pragmatic and architecturally elegant.

Nice to Haves

  • Experience working on foundational model training pipelines (image, video, or language).

  • Experience with video-specific data challenges like frame sampling, codec variability, temporal alignment, and perceptual quality scoring.

In our team, we approach our work with the dedication similar to Olympic athletes. Anticipate occasional late nights and weekends dedicated to our mission. We understand this level of commitment may not suit everyone, and we openly communicate this expectation.

If you're motivated by deeply technical problems, a seemingly never-ending uphill battle and the opportunity to build (and own) a generational technology company, we can give you what you're looking for.

All business roles at Moonvalley are hybrid positions by default, with some fully remote depending on the job scope. We meet a few times every year, usually in London, UK or North America (LA, Toronto) as a company.

If you're excited about the opportunity to work on cutting-edge AI technology and help shape the future of media and entertainment, we encourage you to apply. We look forward to hearing from you!

The statements contained in this job description reflect general details as necessary to describe the principal functions of this job, the level of knowledge and skill typically required and the scope of responsibility. It should not be considered an all-inclusive listing of work requirements. Individuals may perform other duties as assigned, including work in other functional areas to cover absences, to equalize peak work periods, or to otherwise balance organizational work

Moonvalley AI is proud to be an equal opportunity employer. We are committed to providing accommodations. If you require accommodation, we will work with you to meet your needs.

Please be assured we'll treat any information you share with us with the utmost care, only use your information for recruitment purposes and will never sell it to other companies for marketing purposes. Please review our privacy policy and job applicant privacy policy located here for further information.

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Collaboration
  • Adaptability
  • Problem Solving

Data Engineer Related jobs