Offer summary

Qualifications:

Minimum 4 years of engineering experience., Expertise in Python programming., Familiarity with modern data and machine learning tools., Knowledge of distributed systems and scalable design..

Key responsibilities:

Enhance the Python-based ingestion framework for various data sources.

Build connectors for major data and ML systems.

Enable the ingestion framework to operate in cloud-native environments.

Collaborate on developing scalable and fault-tolerant data ingestion solutions.

Job description

DataHub is an AI & Data Context Platform adopted by over 3,000 enterprises, including Apple, CVS Health, Netflix, and Visa. Innovated jointly with a thriving open-source community of 13,000+ members, DataHub's metadata graph provides in-depth context of AI and data assets with best-in-class scalability and extensibility.

The company's enterprise SaaS offering, DataHub Cloud, delivers a fully managed solution with AI-powered discovery, observability, and governance capabilities. Organizations rely on DataHub solutions to accelerate time-to-value from their data investments, ensure AI system reliability, and implement unified governance, enabling AI & data to work together and bring order to data chaos.

In this role, you will

Enhance the Python-based ingestion framework to support ingesting usage statistics, lineage, and operational metadata from systems like Snowflake, Redshift, Kafka, & more!
Build connectors for major systems in the modern data and ML stacks
Enable the ingestion framework to run in a cloud native environment

Requirements:

Minimum 4 years of engineering experience
Expertise in Python
Familiarity with tools in the modern data and ML ecosystem
Knowledge of distributed systems
Ability to design for scale and fault tolerance

Benefits

Competitive salary
Equity
Medical, dental, and vision insurance (99% coverage for employees, 65% coverage for dependents; USA-based employees)
Carrot Fertility Program (USA-based employees)
Work from home and monthly co-working space budget

Required profile