Compensation: $180,000 - $200,000 per year. You are eligible to a Short-Term Incentive Plan with the target at 7.5% of your annual earnings, terms and conditions apply.
Principal Data Engineer- Remote USA
The Principal Data Engineer is responsible for driving the design, development, and implementation of Ambry's data infrastructure and solutions. This role will play a pivotal part in building and maintaining scalable, reliable, and efficient data pipelines, data warehouses, and data lakes. The Principal Data Engineer will collaborate closely with data architects, scientists, and analysts to ensure that data is accessible, secure, and aligned with business objectives. As a Principal Data Engineer at Ambry, you’ll approach tasks with a customer-based, cloud-first mindset to support and enhance various data platform products, including Ambry’s data lakes, streams, and warehouses. This role will be primarily responsible for building, monitoring, and operationalizing our data streams which are hydrated via CDC (change data capture) from a suite of 20 on-prem and cloud databases.
Essential Functions
- Build Kafka connectors to sync updates from source data stores
- Build partitioned Kafka topics to sync updates to destination data marts
- Build multiplexed data analytics workloads using Apache Flink to monitor streaming metrics and perform real-time data transformations
- Build dashboards using Datadog and Cloudwatch to ensure system health and user support
- Build opinionated but accommodating schema registries that ensure data governance
- Work closely with your West Coast based scrum team to submit and review PRs daily, maintain documentation and backlogs, validate builds across multiple environments, and deploy at a 2–4-week sprint cadence
- Design reasonable database schemas with query access patterns as the forethought Build and maintain CI/CD pipelines using infrastructure-as-code
- Iteratively migrate on-prem ETL jobs written in PHP into AWS Flink and Glue processes Partner with QA Engineers in building automated test suites
- Partner with end-users to resolve service disruptions and evangelize our data product offerings Vigilantly oversee data quality and alert upstream data producers of all disparities, latency, and defects
- Develop and maintain the overall data platform architecture strategy, roadmap, and implementation plans to support the company's data-driven initiatives and business objectives.
- Design and implement scalable, secure, and high-performance data architectures, including data warehouses, data lakes, and data pipelines, leveraging both on-premises and cloud technologies.
- Establish data governance policies, standards, and best practices for data management, data quality, data security, and data privacy across the organization.
- Lead the development and implementation of real-time data streaming solutions, including event-driven architectures, data ingestion, transformation, and consumption using technologies like Apache Kafka, Apache Flink, and AWS Managed Streaming for Kafka (MSK).
- Oversee the creation and maintenance of Business Intelligence (BI) platforms, data visualization tools, and self-service analytics capabilities to enable data-driven decision-making across the organization.
- Lead and manage a team of data engineers, database administrators, and data analysts, fostering their professional growth, promoting best practices, and ensuring adherence to organizational standards and processes
- Other duties as assigned
Qualifications
- Basic understanding of genomic concepts and terminology
- Willing to work PST hours between 8:00 AM - 5:00 PM or 9:00 AM – 6:00 PM
- Strong familiarity with any combination of our tech stacks in order of importance: Apache Kafka (MSK flavor preferred), Debezium, Python, Apache Flink or PySpark Streaming, MySQL (RDS flavors preferred), Python, CDK or Terraform, Athena, Glue, Lambda, Appflow, HANA/4, PHP, Redis, Docker, Javascript
- Experience building data APIs and offering Data as a Service
- Experience integrating with SaaS platforms such as SAP and Salesforce
- Experience or willingness to learn working with PHP MVC frameworks such as Symfony
- Experience with Atlassian products, i.e. Jira, Confluence, Bamboo
- Experience with system diagramming tools such as Miro, LucidCharts, or Visio
- 6+ years’ experience working with professional scrum teams and/or equivalent schooling
- 4+ years’ experience using Git versioning control
- 3+ years’ experience designing and indexing relational databases
- 2+ years’ experience building and operationalizing real-time data streams
- Bachelor’s or master’s degree in computer, data, math, or life sciences or equivalent work experience
Preferred
- AWS Associate Solution Architect certification
- AWS Data Engineer certification
About Us:
Ambry Genetics Corporation is a CAP-accredited and CLIA-licensed molecular genetics laboratory based in Aliso Viejo, California. We are a genetics-based healthcare company that is dedicated to open scientific exchange so we can work together to understand and treat all human disease faster.
At Ambry, everyone is welcome. A career at Ambry Genetics is a chance to be part of a dynamic company that aims to improve health by understanding the relationships between genetics and human disease. We earned our reputation as industry leaders by responsibly introducing cutting-edge genetic testing solutions and continually sharing what we learn with the global scientific community.
At Ambry you will be learning, challenging yourself, and having fun while collaborating with teammates through the open exchange of ideas. Our outstanding benefits program includes medical, dental, vision, 401k with a 4% employer match, FSA, paid sick leave and generous paid time off (PTO) program. You can learn more about the benefits here. Ambry Genetics is an Equal Opportunity Employer (EOE) and we maintain a drug-free work environment.
Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
All qualified applicants will receive consideration for employment without regard to race (and traits historically associated with race, including, but not limited to hair texture and protective hairstyles such as braids, locks, and twists), color, creed, religion, sex, sexual orientation, gender identity, gender expression (including transgender status), national origin, ancestry, age, marital status or protected veteran status and will not be discriminated against on the basis of disability, protected medical condition as defined by applicable state or local law, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances. If you have a disability or special need that requires accommodation, please contact us at careers@ambrygen.com
Ambry does not accept unsolicited resumes from individual recruiters, third party recruiting agencies, outside recruiters or firms without an executed contract in place. We are not responsible for any fees related to resumes that are unsolicited or are received by Ambry. Such resumes will be deemed the sole property of Ambry and will be processed accordingly.
PRIVACY NOTICES
To review Ambry’s Privacy Notice, Click here: https://www.ambrygen.com/legal/privacy-policy
To review the California privacy notice, click here: California Privacy Notice | Ambry Genetics
To review the UKG privacy notice, click here: California Privacy Notice | UKG
#LI-REMOTE #LI-NK1
