Onshore - Sr Engg_CurationSup

Location: Remote

Role Overview

We are looking for a Digital Operations Engineer with strong expertise in data engineering, Azure cloud, and data quality frameworks. The role focuses on building scalable data platforms, ensuring high data reliability and quality, and enabling seamless operations through automation and monitoring. The ideal candidate will have hands-on experience with Databricks, Python, SQL, and a strong foundation in data quality and governance practices.

Key Responsibilities

Data Engineering & Platform Development

Design, develop, and maintain robust data pipelines using Azure Databricks, Python, and SQL

Build and optimize ETL/ELT processes for batch and real-time data

Implement scalable solutions using Spark and distributed data processing frameworks

Develop reusable components and standardized data engineering practices

Data Quality & Governance

Design and implement data quality frameworks (validation rules, anomaly detection, profiling)

Establish data quality KPIs such as completeness, accuracy, consistency, and timeliness

Build data validation pipelines and automated checks within ETL processes

Perform root cause analysis for data issues and implement corrective/preventive actions

Collaborate with business teams to define data standards and governance policies

Azure & Databricks Platform

Work on Azure ecosystem: Azure Data Factory, ADLS Gen2, Synapse Analytics, Azure Databricks

Optimize Delta Lake architectures and ensure efficient data storage and access

Implement secure and scalable data lake/lakehouse solutions

Digital Operations & Production Support

Monitor data pipelines and workflows for failures, latency, and performance issues

Ensure production stability, SLA adherence, and incident management

Set up monitoring, logging, and alerting (Azure Monitor, Log Analytics)

Support data reconciliation and audit processes

DevOps & Automation

Implement CI/CD pipelines using Azure DevOps and Git

Automate deployment of data pipelines and infrastructure (ARM templates/Terraform)

Integrate automated data quality checks into CI/CD workflows

Ensure proper versioning and release management practices

Required Skills & Qualifications

Technical Skills

Strong experience in Python and SQL

Hands-on experience with Azure Databricks (Spark, Delta Lake)

Experience with Azure data services (ADF, ADLS, Synapse)

Solid understanding of data engineering concepts (ETL/ELT, data modeling, warehousing)

Proven experience in data quality frameworks, tools, and methodologies

Experience with DevOps tools (Azure DevOps, Git, CI/CD pipelines)

Data Quality Expertise

Experience implementing data validation, profiling, and cleansing techniques

Knowledge of tools/frameworks like Great Expectations, Deequ, or custom validation frameworks

Understanding of data governance, lineage, and metadata management

Operational Skills

Strong troubleshooting and debugging capabilities

Experience in production support and incident handling

Familiarity with monitoring and logging tools

Pay:

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.  The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled.  At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.  A reasonable estimate of the current range is: $150,000 - $170,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits:

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time.  You will be eligible for benefits on the first day of employment with the Company.  In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms.   The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.