Sr. Data Engineer

This is a remote position.

The Sr. Data Engineer will play a strategic role in designing, developing, and optimizing advanced data pipelines and infrastructure to support our client's enterprise data modernization efforts. This role is critical to delivering scalable, secure, and high-performance data solutions that drive analytics, reporting, and AI/ML initiatives across the organization. The ideal candidate will bring deep technical experience with the Azure data ecosystem, demonstrate leadership in data architecture and governance, and proactively support the team’s growth and capability maturity.

The Sr. Data Engineer is a full-time, remote, exempt position and reports to the Sr. Director, Data and Analytics.

Base Salary: $130,000 - $155,000.

Specific Responsibilities:

• Lead the design and optimization of data pipelines in Databricks and Azure Data Factory for real-time and batch workflows.
  
• Architect and manage datasets in Delta Lake and OneLake, ensuring performance, scalability, and compliance.
  
• Oversee data ingestion, transformation, and delivery to Azure SQL Managed Instance, Synapse, and Snowflake.
  
• Develop, maintain, and review Power BI dashboards and data visualizations in support of key stakeholders.
  
• Partner with data scientists to prepare data for AI/ML modeling, training, and deployment.
  
• Write, review, and maintain robust, production-grade SQL and Python code for large-scale data workflows.
  
• Monitor, troubleshoot, and improve data pipeline reliability, latency, and quality.
  
• Champion metadata management, data cataloging, lineage tracking, and documentation efforts.
  
• Promote best practices for data governance, including data security, privacy, and quality frameworks.
  
• Provide guidance and mentorship to junior engineers and interns.
  
• Participate in Agile sprint planning and lead technical discussions during knowledge-sharing sessions.
  

Supervisory Responsibilities:

• This position does not have direct reports. However, the Sr. Data Engineer may collaborate with contractors or external vendors on specific initiatives and is encouraged to provide technical guidance to interns or newer team members when appropriate.
  

Requirements

• Advanced proficiency in SQL, Python, and PySpark.
  
•  Deep experience with Databricks, Delta Lake, Azure Data Factory, and related Azure services.
  
•  Familiarity with Microsoft Fabric, OneLake, and medallion architecture concepts.
  
•  Strong Power BI development experience including DAX, row-level security, and performance optimization.
  
• Experience designing scalable cloud data architectures and implementing data quality frameworks.
  
• Working knowledge of Snowflake, Azure SQL, and Synapse Analytics.
  
• Exposure to AI/ML workflows, including MLOps, feature engineering, and data versioning.
  
• Strong understanding of data governance, PII/PHI compliance, and security best practices.
  
• Excellent communication skills in a remote, cross-functional team environment.
  
• Experience using Git, DevOps tools, and CI/CD pipelines for data engineering workflows.
  

Experience:

• 4–7 years of hands-on experience in a data engineering or analytics engineering role.
  
• Demonstrated success leading data modernization or migration initiatives in cloud environments.
  
•  Prior experience working with healthcare or other regulated data environments is highly desirable.
  

Education:

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field.
  
• Azure Data Engineer Associate or related certification (preferred).
  
• Coursework or certification in AI/ML (preferred but not required).
  

Benefits

Our client offers competitive compensation along with an extensive benefits package for all full-time employees, including medical, dental and vision coverage, tuition assistance and a 401k. They​ offer full-time remote work to all staff from any location and maintain a physical office in downtown Washington, DC.