Data Engineer

Job Summary:

The Data Engineer will partner with other Data Engineers to assist in the development, deployment, and maintenance of our organization’s data platform. In a healthcare setting, this involves ensuring that data systems are secure, scalable, and compliant with healthcare regulations, while also supporting the organization's clinical, operational, and strategic goals. You will be a member of a small team of data engineers that are responsible for data engineering, data architecture, data modeling and other key responsibilities that come with managing a data platform. You will also collaborate with other resources in the organization such as data scientists, data analysts, researchers, and other stakeholders to understand business requirements and translate them into scalable and efficient data solutions. Your previous experience in developing data solutions, data integration, and data warehousing concepts will be crucial in ensuring successful delivery of data projects.

Key Responsibilities: 

Development:

• Assist in the development in the end-to-end data solutions on the Azure Platform, including data ingestion, data storage, data processing, and data visualization. Solutions must be tailored for healthcare data, ensuring compliance with HIPAA and other relevant regulations.
• Support the ingestion, integration, storage, processing, and retrieval of health data across various platforms and systems.
• Work with teammates to develop, and implement scalable data pipelines using appropriate data integration patterns (ELT/ETL, streaming, API, etc.) to efficiently and reliably collect, process, and store large volumes of data from various data sources.
• Comply with data architecture standards and best practices for data governance, quality, and security within the healthcare context.

Implementation:

• Collaborate with teammates to assist with the implementation of cloud-based solutions ensuring they meet the specified requirements and best practices. 
• Contribute to the efforts of deployment of cloud infrastructure and services.
• Align with DevOps best practices (IaC, Git, CICD, etc.) to automate the development lifecycle and streamline cloud operations.

Collaboration:

• Work closely with business stakeholders, developers, analysts, IT teams, and other key stakeholders to understand business/data requirements and deliver solutions.
• Collaborate with software developers to integrate data solutions into applications.

Optimization:

• Collaborate with teammates and leadership to continuously evaluate and optimize new and existing cloud solutions to improve performance, scalability, and cost-efficiency.
• Implement monitoring and logging solutions to ensure system reliability and performance.

Security & Compliance:

• Ensure that cloud solutions comply with security standards and regulatory requirements.
• Implement and manage security controls and best practices.

Innovation:

• Stay up to date with the latest cloud technologies and trends.
• Collaborate with teammates and leadership to evaluate new tools and technologies to improve existing solutions or create new ones.
• Develop custom software/data tools as necessary to augment core data systems.

Maintenance & Support:

• Monitor and troubleshoot data pipelines and systems.
• Participate in ongoing support and maintenance for existing data infrastructure.
• Assist with the business continuity and disaster recovery plans to ensure system uptime.

Documentation:

• Document data processes and configurations.
• Maintain clear and comprehensive documentation for data workflows and systems.

Required Skills and Qualifications:

• Bachelor’s degree in computer science, Information Technology, Engineering, or a related field.
• 4-7 years of experience in data engineering, and/or a related field.
• Experience developing data solutions that contain healthcare data. 
• Experience with cloud platforms such as Microsoft Azure.
• Experience with data modeling, data architecture, and data pipeline development.
• Understanding of cloud architecture patterns and best practices.
• Proficiency in cloud services (compute, storage, networking, databases, etc.).
• Experience on data warehousing solutions such as Azure Databricks or Snowflake.
• Experience with Azure data services such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, etc.
• Understanding of Infrastructure as Code (IaC) tools such as Terraform, Azure Resource Manager.Strong programming skills in Python or similar scripting language.
• Experience with programming in SQL and experience with relational and NoSQL databases.
• Experience with User Interface and web development with front-end languages.
• Knowledge of DevOps practices and tools.
• Knowledge of security best practices and tools for cloud environments.
• Strong problem-solving and analytic skills with the ability to troubleshoot and resolve data related issues. 

Preferred Qualifications:

• Certification in cloud platforms (e.g., Azure Data Engineer, Microsoft Certified: Azure Solutions Architect Expert).
• Experience with hybrid cloud and multi-cloud strategies.
• Experience with data migration to cloud platforms.
• Experience with Business Intelligence and data visualization tools.
• Working knowledge of data governance, data security, and data privacy best practices.

The specific statements shown in each section of this description are not intended to be all-inclusive. They represent typical elements and criteria necessary to successfully perform this position.

** In accordance with CareQuest Institute for Oral Health’s Compliance Plan, all employees must conduct CareQuest Institute for Oral Health business and activities in accordance with applicable laws, regulations, professional standards and ethical standards and report potential compliance or ethical issues to CareQuest Institute for Oral Health’s designated Compliance Officer. **

CareQuest Institute for Oral Health’s Affirmative Action Program affirms our commitment to make reasonable accommodation for known physical or mental limitation of otherwise-qualified individuals with disabilities or special disabled veterans, unless the accommodation would impose an undue hardship on the operation of our business and activities. Please see Human Resources for additional information regarding this program.