Experience with Azure Data Factory (ADF) and ADLS for cloud-based data pipelines and storage
Strong knowledge of Snowflake architecture (streams, tasks, pipeline processing)
Experience with data ingestion tools (Fivetran, HVR) and transformation using dbtLabs
Understanding of batch and near real-time data integration patterns
Requirements:
Develop, maintain, test and debug software and data integration solutions to meet generally defined requirements in both traditional and cloud-based environments utilizing software development languages and tools.
Formulate and define system scope and objectives through research and fact-finding for the purpose of developing or modifying moderately complex information systems and data pipelines.
Prepare detailed specifications from which programs and data processes will be written; design, build, test, debug, document and maintain scalable applications and data solutions.
Job description
Our Client, a Business Solutions company, is looking for a Senior Data Engineer for their Memphis, TN location.
Responsibilities:
Develop, maintain, test and debug software and data integration solutions to meet generally defined requirements in both traditional and cloud-based environments utilizing software development languages, modern data platforms, and tools such as PL/SQL, Oracle, .Net, Microsoft SQL, Azure Data Factory, Snowflake, and related technologies.
Formulate and define system scope and objectives through research and fact-finding for the purpose of developing or modifying moderately complex information systems and data pipelines.
Prepare detailed specifications from which programs and data processes will be written; and to design, build, test, debug, document and maintain scalable applications and data solutions, including ETL/ELT processes, leveraging modern cloud data platforms.
Requirements:
Experience with Azure Data Factory (ADF) and ADLS for cloud-based data pipelines and storage
Strong knowledge of Snowflake architecture (streams, tasks, pipeline processing)
Experience with data ingestion tools (Fivetran, HVR) and transformation using dbtLabs
Understanding of batch and near real-time data integration patterns
Ability to design and support scalable cloud data architecture
Experience with Git, CI/CD, and Azure DevOps within data engineering workflows
Experience documenting ETL designs, data mappings, and architecture
Focus on data integrity, governance, lineage, and production support (monitoring and performance tuning)
