Azure Data Engineer

The consultants will work as Azure Data Engineer as stated below.

• End to end development lifecycle, including the following environments Development, QA, Preproduction and Cutover activities
• End to end data flow development including: SAP and Non-SAP Extraction, Ingestion, Data Landing, Data Vault, Data Mart and reporting layer backend.
• End to end data flow development including: Extraction, Ingestion, Bronze, Silver, Gold, Data Mart and reporting layer backend for Lakehouse development.
• Technical design and architecture
• Code review, performance tuning and code optimization
• Assist/Develop Data Models
• Development, unit test and document results
• Technical solutions and quality check
• Data validation and verification
• Support SIT, Regression and performance testing
• Assist UAT testing
• Provide technical documentation that can be used for KT session to the Support team

Required Qualifications:

• Bachelor degree required
• Strong experience working with Azure Platform & Azure BI Stack (Azure data factory / SQL / Azure Synapse /Azure SSAS /Azure DevOps /Azure Pipelines /Azure Data Lake). At least 3 years experience working with Azure Platform & Azure BI Stack
• Deep understanding relational database systems, modern Datawarehouse platforms like Azure SQL Synapse.
• Experience building and automating data system components that enable - Data acquisition, cleansing, and persistence data engineering.

• Proficient in writing complex SQL queries.

• Solid understanding of key Business Intelligence and Analytics trends.
• Experience with Visualization tools like Power BI is a Plus.
• Understanding of how to define and support a data governance framework.
• Experience with implementing companywide Business Intelligence and Analytics programs.
• Understanding of agile software development methodologies.

Personal characteristics:

• Communications skills
• High level of English to mainten conversation with leaders and team members.
• Leadership and proactive actitud
• Innovative and creative personality.
• Smart thinker
• Previous experiences working in corporate companies with different work groups and authorization levels

Essential Functions

• Design and develop data warehouses and data pipelines within Azure

• Design and develop Azure ML model execution pipelines

• Evangelize engineering design and development standards

• Act as a key contributor to the design and development lifecycle of analytic applications.

• Participate in Agile ceremonies including daily stand-ups, sprint planning, retrospectives, and product demonstrations

• Produce efficient and elegant code that meets business requirements

• Author unit tests that adhere to code coverage guidelines

• Proactively communicate progress, issues, and risks to stakeholders

• Accurately estimate assignments

• Create and maintain technical documentation

• Mentor less experienced engineers

• Contribute to the growth and maturity of the Software Engineering Group

• Performs other related duties as directed

Required Skills & Competencies

• 7 years of hands-on experience designing and implementing large-scale distributed data architecture for BI and OLTP systems

• 7 years of hands-on experience designing and implementing large-scale data pipelines

• 4 years of hands-on experience in Azure data services

• 4 years of hands-on experience with data integration using ETL / ELT tools

• Experience doing data migrations from SAP into Azure Datalakes using Theobald.

• 4 years of hands-on experience with Python including object-oriented programming and unit testing

• Advanced experience with one or more Python parallel processing libraries

• Advanced experience with one or more Python data analysis libraries

• Advanced data modeling experience

• Broad experience in Microsoft SQL technologies

• Broad multi-tenant data architecture and implementation experience across different data stores, messaging systems and data processing engines

• Experience with data integration through APIs, Web Services, SOAP, and/or REST services

• Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence

• Knowledge of SOA and Micros Services Application Architecture

• Ability to work in a fast-paced, collaborative team environment

• Excellent written and verbal communication skills and ability to express ideas clearly and concisely.

• Previous experience in Supply Chain related projects.

Desired Attributes

• Strong team player with ability to collaborate with all levels of the organization

• Possess a drive towards forward progress and delivering results while taking responsibility

• Multi-tasker with ability to set and manage priorities

• Proactively and transparently communicate challenges and successes to product leadership

• Exhibit attention to detail

• Flexibility and willingness to help in other areas as priorities shift

• Ability to effectively operate with minimal supervision, but knowing how to keep leadership in the loop

Education or Prior Work Experience

• Bachelor's degree in CS or related field, master's degree preferred

• 7+ years of experience with designing and developing complex data architecture solutions

• 4+ years of design and development experience with Microsoft Azure data architecture and related solutions

• 4 years of hands-on experience with Python