Azure Data Architect

Job Description

Data Architect

• Data Warehouse
• Lakehouse (Databricks or Microsoft Fabric)
• Datalake
• ADF/Synapse/Data Pipelines (ETL/ELT)
• Strong SQL and PySpark knowledge
• CI/CD Experience
  
  

Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, or related field AND 4+ years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting. Or, equivalent experience

• 12+ years of experience in implementing large data and analytics platforms
• 6+ years of experience architecting and building data platforms on Azure
• 4+ years of experience architecting and building data platforms on Databricks from scratch
• Experience using Azure Synapse as source or target for the data pipelines in at least 1 project
• Hands on experience using Microsoft Fabric in at least 1 project
• Pro in all Databricks engineering services Unity Catalog, Spark Jobs, Delta Live Table (DLT), DLT Meta, Databricks Workflow, Auto Loader. (You need to ask the candidate)
• Hands on in Databricks SQL, PySpark
• Understanding of data modelling, data mappings, understand the data model changes and propose the best practices and guidelines
• Creating technical design based on end-to-end data architecture and frameworks for meta data driven data ingestion, transformation, logging and monitoring
• Deploying data pipelines/applications to higher environments using CI-CD pipelines
• Experience in writing technical user stories
• Experience in Agile methodology and scrums
  
  

About Us

Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.

Organization

Datavail’s Data Management Services:

Datavail’s Data Management and Analytics practice is made up of experts who provide a variety of data services including initial consulting and development, designing and building complete data systems, as well as ongoing support and management of database, data warehouse, data lake, data integration, and virtualization and reporting environments. Datavail’s team is comprised of not just excellent BI & analytics consultants, but great people as well. Datavail’s data intelligence consultants are experienced, knowledgeable and certified in the best in breed BI and analytics software applications and technologies. We ascertain your business objectives, goals and requirements, assess your environment, and recommend the tools which best fit your unique situation. Our proven methodology can help your project succeed, regardless of stage. With the combination of a proven delivery model and top-notch experience ensures that Datavail will remain the Data Management experts on demand you desire. Datavail’s flexible and client focused services always add value to your organization.