10+ years in data platforms with Azure Databricks, preferably with a P&C (property and casualty) Insurance industry background
Strong ETL design and development experience with IICS (Informatica Intelligent Cloud Services)
Very strong SQL skills; experience with CI/CD and Git repositories
Experience leading ETL/Data Engineering teams and providing technical guidance
Requirements:
Build Data Pipeline Factory and dynamic data integration (internal, client, third-party, and web data) and deliver trusted data products including data typing, data matching, data mapping, data enrichment, and metadata management
Develop smart data structuring and standardization solutions (e.g., NLP, table recognition, auto-mapping to target formats; standardization to uniform target formats and data pools)
Act as a technical guide for ETL data engineers, design and implement ETL solutions, and collaborate with the platform architecture team
Build strong relationships with business and IT stakeholders and ensure alignment with data governance and overall data strategy
Job description
Azure Data bricks consultant 100% Remote
Rate - DOE
Duration - 6 months +
Start date ASAP
Immediate interview
Job Description
Min 10 years in Data platforms including Azure Data bricks + P&C Insurance industry background
Responsibility
Build Data Pipeline Factory including Dynamic data integration (e.g., internal data, client data, third party data, web data, etc.) Trusted data products (e.g., data typing, data matching, data mapping, data enrichment, metadata management, etc.) Smart solutions for structuring data (e.g., natural language processing, table recognition, auto-mapping to target format, etc.) Standardization of data (e.g., mapping to uniform target format, sharing of algorithms, creating data pools, etc.)
Acting as a data ninja: dive deep, flip, slip and transform data
Closely cooperating with platform architecture team,
Being a technical guide for a ETL data engineers team and creating ETL solutions
Building strong relationship with business and it stakeholders