Offer summary

Qualifications:

Proficiency in developing data pipelines using Python, PySpark, and Pandas on AWS or Azure platforms., Experience with ETL, OLAP, and analytical applications development., Strong SQL skills with any RDBMS such as Oracle, PostgreSQL, or SQL Server., Familiarity with cloud data services like AWS Lambda, Glue, Athena, Redshift, and Azure Data Factory..

Key responsibilities:

Design and develop data pipelines for large-scale data processing.

Implement and maintain ETL and analytical applications.

Ingest batch and streaming data from various sources.

Collaborate on cloud-based data solutions using AWS and Azure technologies.

IMC is a leading cross-border advisory firm, and it serves large companies, multinational corporations, small and medium-sized enterprises, high-net-worth individuals, family-owned businesses and start-ups. It is a Member Firm of Andersen Global in the United Arab Emirates, Singapore and India. Andersen Global was established in 2013 as an association of legally separate, independent member firms. It is comprised of more than 13,000 professionals worldwide, over 1,800 global partners, and a presence in over 390 locations in more than 170 countries worldwide. IMC offers a wide range of services, including Corporate Advisory, Global Mobility, Mergers & Acquisitions, Governance, Risk & Compliance, Accounting, Private Client & Family Advisory, Outsourcing Solutions and Digital Transformation.

Job description

Requirements

Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on AWS / Azure

Experience in developing ETL, OLAP based and Analytical Applications.

Experience in ingesting batch and streaming data from various data sources.

Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)

Ability to quickly learn and develop expertise in existing highly complex applications and architectures.

Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.)

Proficiency in Azure technologies

such as Azure Data Factory (ADF), Azure Data Bricks (ADB),Azure Synapse Analytics, Azure Active Directory, Azure Storage, Azure data Lake Services (ADLS), Azure key vault, Azure SQL DB, Azure HD Insight.

Experience in Airflow DAGS, AWS EMR, S3, IAM and other services

Snowflake or Redshift data warehouses

Experience of DevOps and CD/CD tools.

Familiarity with Rest APIs

· Clear and precise communication skills

· Experience with CI/CD pipelines, branching strategies, & GIT for code management

· Comfortable working in Agile projects

Benefits

Best in the industry

This is a remote position.

Azure Data Engineers / AWS Data Engineers

Offer summary

Qualifications:

Key responsibilities:

Job description

Requirements

Benefits

Required profile

Experience

Hard Skills

Other Skills

Data Engineer Related jobs

Principal Data Science Engineer

Engenharia de Dados

Senior Data Engineer

[Ambev Tech] Engenharia de Dados Pleno e Sênior Vaga afirmativa para PCD

Principal Data Engineer