Offer summary

Qualifications:

Proficiency in developing data pipelines using Python, PySpark, and Pandas on AWS or Azure platforms., Experience with ETL processes, OLAP, and analytical applications., Strong SQL skills with any RDBMS such as Oracle, PostgreSQL, or SQL Server., Knowledge of AWS and Azure data services like Lambda, Glue, Athena, Redshift, Data Factory, Data Bricks, and Synapse Analytics..

Key responsibilities:

Design and develop data pipelines processing large data volumes.

Ingest batch and streaming data from various sources.

Work with cloud data services to build scalable data solutions.

Collaborate in Agile teams and contribute to CI/CD pipelines.

IMC is a leading cross-border advisory firm, and it serves large companies, multinational corporations, small and medium-sized enterprises, high-net-worth individuals, family-owned businesses and start-ups. It is a Member Firm of Andersen Global in the United Arab Emirates, Singapore and India. Andersen Global was established in 2013 as an association of legally separate, independent member firms. It is comprised of more than 13,000 professionals worldwide, over 1,800 global partners, and a presence in over 390 locations in more than 170 countries worldwide. IMC offers a wide range of services, including Corporate Advisory, Global Mobility, Mergers & Acquisitions, Governance, Risk & Compliance, Accounting, Private Client & Family Advisory, Outsourcing Solutions and Digital Transformation.

Job description

Requirements

Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on AWS / Azure

Experience in developing ETL, OLAP based and Analytical Applications.

Experience in ingesting batch and streaming data from various data sources.

Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)

Ability to quickly learn and develop expertise in existing highly complex applications and architectures.

Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.)

Proficiency in Azure technologies

such as Azure Data Factory (ADF), Azure Data Bricks (ADB),Azure Synapse Analytics, Azure Active Directory, Azure Storage, Azure data Lake Services (ADLS), Azure key vault, Azure SQL DB, Azure HD Insight.

Experience in Airflow DAGS, AWS EMR, S3, IAM and other services

Snowflake or Redshift data warehouses

Experience of DevOps and CD/CD tools.

Familiarity with Rest APIs

· Clear and precise communication skills

· Experience with CI/CD pipelines, branching strategies, & GIT for code management

· Comfortable working in Agile projects