Key Facts

Remote From:

Anywhere

Full time

English

Hard Skills

Other Skills

•
Quick Learning
•
Communication

Roles & Responsibilities

Experience in developing data pipelines that process large volumes of data using Python, PySpark, and Pandas on AWS or Azure.
Experience in developing ETL, OLAP-based and analytical applications, and ingesting batch and streaming data from various data sources.
Strong SQL skills with experience in RDBMS (Oracle, PostgreSQL, SQL Server) and data warehouses (Snowflake, Redshift).
Exposure to cloud data services and tools across AWS and Azure (e.g., AWS Lambda, Glue, Athena, Redshift, Kinesis; Azure Data Factory, Azure Databricks, Synapse, ADLS, Key Vault, Azure SQL DB).

Requirements:

Design, develop, and maintain data pipelines on AWS and Azure using Python, PySpark, and Pandas.
Develop ETL, OLAP-based and analytical solutions and implement ingestion of batch and streaming data from diverse sources.
Write and optimize complex SQL queries across RDBMS and data warehouses (Oracle, PostgreSQL, SQL Server, Snowflake, Redshift).
Collaborate in Agile projects, contribute to CI/CD pipelines, and integrate Rest APIs as needed.

IMC Group (Member Firm of Andersen Global)

About IMC Group (Member Firm of Andersen Global)

IMC is a leading cross-border advisory firm, and it serves large companies, multinational corporations, small and medium-sized enterprises, high-net-worth individuals, family-owned businesses and start-ups. It is a Member Firm of Andersen Global in the United Arab Emirates, Singapore and India. Andersen Global was established in 2013 as an association of legally separate, independent member firms. It is comprised of more than 13,000 professionals worldwide, over 1,800 global partners, and a presence in over 390 locations in more than 170 countries worldwide. IMC offers a wide range of services, including Corporate Advisory, Global Mobility, Mergers & Acquisitions, Governance, Risk & Compliance, Accounting, Private Client & Family Advisory, Outsourcing Solutions and Digital Transformation.

Founded: 2018

Company size: 51 - 200

LinkedIn See all jobs →

Job description

Requirements

Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on AWS / Azure

Experience in developing ETL, OLAP based and Analytical Applications.

Experience in ingesting batch and streaming data from various data sources.

Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)

Ability to quickly learn and develop expertise in existing highly complex applications and architectures.

Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.)

Proficiency in Azure technologies

such as Azure Data Factory (ADF), Azure Data Bricks (ADB),Azure Synapse Analytics, Azure Active Directory, Azure Storage, Azure data Lake Services (ADLS), Azure key vault, Azure SQL DB, Azure HD Insight.

Experience in Airflow DAGS, AWS EMR, S3, IAM and other services

Snowflake or Redshift data warehouses

Experience of DevOps and CD/CD tools.

Familiarity with Rest APIs

· Clear and precise communication skills

· Experience with CI/CD pipelines, branching strategies, & GIT for code management

· Comfortable working in Agile projects