Key Facts

Remote From:

Full time

English

Hard Skills

Azure Databricks Azure Data Factory Azure Data Lake Apache Spark Microsoft Azure Parallel Computing Query Optimization Apache Spark Fraud Detection Angular (Web Framework) Application Programming Interface (API) Scala (Programming Language) Java (Programming Language) Design Specifications

Other Skills

•
Mentorship
•
Team Leadership

Roles & Responsibilities

Experience with Azure services including Azure Databricks (ADB), Azure Data Lake Storage (ADLS), and Azure Data Factory (ADF)
Experience with Spark and distributed data processing
Proficient in PySpark
Experience in leading a small team and providing design/technical guidance

Requirements:

Lead and mentor a small data engineering team, guiding design and technical decisions
Design and implement end-to-end data pipelines using Azure services (ADB, ADLS, ADF) and PySpark
Develop and optimize complex SQL queries and Spark jobs for large-scale data processing in the Banking/Financial Services domain
Collaborate with stakeholders to translate business requirements into scalable data solutions and ensure domain compliance

MDA Edge

About MDA Edge

Our objective is to establish an exceptional ecosystem by connecting individuals, technology, and prospects through the application of human intelligence.MDA Edge is a process-oriented company and our expertise lies in providing comprehensive Workforce Solutions, specifically focusing on Contingent Staffing, Bulk/Project Staffing, RPO/KPO/BPO, and Direct Hire services. We cater to a wide range of industries, including Infrastructure Consulting, Engineering Consulting, IT Consulting, Healthcare, Life Sciences, Pharmaceutical Consulting, Consumer Goods, Education, Transportation & Logistics, Media & Entertainment, Telecom, BFSI, Manufacturing, Utilities & Energies, and Corporate Recruitment. Moreover, we have developed a dedicated focus on Government Consulting.Our company prides itself on a meticulous approach, ensuring that we meet your specific needs. We have established a robust network of highly skilled professionals who are readily available to fulfill your requirements. With a strong commitment to excellence, we consistently deliver exceptional results for clients in India, Denmark, France, Germany, Ireland, Japan, Spain, Thailand, the USA, Canada and Mexico, with ongoing expansion efforts to serve more new regions in the near future.We consistently uphold the highest standards of quality by providing resources, time, and materials to design, implement, and support efficient operations for organizations. Our track record of measurable accomplishments demonstrates our commitment to cultivating a balanced work and societal ecosystem.Our continuous growth, successful customer engagements, and strong customer retention exemplify our achievements. Furthermore, our passion lies in streamlining complex business processes through the application of suitable technology, which has been integral to our success.We extend an invitation to join our dynamic workplace, offering rapid growth opportunities, excellent employee benefits, and a positive work-life balance.

Company type: Scaleup

Founded: 2018

Company size: 201 - 500

Website LinkedIn See all jobs →

Job description

Must Have Skills:

Experience with Azure Services like – ADB, ADLS, ADF.
Experience with working on Azure platform.
Experience with Spark – distributed processing.
Have knowledge of PySpark.
Have managed a small team– helped the team with design/technical questions.
Complex SQL Queries, Azure data bricks, Azure data lake, PySpark/Spark, Azure Data Factory.
Experience of working within Banking/Financial Services Industry.