Key Facts

Remote From:

Full time

Senior (5-10 years)

English

Hard Skills

Java (Programming Language) AWS Cloud Services Performance Systems Analysis Apache Spark Data Modeling Agile Software Development Multiprocessing Linux Relational Database Management Systems Batch Processing CI/CD Big Data Kinaxis (Software) Control-M (Batch Scheduling Software) Apache Kafka Data Streaming SQL Server Reporting Services Data Libraries

Roles & Responsibilities

Minimum 6 years of IT experience with a focus on Big Data technologies.
Proficiency in PySpark, Core Java, and Linux/UNIX environments.
Experience with RDBMS databases and performance tuning in PySpark.
Knowledge of AWS platform, Agile methodologies, and CI/CD processes.

Requirements:

Design and develop big data batch and real-time data services.
Take ownership of complex, business-critical applications.
Implement performance tuning and optimization in PySpark.
Work with streaming technologies like Kafka, Kinesis, and scheduling tools such as Autosys or Control-M.

Job description

JD for Data Engineer with Pyspark – 6+ Years, Bangalore
Required Skills
Ø 6 to 10 years of overall IT Experience
Ø Core Skills Ø Strong hands on working experience of Big Data stack including PySpark and Core Java
Ø Good understanding on RDMS database and LinuxUNIX .
Ø Take ownership of businesscritical and complex applications.
Ø Strong knowledge of multithreading and high volume batch processing.
Ø Able to design Big data batch and real time data services.
Ø Should be good in performance tuning skills in PySpark.
Ø Should have experience on AWS platform.
Ø Hands experience on Agile and CICD process.

Preferred skills
Ø Experience on reporting service implemented on Big database.
Ø Experience on Autosys or ControlM scheduler.
Ø Prefer experience on Kafka , Kinesis, and Streaming real time data.
Ø Experience on Python data libraries.