Offer summary

Qualifications:

Proficiency in PySpark, SQL, and data modeling techniques., Experience with cloud computing platforms like AWS or Azure., Knowledge of big data tools such as Hadoop, Spark, and related technologies., Background in data engineering, batch and real-time processing, and scripting languages..

Key responsibilities:

Develop and maintain PySpark and Python code for analytics in a cloud environment.

Collaborate with cross-functional teams to design and implement data solutions.

Ensure compliance with security policies and stay updated with cloud technology advancements.

Work in an Agile environment to deliver data engineering projects.

Job description

Must to have skills: Pyspark, SQL, Cloud computing(AWSAzure or any other cloud)

JOB DESCRIPTION
§ Work with extremely talented peers in a client environment to build new and enhancemaintain existing PySpark, Python codes that generates analytics insights leveraging the big data environment in AWS
§ Proficiency in SQL Writing, SQL Concepts, Data Modelling Techniques & Data Engineering Concepts
§ Experience in working with batch processing realtime systems using various technologies like Airflow, Databricks, HDFS, Redshift, Hadoop, Elastic MapReduce on AWS
§ Familiar with tools like Git, Code Commit, Jenkins, Code Pipeline
§ Work in a Cross functional team along with other Data Engineers, QA Engineers and DevOps Engineers.
§ Work with Functional Analysts to understand the core functionalities of the solution and build Data Models, Design Documents
§ Develop, test and implement data solutions based on finalized design documents.
§ Ensure adherence with Security and Compliance policies
§ Stay uptodate with evolving cloud technologies and development bestpractices including opensource software.
§ Work in an Agile Environment