Offer summary

Qualifications:

Minimum 3-4 years of relevant experience in data engineering., Proficiency in Python, with capabilities in Scala or Java., Experience with cloud platforms such as AWS, AliCloud, or Tencent Cloud., Strong SQL skills and familiarity with big data tools like Spark, Kafka, and Airflow..

Key responsibilities:

Design, build, and maintain scalable data pipelines and infrastructure.

Integrate and manage data from multiple sources ensuring data integrity and performance.

Collaborate with data scientists and business teams to provide clean, usable data.

Work on deployment and optimization of big data solutions in the cloud, documenting workflows and best practices.

Job description

Job Description

Must have Skills : Databricks, Python (Capable), AWS

Good To Have Skills : AliCloud, Tencent Cloud

Job Description :

Experience Level: Minimum 3-4 years of relevant experience Preferably some senior profiles to help design architecture and lead delivery

Key Responsibilities: Design, build, and maintain scalable data pipelines and data infrastructure Integrate and manage data from multiple sources ensuring data integrity and performance Collaborate with data scientists and business teams to provide clean, usable data Work on deployment and optimization of big data solutions in the cloud Document data engineering workflows and ensure best practices

Preferred Experience: Experience in the pharma/healthcare domain (nice-to-have) Exposure to supporting recommendation engines / next-best-action platforms

Technical Skills: Proficiency in Python / Scala / Java Strong SQL skills Hands-on experience with cloud platforms: AWS, AliCloud, Tencent Cloud, Databricks Familiarity with big data tools (Spark, Kafka, Airflow, etc.)

Required profile