Offer summary
Qualifications:
6+ years of experience, Proficient in Python 3.9.1, Pyspark 3.X, Experience with AWS services (EMR, S3, EC2), Familiarity with Postgres V13, Knowledge of tech stacks like Python, AWS.Key responsabilities:
- Develop and deploy Spark applications on AWS EMR
- Build workflows using state machine and step function on AWS
- Work with Jenkins, Bitbucket/Git, Apache Airflow
- Configuration of spark clusters and leveraging AWS Glue service
- Provide limited ML support as needed