Experience: 4+
Data Engineer with Python
• Experience in implementing end to end data pipelines using AWS services – Glue, EMR, S3, Redshift, RDS, Airflow
• Expert in programming using Python, Scala or SPARK
• Experience of using Jenkins / Terraform / CloudFormation for deployment of data pipelines, and for infrastructure creation
• Basic experience in data modelling and data quality
• Experience of writing SQL, and performance tuning SQL queries
• Experience of development tools s.a. an IDE (preferably IntelliJ), GitHub, Jenkins