Job description

6-8 Years of Experience , 6 M to 1 year of experience in Adobe Experience Platform

Experience as a Data Engineer using Adobe Experience Platform

- Analyze the data engineering use cases from Customers.
- Direct Interaction with Customers on a weekly basis.
- Participate in technical discovery and design discussions and a come up with the Technical Design to meet customer use cases.
- Implement and deploy scalable and fault tolerant ETL pipelines using public cloud(AWS primarily) components
- Designed and implemented SQL(Spark SQL/HIVE) queries for reporting and complex solution development.
- Work closely with Data Scientists and help them to productionize the ML pipelines
- Follow best practices that can be adopted in the Bigdata stack and share across teams.
- Designed internal process improvements to automate repetitive tasks, shortening data delivery times.
- Development stack: Python with Apache Airflow/Docker/PySpark/Kafka/AWS Redshift/AWS EMR/AWS Athena/AWS Lambda/AWS API Gateway