Offer summary
Qualifications:
Experience with Big Data technologies, Proficiency in Azure and Databricks, Strong understanding of data processing architectures, Knowledge of data management and governance, Familiarity with CI/CD and MLOps.Key responsabilities:
- Lead design of data processing architectures
- Design streaming pipelines using Apache Spark
- Implement data management processes
- Collaborate on Machine Learning projects
- Develop data transformations using DBT and Airflow