Offer summary
Qualifications:
Strong object oriented programming skills (Python/Java), Experience with big data technologies like Spark, Kafka, Nifi, and datastores, Understanding of schema design, data models, and SQL databases, Experience in cloud computing and distributed systems.
Key responsabilities:
- Design, build, support realtime big data projects
- Develop ETL processes, data integrations, pipelines for data handling
- Implement data validation, quality checks for accuracy
- Troubleshoot production systems and innovate new technologies
- Guide, mentor colleagues and collaborate across functions