Offer summary
Qualifications:
A minimum of 5 years of experience as a technical lead in building complex data systems., Advanced proficiency in Python and strong SQL writing skills., Expert-level knowledge of Elasticsearch and data pipeline tools like Spark, Hive, and Airflow..
Key responsabilities:
- Lead the design, development, and optimization of complex data systems, including Elasticsearch clusters management.
- Create and optimize indices, build queries, and implement data ingestion pipelines into Elasticsearch.
- Oversee performance monitoring, security protocols, backup procedures, and version management of Elasticsearch clusters.
- Develop and maintain data pipelines using Apache Spark, Hive, Airflow, and ensure data flow observability.
- Apply Agile practices and CI/CD to enhance data engineering workflows.