Offer summary
Qualifications:
Proven experience in real-time data streaming using Spark Streaming or Azure Functions., Strong proficiency in Python for data processing and automation tasks., Hands-on experience with Kafka for data ingestion and message queuing., Familiarity with Redis for caching and fast data retrieval., Knowledge of data lake architectures and best practices for data storage and retrieval..Key responsabilities:
- Design, develop, and maintain real-time data streaming pipelines.
- Integrate processed data into Redis cache and data lake.
- Implement & optimize data processing solutions using Python.
- Apply software engineering best practices & collaborate with teams.
- Ensure efficient data flow & transformation from machine logs.
