Job description
Senior Elastic Developer
Company Overview
We are seeking an experienced Elastic Developer to join our dynamic DevOps and Platform Engineering team. We are looking for a highly skilled professional with extensive experience in Elasticsearch, Logstash, and Kibana (ELK Stack), capable of managing complex data pipelines, transformations, and advanced use-cases.
Location:
Remote
Responsibilities
Technical Responsibilities:
Elasticsearch Architecture & Query Optimization
Design and implement high-performance Elasticsearch architectures, optimizing query performance and index mappings for specific use-cases.
Data Pipeline Management
Build robust, fault-tolerant data pipelines that clean, transform, and aggregate disjointed data streams into searchable indexes.
Real-Time Data Processing
Implement real-time analytics solutions, taking advantage of Elastic's capabilities to perform operations at scale, possibly in a distributed manner.
API Development & Integration
Build custom APIs that leverage Elasticsearch's capabilities for third-party integrations and integrate existing Elasticsearch APIs into the company's products/services.
Webhook & Trigger-Based Actions
Develop event-driven architectures that make use of webhooks to trigger predefined actions based on specific events or anomalies.
Master Index Management & Data Consolidation
Implement an advanced indexing strategy that includes the consolidation of multiple raw indices into master/golden indices to optimize for search and analytics.
Security & Compliance
Implement security measures like encryption, role-based access, and compliance logging within the Elasticsearch ecosystem.
Scripting & Automation
Develop scripts for automated tasks that relate to index management, data ingestion, and transformation, using languages like Python, Groovy, or Shell scripting.
Disaster Recovery & High Availability
Design and implement strategies for backup, disaster recovery, and high availability, possibly involving cross-cluster search and replication.
Performance Tuning & Monitoring
Continuously monitor system health, tuning performance, and ensuring that the Elastic solutions are optimized and healthy.
Non-Technical:
