Software Engineer - Data Collection

About The Role

We are looking for a Software Engineer - Data Collection to join our dynamic and collaborative team. As a key member of the Agent and Data Collection team, you'll be responsible for building and optimizing systems that collect, process, and analyze API data from a wide array of modern, distributed environments. You'll leverage cutting-edge technologies like eBPF, traffic mirroring, API gateway policies, language agents, and more to ensure the Traceable Platform delivers unparalleled visibility and security.

This team is the backbone of the Traceable platform, driving its core functionality and performance.  Together, you'll solve complex, high-impact challenges that push the boundaries of what's possible, directly contributing to the company's success and continuous innovation. Your work will be integral in shaping the future of API security, ensuring the Traceable platform remains at the forefront of the industry. 

Key Responsibilities

• Build and optimize data collection agents and solutions to extract API traffic, application logs, performance metrics, and other relevant data from distributed systems and services.
• Leverage tools like eBPF, API gateways, traffic mirroring, language-specific agents, and other advanced instrumentation methods to gather real-time data from applications and microservices.
• Design and implement highly scalable, reliable, and performant data collection pipelines that can handle large volumes of traffic and data across diverse environments (cloud, on-premise, hybrid).
• Work closely with engineering, product, and security teams to ensure the data collection solutions meet the needs of Traceable’s platform and customer requirements.
• Continuously improve the accuracy, quality, and efficiency of data collection capabilities, leveraging eBPF. Optimize data extraction and processing for speed, scale, and reliability.
• Develop new features such as bot or ML based protection, improving existing solutions, and solving complex problems that drive innovation in the Traceable Platform.

Qualifications

• Bachelor’s or Master’s degree in computer science
• 4-6 years of experience as a software engineer, with strong programming skills in go/cpp/java
• Strong Data Structures, Algorithms and problem solving skills
• Exceptional Coding Skills
• Excellent communication and collaboration skills
• Ability to work independently with minimal supervision
• Experience with writing policies for API Gateways/Load balancer will be plus.
• Prior experience of contributing to open source projects would be a plus.
• Moderate experience of networking stack (TCP, UDP, L2/L3 layers, L4)
• Moderate experience of various protocols: SSL, TLS v1.2 TLS v.13,  HTTP1, HTTP2, HTTP3, gRPC
• Hands on experience in networking devices (F5 BigIP, Citrix ADC, Avi, Arista etc) will be a big plus
• Languages: Golang, C/C++, Java, JavaScript
• Moderate experience  of Linux networking
• Strong system fundamental & experience (process, cpu, memory, containers, cgroups, filesystem)
• Good experience in kubernetes, AWS