Logo for Team Cymru

Data Platform Engineer

Role overview

Summary

This role focuses on designing and building the Go services and pipelines that power Team Cymru's data lake. You will collaborate with threat intelligence analysts to translate workflows into scalable software, ensuring the reliability and performance of systems that support cybersecurity efforts.

Qualifications

  • 7+ years of professional software engineering experience, including 3+ years building and operating production Go systems at scale.
  • Deep Go fluency, including concurrency, profiling, performance tuning, and idiomatic testing.
  • Hands-on experience building and running a data lake using the Medallion Architecture in production.
  • Strong working knowledge of an open table format such as Apache Iceberg, Delta Lake, or Apache Hudi.
  • Experience with object storage (S3, GCS, or ADLS) and with partitioning, compaction, and schema evolution at scale.

Responsibilities

  • Design, build, and operate large-scale systems for collecting and processing threat intelligence data into the data lake infrastructure.
  • Own all layers of the data lake, including choosing and tuning table formats and file layout.
  • Write clean, well-tested, maintainable code in Go, contributing to engineering standards and practices.
  • Mentor other engineers through code review and technical guidance.

Key facts

  • Remote from: United States
  • Full time
  • Senior (5-10 years)
  • Data Platform Engineer
  • English

Hard skills

Other skills

  • Communication
  • Collaboration
  • Mentorship

About the company

Team Cymru logo

Team Cymru

  • Cybersecurity
  • 51–200
Since 2005, Team Cymru’s mission has been to save and improve human lives by working with public and private sector analyst teams around the world, enabling them to track and take down bad actors of all kinds. The company delivers comprehensive visibility into global cyber threat activity and is a key source of intelligence for many cyber security and threat intelligence vendors. Its Community Services division provides no-cost threat detection, DDoS mitigation and threat intelligence to network operators, hosting providers and more than 143 CSIRT teams across 86+ countries. Enterprise security teams rely on its Pure Signal™ platform for on-demand visibility into what’s happening virtually anywhere across the internet with a clarity similar to that of their own internal network telemetry. With this visibility, they close detection gaps, accelerate incident response and detect threats and vulnerabilities across entire enterprises and third-party ecosystems.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Join the mission to make the digital world safer.

About Team Cymru

Team Cymru’s mission is to save and improve human lives by helping public and private sector analysts track and take down cybercriminals. We provide visibility into global cyber threat activity and are a key intelligence source for leading cybersecurity and threat intelligence vendors.

Our Pure Signal™ platform gives enterprise security teams on-demand access to global internet traffic telemetry, providing clarity into what’s happening across the internet with a level of visibility comparable to their own internal networks. This allows organizations to close detection gaps, accelerate incident response, and get ahead of critical, recurring threats.

Team Cymru is a fast-paced, distribution-focused, private equity-backed company where your work directly supports a mission that protects millions worldwide.

We’re looking for a Senior Software Engineer to design and build the Go services and pipelines that power our data lake. You’ll own how raw data lands, gets cleaned and conformed, and becomes trusted, business-ready datasets across our bronze, silver, and gold layers. You’ll operate with significant technical ownership, working closely with stakeholders to turn deep domain knowledge into reliable, production-grade systems. This role suits an engineer who can move fluidly between hands-on coding, system design, and mentoring, and who is energized by the mission-driven, high-signal nature of threat intelligence work.

Key Responsibilities:

Data Lake Design & Development

  • Design, build, and operate large-scale, high-throughput systems for collecting, processing, enriching, and ingesting threat intelligence data (network telemetry, indicators of compromise, or similar) into our data lake infrastructure
  • Own all layers of the data lake: bronze, silver, and gold
  • Choose and tune table formats, partitioning, compaction, and file layout to balance cost, latency, and query performance
  • Own significant components or services end-to-end, from technical design through deployment, monitoring, and iteration in production
  • Write clean, well-tested, maintainable code in Go, and contribute to our engineering standards and practices
  • Participate in architectural decisions, design reviews, and technical planning; provide informed input on trade-offs around scale, latency, and data integrity

Collaboration & Domain Translation

  • Partner directly with threat intelligence analysts and researchers to translate investigative workflows and detection logic into scalable software
  • Collaborate cross-functionally with product, security, and data teams to prioritize work that has direct impact on customer and analyst outcomes

Reliability & Operations

  • Improve the reliability, performance, and observability of existing systems, including on-call participation for services you own

Mentorship & Engineering Quality

  • Mentor other engineers through code review, pairing, and technical guidance; help raise the bar for engineering quality across the team

Qualifications & Experience

  • 7+ years of professional software engineering experience, including 3+ years building and operating production Go systems at scale
  • Deep Go fluency: concurrency (goroutines, channels, context), profiling and performance tuning, memory management, and idiomatic testing
  • Hands-on experience building and running a data lake using the Medallion Architecture (bronze, silver, gold) in production
  • Strong working knowledge of an open table format such as Apache Iceberg, Delta Lake, or Apache Hudi, and columnar formats like Parquet
  • Experience with object storage (S3, GCS, or ADLS) and with partitioning, compaction, and schema evolution at scale
  • Demonstrated experience designing distributed systems; you can reason clearly about trade-offs in scalability, reliability, latency, and cost
  • Experience working with large or high-velocity datasets; familiarity with streaming or batch data pipeline technologies is a strong plus
  • Experience building and maintaining ClickHouse and PostgreSQL databases

Additional Skills

  • Genuine interest in cybersecurity or threat intelligence; prior experience in the domain is a plus but not required for a strong engineer with the right curiosity and aptitude
  • Excellent written and verbal communication skills, including the ability to explain technical trade-offs to non-engineering stakeholders
  • A collaborative, low-ego approach to technical disagreement, mentorship, and cross-team problem-solving
  • Experience with the specific data domains relevant to threat intelligence (network flow data, DNS, malware analysis, OSINT, or similar)
  • Experience with AWS and infrastructure-as-code tooling
  • Familiarity with security frameworks or standards relevant to the industry (MITRE ATT&CK, STIX/TAXII)
  • Prior experience in a startup or fast-scaling engineering organization, including comfort with ambiguity and shifting priorities
  • Open-source contributions or a public track record of technical writing or speaking

Education and Certifications

  • Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience

Travel

Occasional travel for team meetings or industry events may be required.

Why Join Team Cymru? 

At Team Cymru, we provide unmatched global threat intelligence that empowers organizations to proactively disrupt adversaries. You'll be at the forefront of cybersecurity innovation, helping customers harness the full power of our threat intelligence to achieve critical business and security outcomes. 

We offer a collaborative, mission-driven culture where your expertise and impact will directly contribute to improving global security. 

Ready to make an impact?

Apply now and help shape the financial future of a company protecting millions worldwide.

This job description is not exhaustive. Responsibilities may evolve as needed. Team Cymru is an equal opportunity employer and welcomes applicants from all backgrounds. This is a remote position.

#LI-BR1

Related jobs

See all Data Platform Engineer jobs

Other jobs at Team Cymru