Staff Data Systems Engineer

At Index Exchange, we’re reinventing how digital advertising works—at scale. As a global advertising supply-side platform, we empower the world’s leading media owners and marketers to thrive in a programmatic, privacy-first ecosystem. 

We’re a proud industry pioneer with over 20 years of experience accelerating the ad technology evolution. Our proprietary tech is trusted by some of the world’s largest brands and media owners and plays a crucial role in keeping the internet open, accessible, and largely free. 

We process more than 550 billion real-time auctions every day (in comparison, Google processes 8.5 billion searches per day) with ultra-low latency. Our platform is vertically integrated from servers to networks and runs primarily on our own metal and cloud infrastructure. This end-to-end infrastructure is designed to provide both stability and agility, enabling us to adapt quickly as the market evolves. 

At the core of it all is our engineering-first culture. Our engineers tackle internet-scale problems across tight-knit, global teams. From moving petabytes of data and optimizing with AI to making real-time infrastructure decisions, Indexers have the agency and influence to shape the future of advertising. We move fast, build thoughtfully, and stay grounded in our core values. 

About The Role: 

We’re looking for a Staff Engineer, Data Systems to join our team and help build and maintain the next generation of big and small data solutions at Index Exchange. Data is a big deal at Index Exchange (Index). Index’s advertising exchange handles billions of auctions and generates terabytes of auction-related information every day. Our team builds tools and infrastructure to manage this vast amount of data and make it available to both internal and external customers and partners for their reporting and analytics as well as machine model training needs.  

Working with exciting technologies, your team will experiment with new tools and engineer innovative approaches to solve interesting challenges under your technical leadership. Things shift very quickly in our industry, and we rely on our Technology Operations and Engineering teams to keep Index and our clients ahead of the curve and moving in the right direction. We are looking for Engineers who have experience in an Agile environment, who can execute and innovate between all layers of the data stacks, from application event driven systems and RDBs to big data query engines and storage patterns and their automation pipelines. 

What We’re Looking For: 

• Experience and Execution: An established engineer with exposure execution of projects at a lead/staff level or a functional area. A developer first and for most, that understands how to operate, scale and join various data systems. 
• Problem Solvers: You don’t stop until the problem gets solved and you find more than one way to solve it. You love working with other people, presenting your viewpoint but ultimately working towards the best solution, regardless of where it comes from. 
• Knowledge Hungry: Learning new frameworks and languages is exciting to you – you’re not satisfied with the status quo. We use a variety of languages and tools to solve problems and we're interested in what you're looking to learn. 
• Passionate and Self Motivated: You have a passion for Small and Big Data and an interest in the latest trends and developments constantly researching new tools and data technologies 

Here’s What You’ll be Doing: 

• Evaluate new technologies, design, implement, and maintain big and small data systems and their associated pipelines (governance, audit, installations, operations, best practices, code libraries)
• Maintain, operate, expand and govern existing big and small data systems (from small caches and RDBs in Kubernetes to large Trino/Spark/Hadoop/OLAP clusters)
• Automate and manual hardships, deployments, create CI/CD pipelines for everything, best practices, and internal methodologies for making everyone's life “just that much easier.”
• Lead and mentor team members
• Identify and assess potential solutions for technical and business suitability
• Have a deep understanding about Index and its products. Drive initiatives that produce positive outcomes across divisions 

Here's What You Need: 

• Bachelor/ Master’s Degree in Computer Science or Engineering related fields
• 8+ years of experience as a Senior Software Engineer in enterprise grade, large scale distributed software product development
• 5+ years of work experience designing and building high performance data pipelines and applications using Hadoop, Spark, Hive, Presto, Kafka and Flink streaming, Druid, or other similar technologies
• General Working and Operational knowledge in traditional RDBS (mysql, postgres, etc)
• Proficiency in some of the following languages: Kotlin, Scala, Java, Python, Golang, Rust, Bash
• Deep understanding of design principles of distributed systems and familiar with mainstream big data related technologies and distributed frameworks
• Strong technical leadership, mentorship, collaboration, and communication skills
• Exposure to working with a globally distributed, culturally diverse team
• Knowledge of data modeling, index patterns, query optimization.
• Some Experience NoSQL systems, usage, operations, installations (cassandra, redis, scylladb, keyDB, etc)
• Experience with automated testing systems
• Experience working in Agile methodologies with continuous integration and delivery as CI/CD
• Experience working with containerization, and virtualization tools such as Kubernetes, Docker
• Some experience with scheduling tools such as airflow, oozie 

Equal employment opportunity

At Index Exchange, we believe that successful products are built by teams just as diverse as the audience who uses them. As such, we are committed to equal employment opportunities. We celebrate diversity of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or expression, or veteran status. Additionally, we realize that diversity is deeper than any status or classification—diversity is the human experience. For those who show grit, passion, and humility—Index will welcome you.

Accessibility for applicants with disabilities

Index Exchange welcomes and encourages individuals with disabilities to apply to work with us. 

If you require an accommodation, please share the details of your request and any information how we can assist you with the hiring recruiter when they contact you. Index Exchange will make reasonable efforts to ensure accommodation requests are met throughout the recruitment process.

Index Everywhere, Index Anywhere

Our corporate headquarters are in Toronto, with major offices in New York, Montreal, Kitchener, London, San Francisco, and many other global cities. As a major global advertising exchange, we are committed to operating as a tightly knit global team and embracing and empowering talent wherever our colleagues may be.  

#LI-REMOTE

#LI-AS4