Director of Data Engineering | Allconnect

This role is not open to visa sponsorship or transfer of visa sponsorship including those on H1-B, F-1, OPT, STEM-OPT, or TN visa, nor is it available to work corp-to-corp.

For the Allconnect website click here. Curious how Allconnect fits into Red Ventures? Click here. 

Curious how Home fits into Red Ventures? Click here.

You'll lead the team that builds and scales Red Ventures' data infrastructure, using Databricks, Spark, and our proprietary platforms to move data across the business and turn raw data into the analytics we run on. As a Director who stays close to the technical details, you'll set multi-year direction and grow a team of engineers and engineering managers, while making sure your team has the context and guidance to move fast on their own. Our data team exists to make data easy to use for everyone, and this role owns how we get there, in close partnership with the business leaders who depend on that data.

What You'll Do

• Lead a team of data engineers and engineering managers building large-scale, real-time data pipelines in Spark
• Act as the primary technical liaison to business leadership, translating trade-offs between technology and business priorities in both directions
• Set the multi-year technical direction for Data Engineering and communicate that strategy across both technical and business audiences
• Partner with data scientists, analysts, and business stakeholders to turn business requirements into data products the team builds against
• Represent Data Engineering in cross-functional and executive planning, building alignment across engineering, product, and business leaders
• Set the architectural direction and standards for how data moves across platforms, from streaming ingestion through ETL to aggregation and analytics, hold your managers and teams accountable to that direction, and establish the engineering and agile practices that support delivery speed and quality
• Stay close to the technical details to guide architecture design decisions, performance tuning, and tradeoff calls, and to give your team the context they need to move quickly without waiting on you
• Work with your teams and the RV Data Platform team to design scalable solutions across distributed systems using AWS, Databricks, and modern big data technologies
• Champion a governance-first mindset across your team, making sure the way we collect, move, and use data protects the privacy of the people behind it
• Manage and develop the data engineering managers on your team, setting the bar for how they coach, hire, and run their teams
• Own career development across your org, building growth paths for individual contributors and managers alike, and coaching through regular, direct feedback
• Hold the team accountable for delivering high-quality, scalable solutions across the full data lifecycle

What We're Looking For

• 8-10 years of data or software engineering experience, including 5+ years managing engineering teams and at least 1 year managing managers
• Track record of communicating technical strategy and tradeoffs clearly to non-technical executives, and building trust quickly with cross-functional peers
• Deep curiosity about the systems and processes that produce our data, with enough understanding of the source to help your team strengthen and troubleshoot pipelines rather than treating data as a black box
• Track record of leading engineering teams in an agile environment, coaching both engineers and managers, and giving teams enough context to operate independently
• Deep hands-on experience building large-scale Spark applications for batch and streaming workloads
• Experience with modern lakehouse platforms (Databricks or similar) in addition to traditional Spark-based pipelines
• Expertise with the Spark RDD and DataFrame/Dataset APIs, with emphasis on DataFrames, for querying and data manipulation
• Experience with Spark Structured Streaming and SparkSQL, including broadcast joins
• Strong programming background in Python and/or Scala, with SQL fluency across large-scale datasets
• Hands-on experience with AWS data services (Kinesis, S3, Lambda, DynamoDB)
• Experience with ANSI SQL relational databases (Oracle, SQL Server, Postgres, MySQL)
• Strong grounding in distributed systems and distributed data processing frameworks

Compensation:

This range reflects total cash compensation, which may include base salary only or base salary plus target bonus, depending on the role. Where eligible, equity may also be offered separately and not included below. Actual compensation varies based on location, experience, and qualifications.

• Total Cash Compensation Range: $190,000 - $240,000 per year

Additionally, the following benefits are provided by Red Ventures, subject to eligibility requirements.

• Health Insurance Coverage (medical, dental, and vision)
• Life Insurance
• Short and Long-Term Disability Insurance
• Flexible Spending Accounts
• Holiday Pay
• 401(k) with match
• Employee Assistance Program
• Paid Parental Bonding Benefit Program
• Flexible Paid Time Off (PTO): We believe time to rest and recharge is essential.  That’s why we offer a generous and flexible PTO policy.  Full-time employees accrue 20 days of PTO for a full calendar year annually, with an increase to 25 days after five years of service.

Who We Are:

Red Ventures is a global portfolio of high-growth companies — spanning several U.S. businesses, a joint venture in the health services industry, and strategic investments in Europe. Their businesses include The Points Guy, Lonely Planet, Bankrate, the Allconnect Platform, RV Home Client Growth, RV Growth & Transformation, Sage Home Loans Corporation, and more. Across the portfolio, Red Ventures businesses deliver seamless digital experiences for consumers, help Fortune 100 clients solve large-scale digital growth challenges, and create world-class experiences and opportunities for employees. Learn more at redventures.com and follow @RedVentures on LinkedIn and Instagram.

At Red Ventures, we believe diverse, inclusive teams are better. To help you better understand our core values and beliefs, we encourage you to watch this brief YouTube video: Our Belief Statements. This will give you insight into the principles that guide our work and our commitment to fostering an inclusive environment.

Red Ventures is an equal opportunity employer that does not discriminate against any employee or applicant because of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or any other basis protected by law. Employment at Red Ventures is based solely on a person's merit and qualifications. 

We are committed to providing equal employment opportunities to qualified individuals with disabilities. This includes providing reasonable accommodation where appropriate. Should you require a reasonable accommodation to apply or participate in the job application or interview process, please contact accommodation@redventures.com. 

If you are based in California, we encourage you to read this important information for California residents linked here.

#LI-LR1

At Red Ventures, we believe in real human connection. That’s why we do not hire someone through text, social media, or email only. As part of the hiring process, you should expect live conversations with RV teammates before any offer is made. Also, keep an eye on the sender: we only use official @redventures.com email addresses at the portfolio level or business specific email addresses (e.g., @thepointsguy.com), not ones like “redventurescareer.com.” We will never ask candidates to send money, buy equipment, or share financial account info during your journey with us. You can always find our open roles on redventures.com— if you receive a message that seems suspicious, please use redventures.com to verify the opportunity.

For more, the U.S. Federal Trade Commission has published helpful articles to help individuals learn more about protecting themselves from recruiter scams. If you think you’ve been targeted, feel free to report it to your local authorities. Stay safe out there!