Offer summary

Qualifications:

Bachelor's or master's degree in computer science, engineering, or related field., 7+ years of hands-on experience in data engineering, especially with Databricks and Apache Spark., Expert proficiency in Python, including PySpark, and strong SQL skills., Experience designing and optimizing scalable ELT/ETL pipelines and ensuring data integrity..

Key responsibilities:

Design, implement, and optimize data pipelines using Databricks, Spark, and Python.

Lead and mentor a team of data engineers, providing technical guidance.

Develop testing frameworks and data validation rules to ensure data quality.

Collaborate with cross-functional teams and participate in an Agile development environment.

How can you get the inside view on where brands are spending ad dollars, leverage that powerful data to create a bulletproof sales pitch, and win new accounts? MediaRadar is a SaaS company created to provide real-time advertising insights and give you the tools to outsmart your competition – all while streamlining the sales process. Get a free custom demo: https://mediaradar.com/request-demo Sign up to our blog: https://mediaradar.com/blog-signup Chat with us: https://lc.chat/now/3971471/ MediaRadar offers comprehensive ad analysis for over 3.1 million brands across multiple media platforms including TV, digital, mobile, email, social media, print and more. Over 2,200 clients enjoy unmatched quality and award-winning customer service to help them identify new prospects, create bulletproof pitches, and grow their business. Connect with us on Twitter: @mediaradar

Role: Senior Data Engineer

Location: US Remote

Please note: At this time, we are unable to sponsor employment visas. Only candidates who are legally authorized to work in the United States on a fulltime, longterm basis without current or future visa sponsorship will be considered.

Additionally, we are not considering applicants seeking shortterm, contractbased, or temporary employment arrangements.

About MediaRadar
MediaRadar , now including the data and capabilities of Vivvix, powers the missioncritical marketing and sales decisions that drive competitive advantage. Our competitive advertising intelligence platform enables clients to achieve peak performance with alwayson data and insights that span the media, creative, and business strategies of five million brands across 30+ media channels. By bringing the advertising past, present, and future into focus, our clients rapidly act on the competitive moves and emerging advertising trends impacting their business.

Job Description

We are seeking an experienced Senior Data Engineer to join the team and take ownership of our data infrastructure. With millions of new data points ingested daily, your mission will be to architect, build, and scale robust data pipelines that ensure flawless data quality. Youll work with a passionate team on a modern cloud data stack (Azure, Databricks), solving complex challenges to deliver timely and reliable data that drives our business and delights our customers.

What Youll Do

Architect & Build: Design, implement, and optimize scalable and reliable ELTETL pipelines using Databricks, Spark, Python and Store Procedures. You will model complex data and build solutions for both batch and streaming workloads.

Lead & Mentor: Guide and support a team of data engineers, providing technical direction and resolving challenges. You will elevate the teams skills through mentorship and constructive code reviews to ensure we ship highquality, efficient code.

Ensure Data Integrity: Develop and implement comprehensive testing frameworks, data validation rules, and QA plans to guarantee the accuracy and integrity of our data assets.

Optimize & Troubleshoot: Proactively monitor system performance, tune complex SQL queries, and troubleshoot production issues. You will perform rootcause analysis and implement lasting solutions to improve system health and reliability.

Collaborate & Innovate: Actively participate in an Agile environment (Scrum, sprints, backlog grooming) and collaborate with crossfunctional teams. Youll help evaluate and introduce new technologies and best practices to continuously improve our data platform.

Requirements
What Youll Bring (Qualifications)

A bachelor’s or master’s degree in computer science, Engineering, or a related field (or equivalent practical experience).

7+ years of handson experience in data engineering, with a strong focus on Databricks, Apache Spark and 1 RDBMS solution for processing largescale datasets.

Expertlevel proficiency in Python (including PySpark) and a strong understanding of data structures, algorithms, and OOP principles.

Deep expertise in SQL and Spark SQL, with proven experience writing and optimizing complex analytical queries.

Handson experience with the Databricks ecosystem, including Delta Lake, Unity Catalog, and Data frame APIs.

Bonus Points (Nice to Haves)

Experience building and maintaining CICD pipelines using tools like Azure DevOps.

Previous experience migrating a legacy data system to a modern, unified data platform.

Familiarity with containerization (Docker, Kubernetes).

Experience working in a fastpaced, productdriven environment.

Benefits
Benefits:
In addition to career progression, training and development, and an excellent worklife balance, future Radarians can expect a great benefits package that includes:

Medical, Dental & Vision Insurance

401k with Company Match

Flexible PTO

Commuter Benefits

Gym Discounts

Summer Fridays

At MediaRadar, we are committed to creating an inclusive and accessible workplace where everyone can thrive. We believe that diversity of backgrounds, perspectives, and experiences makes us stronger and more innovative. We are proud to be an Equal Opportunity Employer and make employment decisions without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, or any other legally protected status.
In accordance with the EEO1 reporting requirements, we collect demographic data as part of our efforts to ensure fair and equitable hiring practices across all levels of our organization. This is a fulltime exempt role with a base salary range of $130,000 $160,000, plus benefits. A final compensation offer will ultimately be based on the candidates location, skill level and experience, and the Companys pay equity. We are also committed to ensuring our recruitment process is accessible to all applicants. If you need a reasonable accommodation during the application or interview process, please contact us at careers@mediaradar.com.
We’re excited to meet people who share our values and want to build the future with us.