Principal Data Engineer

Title: Principal Data Engineer

Location: Remote - United States Only

About InMarket

Since 2010, InMarket has been the leader in 360-degree consumer intelligence and real-time activation for thousands of today’s top brands. Through InMarket's data-driven marketing platform, brands can build targeted audiences, activate media in real time, and measure success in driving return on ad spend. InMarket's proprietary Moments offering outperforms traditional mobile advertising by 6x.* Our LCI attribution platform, which won the MarTech Breakthrough Award for Best Advertising Measurement Platform, was validated by Forrester to drive an average of $40 ROAS for our clients. 

*Source: Wordstream US Google Display Benchmarks for Mobile Media

About the role

We are looking for a talented Principal Data Engineer to join the team that builds the essential data infrastructure at the heart of InMarket’s product suite. You should be a quick learner who is enthusiastic about learning new technologies. You should be a natural leader who will empower fellow engineers to write clean and efficient data pipelines. You will implement technical solutions to empower internal/external customers and scale the existing data platform. You will work closely with end users to develop and define key business questions, lead fellow engineers to define technical solutions, then work with Product Managers to build the data sets that answer those questions. You will work with huge datasets and build ETL’s that bring data together to answer business questions, conduct reporting, and drive growth.

Your daily impact as a Principal Data Engineer:

• Design and implement ETL pipelines in Apache Airflow, Big Query, Python, and Spark to transform various upstream sources data into curated data assets for use across InMarket’s vast array of data driven products
• Stay up to date with and advocate internally for Data Engineering best practices, technologies, and testing frameworks that will help shape InMarket’s technical future 
• Architect and plan complex cross team projects involving highly distributed and high performance data platform systems
• Provide technical guidance to other engineers in order to help promote the growth of their knowledge and technical capabilities
• Communicate complex concepts and the results of the analyses in a clear and effective manner to Product and Engineering Managers 
• Identify areas for improvement in existing pipelines and processes
• Understand business requirements and convert them to technical solutions

Qualifications Required:

• Strong SQL experience
• Expert in at least one data pipelining orchestration framework (Airflow, Luigi, etc.)
• Experience building ETL pipelines with Python, SQL, and Spark 
• Strong software engineering skills in an Object Oriented language such as Java or Python
• Experience building and optimizing a data warehouse on a major cloud platform (Big Query preferred but not required)
• Experience and deep understanding of Big Data Technologies such as Hadoop and Spark
• Experience with building and optimizing large scale and high-performance systems
• Extensive knowledge of data related tools and architecture concepts in a major cloud platform (ideally GCP)
• Knowledge of Kubernetes, Docker, Airflow, Git, and CD/CI best practices
• Strong collaboration and communication skills within and across teams
• B.S. or M.S. in Computer Science or a related technical field
• At least 5 years of data engineering experience

Qualifications Preferred:

• Experience in Scala
• Experience in Apache Airflow
• Experience in optimizing Big Query performance  
• Experience building a data governance platform in a regulated environment
• Experience with various data testing frameworks and technologies
• Familiarity with the digital media / advertising industry

Benefits Summary

• Competitive salary, stock options, flexible vacation
• Medical, dental and Flexible Spending Account (FSA)
• Company Matched 401(k)
• Unlimited PTO (within reason)
• Talented co-workers and management
• Agile Development Program (For continued learning/professional development)
• Paid Paternity & Maternity Leave

For candidates in California, Colorado, and New York City, Illinois, Minnesota, New Jersey, Vermont and Massachusetts the Targeted Base Salary Range for this role is $180,000 to $200,000. 

Actual salaries will vary depending on factors including but not limited to work experience, specialized skills and training, performance in role, business needs, and job requirements. Base salary is subject to change and may be modified in the future. Base salary is just one component of InMarket’s total rewards package that also may include bonus, equity, and benefits.  Ask your recruiter for more information! 

At InMarket we are committed to a culture that supports diversity, inclusion, belonging and equal opportunity. We celebrate all people and believe everyone deserves respect regardless of race, gender, sexual orientation, backgrounds, experiences, abilities or beliefs.

InMarket is an Equal Opportunity Employer (EOE). Qualified applicants are considered for employment without regard to age, race, color, religion, sex, national origin, sexual orientation, disability, or veteran status.