Senior Data Pipeline Engineer

About YipitData:

YipitData is the leading market research and analytics firm for the disruptive economy and recently raised up to $475M from The Carlyle Group at a valuation over $1B.

We analyze billions of alternative data points every day to provide accurate, detailed insights on ridesharing, e-commerce marketplaces, payments, and more. Our teams use state-of-the-art technologies to identify, license, clean, and analyze data that many of the world’s largest investment funds and corporations depend on. 

For three years and counting, we have been recognized as one of Inc’s Best Workplaces. We are a fast-growing technology company backed by The Carlyle Group and Norwest Venture Partners. Our offices are located in NYC, Austin, Miami, Denver, Mountain View, Seattle, Hong Kong, Shanghai, Beijing, Guangzhou, and Singapore. We cultivate a people-centric culture focused on mastery, ownership, and transparency.

Why You Should Apply NOW:

• As a Senior Data Platform Engineer, you will join at a pivotal time at the company to deploy mission-critical data pipelines and internal data tools that power our fastest-growing products.
• You are excited to augment the pipelines you develop by building interactive tools that analyze data outputs and provide step-level improvements to data refinement and accuracy
• You will scale data operations using a cutting-edge stack that leverages Gen AI, Spark, Databricks, and other leading Data technologies
• You are eager to optimize and automate the maintenance of our sophisticated data platform and provide technical guidance to platform users across the company

About The Role:

We are hiring a Senior Data Pipeline Engineer (Internal, Official Title: Senior Data Platform Engineer) to report to the Chief Architect at YipitData. This newly established function is responsible for enabling data analysts and data entry teams to leverage innovative datasets and applications that power our fastest-growing analytical products. This is a unique, hybrid role that combines data engineering with some full-stack development, encompassing data modeling, ETL, and application development using lightweight Python frameworks such as Plotly Dash. As the pipelines and tools you will oversee are mission-critical, ongoing support, uptime maintenance, and onboarding new data team members are essential to making a strong impact in this role.

You will work with sophisticated data pipelines and modern web applications that harness our petabyte-scale data lake. In addition, you will play a key role in our newest product, Signals, which delivers insights on software companies. Signals is growing rapidly, and this high-visibility position will contribute meaningfully by enabling the data operations behind the product.

You will also be a core member of the Platform Engineering team, responsible for administering our Data & ML platform, supporting global teams during business hours, and researching and implementing process improvements and automation to reduce the team's support burden by leveraging the latest in data and GenAI technologies.

As Our Senior Data Platform Engineer, You Will:

• Own and maintain core data pipelines that power strategic internal and external analytics products.
• Build lightweight data applications and tools on top of these pipelines using Python to streamline data refinement, transformation, and processing workflows.
• Drive reliability, efficiency, and performance improvements across the data platform.
• Diagnose and resolve technical issues in data applications and platform services, including web application performance, optimizing SQL, Pandas, and PySpark queries, and interacting with REST APIs.
• Partner with analysts, product teams, and engineering stakeholders to understand data requirements and translate them into scalable solutions.
• Identify and implement process improvements to streamline support workflows, reduce repetitive tasks, and improve application and data platform efficiency.
• Work with a modern tech stack that includes: Python, Databricks (Spark), Pandas, Plotly Dash, AWS, Github, and Docker. 

This is a fully-remote opportunity based in India. During onboarding, we expect working hours to be 2pm -11pm IST to allow for overlap with other teammates. Afterwards, standard work hours are from 11am to 8pm IST.

You Are Likely To Succeed If:

• Have 5+ years of proven experience in data engineering, particularly in systems with high uptime requirements. 
• Thrive in a fast-paced, evolving environment and can efficiently navigate multiple technologies and production services to troubleshoot and resolve issues.
• Eager to learn basic application development using Python frameworks and Databricks to automate analytical and data entry workflows
• Possess strong communication skills, responsiveness, attention to detail, a team-oriented mindset, and the ability to collaborate effectively with both technical and non-technical stakeholders.
• Show a track record of excellent problem-solving and debugging abilities, maintaining reliable codebases, and architecting efficient data processes.
• Are proficient in Python, Spark, Docker, AWS, and database technologies. (Experience with Pandas, Plotly Dash, Databricks, or REST APIs is a plus but not required.)

What We Offer:

Our compensation package includes comprehensive benefits, perks, and a competitive salary: 

• We care about your personal life and we mean it. We offer vacation time, parental leave, team events, learning reimbursement, and more!
• Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust.

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal-opportunity employer.

Job Applicant Privacy Notice

<img height="1" width="1" style="display:none;" alt="" src="https://px.ads.linkedin.com/collect/?pid=4341228&conversionId=10486642&fmt=gif" />