Senior Data Pipeline Engineer Global Team (India)
Offer summary
Qualifications:
Bachelor's or Master's degree in Computer Science, STEM, or related field., 6+ years of experience as a Data Engineer or similar role., Strong understanding of Spark, SQL, and data pipeline development., Experience working with large-scale datasets using PySpark, Delta, and Databricks..Key responsibilities:
- Build and maintain end-to-end data pipelines.
- Collaborate with stakeholders to incorporate business logic into data pipelines.
- Develop documentation, architecture diagrams, and training materials.
- Solve complex data pipeline issues using PySpark and SQL.
Job description
About YipitData:
YipitData is the leading market research and analytics firm for the disruptive economy and recently raised up to $475M from The Carlyle Group at a valuation over $1B.
We analyze billions of alternative data points every day to provide accurate, detailed insights on ridesharing, ecommerce marketplaces, payments, and more. Our ondemand insights team uses proprietary technology to identify, license, clean, and analyze the data many of the world’s largest investment funds and corporations depend on.
For three years and counting, we have been recognized as one of Inc’s Best Workplaces. We are a fastgrowing technology company backed by The Carlyle Group and Norwest Venture Partners. Our offices are located in NYC, Austin, Miami, Denver, Mountain View, Seattle, Hong Kong, Shanghai, Beijing, Guangzhou, and Singapore. We cultivate a peoplecentric culture focused on mastery, ownership, and transparency.
- You’ll be working with many strategic engineering leaders within the company.
- You’ll report directly to the Director of Data Engineering.
- You will help build out our Data Engineering team presence in India.
- You will work with a Global team.
- You’ll be challenged with a lot of big data problems.
-
- Report directly to the Senior Manager of Data Engineering, who will provide significant, handson training on cuttingedge data tools and techniques.
- Build and maintain endtoend data pipelines.
- Help with setting best practices for our data modeling and pipeline builds.
- Create documentation, architecture diagrams, and other training materials.
- Become an expert at solving complex data pipeline issues using PySpark and SQL.
- Collaborate with stakeholders to incorporate business logic into our central pipelines.
- Deeply learn Databricks, Spark, and other ETL toolings developed internally.
-
- You hold a Bachelor’s or Master’s degree in Computer Science, STEM, or a related technical discipline.
- You have 6+ years of experience as a Data Engineer or in other technical functions.
- You are excited about solving data challenges and learning new skills.
- You have a great understanding of working with data or building data pipelines.
- You are comfortable working with largescale datasets using PySpark, Delta, and Databricks.
- You understand business needs and the rationale behind data transformations to ensure alignment with organizational goals and data strategy.
- You are eager to constantly learn new technologies.
- You are a selfstarter who enjoys working collaboratively with stakeholders.
- You have exceptional verbal and written communication skills.
- Nice to have: Experience with Airflow, dbt, Snowflake, or equivalent.
You Are Likely To Succeed If:
About The Role:
We are seeking a highly skilled Senior Data Engineer to join our dynamic Data Engineering team. The ideal candidate possesses 68 years of data engineering experience. An excellent candidate should have a solid understanding of Spark and SQL, and have data pipeline experience. Hired individuals will play a crucial role in helping to build out our data engineering team to support our strategic pipelines and optimize for reliability, efficiency, and performance.
Additionally, Data Engineering serves as the gold standard for all other YipitData analyst teams, building and maintaining the core pipelines and tooling that power our products. This highimpact, highvisibility team is instrumental to the success of our rapidly growing business. This is a unique opportunity to be the first hire in this team, with the potential to build and lead the team as their responsibilities expand.
This is a hybrid opportunity based in India.
During training and onboarding, we will expect several hours of overlap with US working hours.Afterward, standard IST working hours are permitted with the exception of 12 days per week, when you will join meetings with the US team.
As Our Senior Data Engineer You Will:
Required profile
Experience
Other Skills
- Collaboration
- Communication
- Problem Solving
Data Engineer Related jobs
Mindera
- From: California (USA) (Full Remote)
- Full time
ChowNow
- From: United States (Full Remote)
- Full time
Capgemini
- From: United States (Full Remote)
- Full time
Darwoft
- From: Latin America (Full Remote)
- Full time
Capgemini
- From: United States (Full Remote)
- Full time