Offer summary

Qualifications:

4+ years of experience with PySpark and SQL for building scalable ETL pipelines., Strong proficiency in Python programming., Knowledge of GCP Data Analytics ecosystem including BigQuery and Cloud Functions., Experience with workflow orchestration tools like Airflow/Composer..

Key responsabilities:

Design, build, and maintain scalable ETL/ELT pipelines using PySpark and SQL.

Work on data extraction, transformation, and loading processes into data warehouses like BigQuery.

Collaborate with engineering and analytics teams to develop data integration solutions.

Implement monitoring and alerting for pipelines to ensure data consistency and issue resolution.

Job description

Come Join Us

Experience.com - We make every experience matter more

Position: Data Engineer

Experience: 4+ Years

Job Location: Remote

Employment Type: Full Time

Responsibilities

Design, build, and maintain scalable and robust ETL/ELT pipelines using PySpark and SQL.
Work on data extraction, transformation, and loading processes from multiple sources into data warehouses such as BigQuery.
Leverage GCP data analytics tools (BigQuery, DataProc, Cloud Functions, etc.) to process and analyze data.
Optimize data workflows for benchmarking, performance, and tuning to ensure efficiency and reliability.
Collaborate with engineering and analytics teams to develop data integration solutions that meet business needs.
Ensure the accuracy and quality of data by implementing strong in-memory applications and database designs.
Implement monitoring and alerting for pipelines and workflows to ensure data consistency and issue resolution.

Skills and Qualifications

Must-Have:

4+ years of experience with PySpark and SQL for building scalable ETL pipelines.
Strong proficiency in Python programming.
Knowledge of GCP Data Analytics ecosystem (BigQuery, PySpark, SQL, etc.).
Experience with Airflow/Composer for workflow orchestration.
Experience with in-memory applications, database design, and data integration.
Strong analytical thinking and problem-solving abilities.

Preferred:

Familiarity with data pipeline mechanisms such as Kafka or Pub/Sub, Cloud Functions
Hands-on experience with Elasticsearch, and MongoDB.

About Us

We believe that experience is everything. Experience.com has built the most impactful Experience Management Platform (XMP) available anywhere, with features to drive operational and behavioral change, in real-time, during the moments that matter. XMP delivers impactful business outcomes including increased customer satisfaction, brand loyalty, online reputation and visibility, as well as improved employee engagement, and compliance - making every experience matter more.

Founded in 2015 and originally founded as SocialSurvey, Experience.com is headquartered in San Ramon, Calif. and backed by SavantGrowth (fka Kennet Partners), Silicon Valley Data Capital, Tri-Valley Ventures, and Wilson Sonsini Goodrich & Rosati.

Indian Registered name: Buyers Road India Private Limited

URL: www.experience.com

Required profile