Key Facts

Remote From:

Anywhere

Full time

Senior (5-10 years)

English

Hard Skills

Roles & Responsibilities

6-9 years of experience in data engineering
Experience creating and maintaining data pipeline architectures for ingestion and processing
Hands-on experience building ETL infrastructure using AWS data services (S3, Snowflake, Glue, Lambda) and writing complex SQL
Proficiency with data storage technologies (Amazon S3, SQL, NoSQL), data modeling, and PySpark; ability to optimize AWS services for cost and performance

Requirements:

Design, develop, and maintain scalable data pipelines using AWS Glue and PySpark
Create and manage ETL workflows leveraging S3, Snowflake, and other AWS data services, ensuring data quality and performance
Collaborate with stakeholders across multiple time zones to gather requirements and deliver data solutions
Monitor, optimize, and troubleshoot data pipelines and AWS resources for cost-effectiveness and reliability

PradeepIT Consulting Services Pvt Ltd

About PradeepIT Consulting Services Pvt Ltd

Join PradeepIT: Innovating Information Technology and Solutions We pride ourselves on delivering exceptional results in the digital era of Information and Technology. With a track record of successful projects across offshore, nearshore, and onshore locations, we've built a clientele spanning 3 continents and 100+ companies. Our 380+ successful projects reflect our commitment to excellence. At PradeepIT, we prioritize the satisfaction of our resources, followed closely by meeting the needs of our clients and partner companies. Our service offerings include Outsourcing, Managed Services, Recruitment Process Outsourcing, Customer Relationship Management, Web Designing & Development, Content Development, and E-commerce Management. We specialize in SAP S/4 HANA, SAP Customer Data Cloud (Gigya), SAP CPQ (Calliduscloud), SAP Customer Experience, Mobility, Android, iOS & Hybrid development for native application developments. Our core value of "Join As Employee With Us And Grow Up As Entrepreneur" drives our mission. We proudly introduce our venture companies: 1. HG Infotech Pvt Ltd 2. Beli Brother Consulting Pvt Ltd 3. Involvemind 4. Stackglobe 5. Prastuti Consulting 6. Khahara Consulting 7. Thinkhigh And many more to come in the near future. We invite you to be part of our clients' success stories by adopting the latest technology and continually improving processes. If you'd like to learn more about us or have specific questions, visit www.pradeepit.com, call us at 08047363377, or email info@in.pradeepit.com. Let's work together on your next project!

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

Required Skills: ·
6-9 years of experience in Data Engineering ·
Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data
· Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services
· Experience in Data storage technologies like Amazon S3, SQL, NoSQL
· Hands on experience in writing complex SQL.
· Hands on experience in developing pipelines using AWS data services like Glue, Lambda · Develop, manage, and optimize data pipelines using AWS Glue and PySpark.
· Hands on experience in Optimizing AWS services for cost-effectiveness and performance.
· Data modeling technical awareness · Experience in working with stakeholders working in different time zones Good to have:
· Working knowledge on using Bigdata technologies.
· Experience in collaborating data quality and data governance team.
· Payments domain knowledge· CRM, Accounting, etc. in depth understanding
· Regulatory reporting exposure