Role overview

Qualifications

Python/PySpark and Java or Scala programming
SQL and NoSQL database expertise
AWS cloud platform experience (GCP knowledge a plus)
Databricks, Spark, Kafka, Hive; dbt knowledge a plus

Responsibilities

Build and maintain end-to-end data pipelines and ETL processes using Python/PySpark (and Java/Scala) with Databricks, Spark, Kafka and Hive
Design and optimize data models and data warehouse solutions; work with Parquet, Delta Lake formats
Implement CI/CD for data pipelines and orchestrate workflows with Airflow; use GitHub for version control
Collaborate with infrastructure teams to manage Terraform-based IaC on AWS (GCP) environments; ensure data quality and governance

Key facts

Remote from: India, Anywhere
Full time
Data Engineer
English

About the company

PradeepIT Consulting Services Pvt Ltd

IT Services & IT Consulting

Join PradeepIT: Innovating Information Technology and Solutions We pride ourselves on delivering exceptional results in the digital era of Information and Technology. With a track record of successful projects across offshore, nearshore, and onshore locations, we've built a clientele spanning 3 continents and 100+ companies. Our 380+ successful projects reflect our commitment to excellence. At PradeepIT, we prioritize the satisfaction of our resources, followed closely by meeting the needs of our clients and partner companies. Our service offerings include Outsourcing, Managed Services, Recruitment Process Outsourcing, Customer Relationship Management, Web Designing & Development, Content Development, and E-commerce Management. We specialize in SAP S/4 HANA, SAP Customer Data Cloud (Gigya), SAP CPQ (Calliduscloud), SAP Customer Experience, Mobility, Android, iOS & Hybrid development for native application developments. Our core value of "Join As Employee With Us And Grow Up As Entrepreneur" drives our mission. We proudly introduce our venture companies: 1. HG Infotech Pvt Ltd 2. Beli Brother Consulting Pvt Ltd 3. Involvemind 4. Stackglobe 5. Prastuti Consulting 6. Khahara Consulting 7. Thinkhigh And many more to come in the near future. We invite you to be part of our clients' success stories by adopting the latest technology and continually improving processes. If you'd like to learn more about us or have specific questions, visit www.pradeepit.com, call us at 08047363377, or email info@in.pradeepit.com. Let's work together on your next project!

Company details

IndustryIT Services & IT Consulting

Company size51 - 200

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

6+ Years
7+ Years
8+ Years

Job Description:

Programming languages -Python/PySpark + Java or Scala.
Database expertise -SQL, NoSQL.
Cloud data platforms - AWS (GCP good to have)
Big data frameworks -Databricks, Spark, Kafka, Hive (dbt good to have)
Workflow orchestration (Airflow, ETL, Data Pipelines).
Infrastructure management skills (Terraform).
Datawarehouse Exposure
Fundamental understanding of Parquet, Delta Lake and other OTFs file formats
Strong experience on building CI/CD processes, experience with GitHub

BGV is going be very strong so kindly share clean profile with Actual experience and all proofs of docs

On Site: (3 Days / week or 12 Days / Month Work from Office)

Locations: Gurgaon, Pune, Bangalore, Chennai, Hyderabad, Bhopal, Jaipur