Key Facts

Remote From:

India

Full time

Senior (5-10 years)

English

Hard Skills

Other Skills

•
Troubleshooting (Problem Solving)
•
Analytical Skills
•
Detail Oriented
•
Mentorship
•
Verbal Communication Skills
•
Problem Solving

Roles & Responsibilities

Bachelor's and/or master's degree in computer science or equivalent experience with 6+ years IT experience and 3+ years in Data warehouse/ETL projects
Deep understanding of Star and Snowflake dimensional modeling and strong data management principles
Hands-on experience with SQL, Python, and Spark (PySpark); practical knowledge of Databricks on AWS/Azure and Delta Lake Architecture
Experience with ETL/ELT development including batch and streaming (e.g., Kinesis); familiarity with Kafka, Hadoop ecosystem, and NoSQL databases

Requirements:

Developing modern Data Warehouse solutions using Databricks and AWS/Azure Stack
Collaborating with DW/BI leads to understand new ETL pipeline development requirements
Triage issues to identify gaps in existing pipelines and implement fixes
Orchestrate data pipelines in the scheduler using Airflow

PradeepIT Consulting Services Pvt Ltd

About PradeepIT Consulting Services Pvt Ltd

Join PradeepIT: Innovating Information Technology and Solutions We pride ourselves on delivering exceptional results in the digital era of Information and Technology. With a track record of successful projects across offshore, nearshore, and onshore locations, we've built a clientele spanning 3 continents and 100+ companies. Our 380+ successful projects reflect our commitment to excellence. At PradeepIT, we prioritize the satisfaction of our resources, followed closely by meeting the needs of our clients and partner companies. Our service offerings include Outsourcing, Managed Services, Recruitment Process Outsourcing, Customer Relationship Management, Web Designing & Development, Content Development, and E-commerce Management. We specialize in SAP S/4 HANA, SAP Customer Data Cloud (Gigya), SAP CPQ (Calliduscloud), SAP Customer Experience, Mobility, Android, iOS & Hybrid development for native application developments. Our core value of "Join As Employee With Us And Grow Up As Entrepreneur" drives our mission. We proudly introduce our venture companies: 1. HG Infotech Pvt Ltd 2. Beli Brother Consulting Pvt Ltd 3. Involvemind 4. Stackglobe 5. Prastuti Consulting 6. Khahara Consulting 7. Thinkhigh And many more to come in the near future. We invite you to be part of our clients' success stories by adopting the latest technology and continually improving processes. If you'd like to learn more about us or have specific questions, visit www.pradeepit.com, call us at 08047363377, or email info@in.pradeepit.com. Let's work together on your next project!

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

Roles & responsibilities

Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
Ability to provide solutions that are forward-thinking in data engineering and analytics space
Collaborating with DW/BI leads to understanding new ETL pipeline development requirements.
Triage issues to find gaps in existing pipelines and fix the issues
Work with businesses to understand the need in the reporting layer and develop a data model to fulfill
reporting needs
Help joiner team members to resolve issues and technical challenges.
Drive technical discussion with client architects and team members
Orchestrate the data pipelines in the scheduler via Airflow
Qualification & experience
Bachelor's and/or master's degree in computer science or equivalent experience.
Must have a total of 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
Deep understanding of Star and Snowflake dimensional modeling.
Strong knowledge of Data Management principles
Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
Should have hands-on experience in SQL, Python, and Spark (PySpark)
Candidate must have experience in AWS/ Azure stack
Desirable to have ETL with batch and streaming (Kinesis).
Experience in building ETL / data warehouse transformation processes
Experience with Apache Kafka for use with streaming data / event-based data
Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,
Cassandra, Neo4J)
Experience working with structured and unstructured data including imaging & geospatial data.
Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, and GIT.
Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, an troubleshooting.
Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing
concurrent projects
Should have experience working in Agile methodology.
Strong verbal and written communication skills.
Strong analytical and problem-solving skills with a high attention to detail. Mandatory Skills:
Python/ PySpark / Spark with Azure/ AWS Databricks