Key Facts

Remote From:

Full time

English

Hard Skills

SQL (Programming Language) Azure Data Lake Azure Databricks Apache Spark Technical Design Data Transformation SQL Azure Database Design Microsoft SQL Server Data Engine (MSDE) Azure Cloud Services +12 more

Other Skills

•
Time Management
•
Collaborative Communications

Roles & Responsibilities

Strong SQL and PySpark development skills, including designing and enhancing stored procedures and ETL workflows.
Hands-on experience with Azure data services: Azure Data Lake Storage Gen2, Azure Databricks, Azure SQL Database/Managed Instance, Key Vault, and MS SQL Management Studio.
Ability to design technical solutions, unit test criteria, perform unit testing, and document results; estimate workload for assigned tasks.
Familiarity with DevOps and Agile methodologies and CI/CD pipelines for Spark/Databricks in Azure.

Requirements:

Develop and enhance SQL and PySpark-based ETL solutions; design and implement complex data transformations in Azure Databricks.
Create and optimize SQL stored procedures; design technical solutions, unit test criteria, perform unit testing, and document results.
Provide technical support to functional consultants; develop technical designs and ensure timely, high-quality deliverables per defined processes.
Estimate support requirements and contribute to DevOps/Agile practices; participate in CI/CD pipelines for Spark/Databricks in Azure.

PradeepIT Consulting Services Pvt Ltd

About PradeepIT Consulting Services Pvt Ltd

Join PradeepIT: Innovating Information Technology and Solutions We pride ourselves on delivering exceptional results in the digital era of Information and Technology. With a track record of successful projects across offshore, nearshore, and onshore locations, we've built a clientele spanning 3 continents and 100+ companies. Our 380+ successful projects reflect our commitment to excellence. At PradeepIT, we prioritize the satisfaction of our resources, followed closely by meeting the needs of our clients and partner companies. Our service offerings include Outsourcing, Managed Services, Recruitment Process Outsourcing, Customer Relationship Management, Web Designing & Development, Content Development, and E-commerce Management. We specialize in SAP S/4 HANA, SAP Customer Data Cloud (Gigya), SAP CPQ (Calliduscloud), SAP Customer Experience, Mobility, Android, iOS & Hybrid development for native application developments. Our core value of "Join As Employee With Us And Grow Up As Entrepreneur" drives our mission. We proudly introduce our venture companies: 1. HG Infotech Pvt Ltd 2. Beli Brother Consulting Pvt Ltd 3. Involvemind 4. Stackglobe 5. Prastuti Consulting 6. Khahara Consulting 7. Thinkhigh And many more to come in the near future. We invite you to be part of our clients' success stories by adopting the latest technology and continually improving processes. If you'd like to learn more about us or have specific questions, visit www.pradeepit.com, call us at 08047363377, or email info@in.pradeepit.com. Let's work together on your next project!

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

Job Description:

Skill Sets

Develop, Enhance SQL, Pyspark
Create, Enhance SQL Store Procedures
Design and propose technical solution
Design criteria and test cases for unit testing;
perform unit testing and document results.
Provide technical support to functional consultants.
Develop technical design, follow defined process for timely completion of high-quality deliverables
Understand & support requirements and estimate for assigned work

Knowhow on tools

Azure Cloud Azure ADLS MS SQL Server Azure Databricks MS SQL Management studio

Knowhow on methodologies

DevOps Agile way of working

Expected deliverables

Must be aware of interaction of ETL in Azure and Databricks / Spark
Designing and developing complex data transformations using Pyspark
Designing and developing moderately complex database entities Demonstrated intermediate level of competency with Azure SQL Database, Azure SQL Managed Instance and SQL scripting.
Demonstrated experience with Azure: Data Lake Gen 2, Key Vault and Dev Test Labs
Aware of DevOps CICD pipelines for Spark /Databricks