Key Facts

Remote From:

Freelance

Expert & Leadership (>10 years)

English

Hard Skills

Azure Databricks Azure Data Factory Apache Spark Data Architecture Git (Version Control System) Data Transformation Azure Monitor SQL Azure SQL (Programming Language) Azure Blob Storage Log Monitoring Continuous Delivery Trigger Point Application Programming Interface (API) Dataset Data Architecture

Roles & Responsibilities

Expertise in designing and implementing ETL data pipelines using Azure Data Factory, including performance tuning
Proficiency with ADF components: linked services, datasets, pipelines, triggers, and integration runtimes
Hands-on experience with PySpark and Azure Databricks for data transformations; ability to connect ADF with REST APIs for external data sources
Strong SQL skills and familiarity with Blob Storage and Azure SQL Database; experience with Git and CI/CD pipelines for automated deployments

Requirements:

Design, develop, and optimize data pipelines in Azure Data Factory to support ETL/ELT processes
Develop data transformations using PySpark/Azure Databricks and integrate REST APIs and external data sources with ADF
Implement and maintain CI/CD pipelines using Git for automated deployments; monitor pipeline health and troubleshoot using Azure Monitor and Log Analytics
Collaborate with stakeholders to ensure data quality, security, and efficient data access in Blob Storage and Azure SQL Database

PradeepIT Consulting Services Pvt Ltd

About PradeepIT Consulting Services Pvt Ltd

Join PradeepIT: Innovating Information Technology and Solutions We pride ourselves on delivering exceptional results in the digital era of Information and Technology. With a track record of successful projects across offshore, nearshore, and onshore locations, we've built a clientele spanning 3 continents and 100+ companies. Our 380+ successful projects reflect our commitment to excellence. At PradeepIT, we prioritize the satisfaction of our resources, followed closely by meeting the needs of our clients and partner companies. Our service offerings include Outsourcing, Managed Services, Recruitment Process Outsourcing, Customer Relationship Management, Web Designing & Development, Content Development, and E-commerce Management. We specialize in SAP S/4 HANA, SAP Customer Data Cloud (Gigya), SAP CPQ (Calliduscloud), SAP Customer Experience, Mobility, Android, iOS & Hybrid development for native application developments. Our core value of "Join As Employee With Us And Grow Up As Entrepreneur" drives our mission. We proudly introduce our venture companies: 1. HG Infotech Pvt Ltd 2. Beli Brother Consulting Pvt Ltd 3. Involvemind 4. Stackglobe 5. Prastuti Consulting 6. Khahara Consulting 7. Thinkhigh And many more to come in the near future. We invite you to be part of our clients' success stories by adopting the latest technology and continually improving processes. If you'd like to learn more about us or have specific questions, visit www.pradeepit.com, call us at 08047363377, or email info@in.pradeepit.com. Let's work together on your next project!

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →