Logo for PradeepIT Consulting Services Pvt Ltd

Data Engineer 1 FTE

Roles & Responsibilities

  • Strong SQL and PySpark development skills, including designing and enhancing stored procedures and ETL workflows.
  • Hands-on experience with Azure data services: Azure Data Lake Storage Gen2, Azure Databricks, Azure SQL Database/Managed Instance, Key Vault, and MS SQL Management Studio.
  • Ability to design technical solutions, unit test criteria, perform unit testing, and document results; estimate workload for assigned tasks.
  • Familiarity with DevOps and Agile methodologies and CI/CD pipelines for Spark/Databricks in Azure.

Requirements:

  • Develop and enhance SQL and PySpark-based ETL solutions; design and implement complex data transformations in Azure Databricks.
  • Create and optimize SQL stored procedures; design technical solutions, unit test criteria, perform unit testing, and document results.
  • Provide technical support to functional consultants; develop technical designs and ensure timely, high-quality deliverables per defined processes.
  • Estimate support requirements and contribute to DevOps/Agile practices; participate in CI/CD pipelines for Spark/Databricks in Azure.

Job description

Job Description:

Skill Sets

  • Develop, Enhance SQL, Pyspark
  • Create, Enhance SQL Store Procedures
  • Design and propose technical solution
  • Design criteria and test cases for unit testing;
  • perform unit testing and document results.
  • Provide technical support to functional consultants.
  • Develop technical design, follow defined process for timely completion of high-quality deliverables
  • Understand & support requirements and estimate for assigned work

Knowhow on tools

  • Azure Cloud Azure ADLS MS SQL Server Azure Databricks MS SQL Management studio

Knowhow on methodologies

  • DevOps Agile way of working

Expected deliverables

  • Must be aware of interaction of ETL in Azure and Databricks / Spark
  • Designing and developing complex data transformations using Pyspark
  • Designing and developing moderately complex database entities Demonstrated intermediate level of competency with Azure SQL Database, Azure SQL Managed Instance and SQL scripting.
  • Demonstrated experience with Azure: Data Lake Gen 2, Key Vault and Dev Test Labs
  • Aware of DevOps CICD pipelines for Spark /Databricks

Data Engineer Related jobs

Other jobs at PradeepIT Consulting Services Pvt Ltd

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.