Logo for Digi Digital Placement

Data Engineer

Digi Digital Placement

Roles & Responsibilities

  • Bachelor's degree in Computer Science, Data Science, or related field.
  • 5 to 8 years of experience in data engineering roles.
  • Proficiency in Python, Scala, or SQL, with experience in Pyspark.
  • Strong understanding of data pipeline architecture and cloud platforms like AWS and Azure.

Requirements:

  • Design and implement data pipelines using Apache Spark and Airflow.
  • Develop and optimize SQL queries for ETL processes.
  • Manage data storage and processing on cloud platforms such as AWS EMR, Redshift, and Azure Synapse.
  • Collaborate with teams to maintain data integration pipelines and ensure data quality.

Job description

JD:
• Role: Sr Lead Data Engineer
• Experience: 5 to 8 years
• Job Location : Hyderabad, Work from Office
• Mode of employment: Permanent
• Notice period: Immediate to 15 days ONLY.
Skills and Responsibilities.
• Strong programming skills in Python, Scala, or SQL, as well as Pyspark.
• Architect and implement data pipelines using Apache Spark for efficient data processing and transformation.
• Develop and maintain data workflows using Apache Airflow to automate data pipeline orchestration and scheduling.
• Create and optimize SQL queries for data extraction, transformation, and loading (ETL) processes.
• Harness the power of Python for data manipulation, scripting, and automation.
• Manage and optimize data storage and processing on AWS EMR, Redshift, and Azure Synapse.
• Collaborate with teams to design and maintain Azure Data Factory (ADF) pipelines for data integration.
• Leverage DBT for data modelling and version control, ensuring data accuracy and consistency.
• Integrate data from diverse sources using Fivetran, ensuring seamless data ingestion.
• Continuously improve data quality, performance, and reliability across the data ecosystem.
• Monitor and troubleshoot data pipelines, ensuring data availability and integrity.
• Implement data security best practices and ensure compliance with data privacy regulations.
Ready to apply?
APPLY
·

Data Engineer Related jobs

IndiaData Engineer

Other jobs at Digi Digital Placement

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

✨

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.