Key Facts

Remote From:

Full time

Senior (5-10 years)

English

Hard Skills

Apache Spark Apache Spark SQL (Programming Language) Python (Programming Language) Medflow EMR Apache Airflow Azure Synapse Analytics Azure Data Factory Amazon Redshift Data Quality Assessment Data Security

Other Skills

•
Troubleshooting (Problem Solving)
•
Collaboration

Digi Digital Placement

About Digi Digital Placement

Welcome to Digital Placement, a leading staffing company dedicated to connecting businesses with top-tier digital talent. With a deep understanding of the ever-evolving digital landscape, we specialize in providing customized staffing solutions to meet your organization's unique needsAt Digital Placement, we recognize that in today's fast-paced and technology-driven world, having the right people with the right skills is crucial for success. Whether you're a small startup, a growing mid-sized company, or a large corporation, our extensive network of highly skilled professionals ensures that we can source the perfect candidates for your digital workforceOur team of experienced recruiters possesses a comprehensive knowledge of the digital industry, enabling us to identify and attract top talent across various disciplines. From digital marketing and advertising to web development, UX/UI design, data analysis, and beyond, we are committed to finding individuals who possess the expertise and experience required to drive your organization forwardWhat sets Digital Placement apart is our dedication to building strong, lasting relationships with both our clients and candidates. We take the time to understand your unique business goals, company culture, and specific requirements to ensure that we deliver candidates who not only possess the necessary technical skills but also align with your organization's values and objectivesFor our candidates, we go above and beyond in understanding their aspirations, career goals, and skill sets to match them with opportunities where they can thrive. We provide personalized guidance and support throughout the job search process, helping them secure positions that offer growth, fulfillment, and a rewarding career pathWith Digital Placement as your trusted staffing partner, you can expect exceptional service, prompt communication, and a commitment to excellence. We are dedicated to exceeding your expectations and are driven by a passion

Company type: Scaleup

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

JD:

• Role: Sr Lead Data Engineer

• Experience: 5 to 8 years

• Job Location : Hyderabad, Work from Office

• Mode of employment: Permanent

• Notice period: Immediate to 15 days ONLY.

Skills and Responsibilities.

• Strong programming skills in Python, Scala, or SQL, as well as Pyspark.

• Architect and implement data pipelines using Apache Spark for efficient data processing and transformation.

• Develop and maintain data workflows using Apache Airflow to automate data pipeline orchestration and scheduling.

• Create and optimize SQL queries for data extraction, transformation, and loading (ETL) processes.

• Harness the power of Python for data manipulation, scripting, and automation.

• Manage and optimize data storage and processing on AWS EMR, Redshift, and Azure Synapse.

• Collaborate with teams to design and maintain Azure Data Factory (ADF) pipelines for data integration.

• Leverage DBT for data modelling and version control, ensuring data accuracy and consistency.

• Integrate data from diverse sources using Fivetran, ensuring seamless data ingestion.

• Continuously improve data quality, performance, and reliability across the data ecosystem.

• Monitor and troubleshoot data pipelines, ensuring data availability and integrity.

• Implement data security best practices and ensure compliance with data privacy regulations.

Ready to apply?

APPLY

Share ·

Data Engineer Related jobs

India Data Engineer

Senior Data Engineer

30+ days ago

Sauce

Full time

Azure DatabricksSQL (Programming Language)Python (Programming Language)Data Quality AssessmentGit (Version Control System)

Senior Data Engineer – Data Group

30+ days ago

Trepp, Inc.

Full time

AWS Cloud ServicesSQL (Programming Language)Python (Programming Language)Data ArchitectureAgile Software Development

BDR – Data Engineering & Analytics | International Market | Remote

30+ days ago

HyrEzy Talent Solutions LLP

Full time

Data EngineeringInside SalesLead GenerationBusiness DevelopmentSales Management

Engenheiro de Dados Sênior (57224)

30+ days ago

EVT

Full time

Azure Synapse AnalyticsPython (Programming Language)ETL (Extract Transform Load)Azure Data LakeData Modeling

Junior Data Engineer

30+ days ago

Idexx

Full time

Object ModelSQL (Programming Language)PHP (Scripting Language)Data ModelingJIRA

Other jobs at Digi Digital Placement

Java Developer

30+ days ago

Digi Digital Placement

Full time
Mid-level (2-5 years)

Java (Programming Language)Java (Programming Language)Spring AOPCI/CDAgile Software Development

HR Recruiter

30+ days ago

Digi Digital Placement

Full time
Mid-level (2-5 years)

Competency AssessmentRecruiting ConceptsApplicant Tracking Systems

MERN Stack Developer

30+ days ago

Digi Digital Placement

Full time
Mid-level (2-5 years)

MERN StackNode.js (Javascript Library)MongoDBJavaScript LibrariesGit (Version Control System)

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

✨

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.

Digi Digital Placement

About Digi Digital Placement

Company type: Scaleup

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →