Key Facts

Remote From:

Anywhere

Category: Data Engineer

Full time

Senior (5-10 years)

English

Hard Skills

AWS Glue Infrastructure as Code (IaC) Python (Programming Language) Data Architecture Data Masking Virtual Private Networks (VPN) Mathematical Optimization AWS Identity And Access Management (IAM) Billing Log Monitoring +18 more

Roles & Responsibilities

5+ years of experience in data engineering roles.
Strong expertise in AWS services including AWS Glue, DMS, EC2, VPC, IAM, S3, CloudWatch, and KMS.
Solid understanding of networking and security in AWS, including NACLs, security groups, and VPNs.
Hands-on experience with Python for scripting and data processing.

Requirements:

Design and implement data pipelines and ETL workflows using AWS Glue, migrating from legacy Python scripts on EC2.
Migrate and integrate data using AWS DMS (Database Migration Service).
Design, monitor, and maintain long-running ETL processes (16+ hours), ensuring fault tolerance and recovery.
Collaborate with security teams to enhance data security and governance frameworks, implement data masking and encryption, and integrate with Coalesce for data modeling/transformation workflows.

PradeepIT Consulting Services Pvt Ltd

About PradeepIT Consulting Services Pvt Ltd

Join PradeepIT: Innovating Information Technology and Solutions We pride ourselves on delivering exceptional results in the digital era of Information and Technology. With a track record of successful projects across offshore, nearshore, and onshore locations, we've built a clientele spanning 3 continents and 100+ companies. Our 380+ successful projects reflect our commitment to excellence. At PradeepIT, we prioritize the satisfaction of our resources, followed closely by meeting the needs of our clients and partner companies. Our service offerings include Outsourcing, Managed Services, Recruitment Process Outsourcing, Customer Relationship Management, Web Designing & Development, Content Development, and E-commerce Management. We specialize in SAP S/4 HANA, SAP Customer Data Cloud (Gigya), SAP CPQ (Calliduscloud), SAP Customer Experience, Mobility, Android, iOS & Hybrid development for native application developments. Our core value of "Join As Employee With Us And Grow Up As Entrepreneur" drives our mission. We proudly introduce our venture companies: 1. HG Infotech Pvt Ltd 2. Beli Brother Consulting Pvt Ltd 3. Involvemind 4. Stackglobe 5. Prastuti Consulting 6. Khahara Consulting 7. Thinkhigh And many more to come in the near future. We invite you to be part of our clients' success stories by adopting the latest technology and continually improving processes. If you'd like to learn more about us or have specific questions, visit www.pradeepit.com, call us at 08047363377, or email info@in.pradeepit.com. Let's work together on your next project!

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

Data Engineer

YoE: 3-4 Years

Key Responsibilities:

Design and implement data pipelines and ETL workflows using AWS Glue, migrating from legacy Python scripts on EC2.
Work with AWS Organizations to manage and optimize a multi-account strategy with centralized governance and billing.
Develop and enforce network and security policies including NACLs, VPCs, and VPN configurations.
Implement and manage Infrastructure as Code (IaC) using tools like Terraform or AWS CloudFormation.
Design, monitor, and maintain long-running ETL processes (16+ hours), ensuring fault tolerance and recovery.
Migrate and integrate data using AWS DMS (Database Migration Service).
Ensure proper data encryption and masking of sensitive data, including PII and PCI data, following best practices and compliance standards.
Collaborate with security teams to enhance data security and governance frameworks.
Integrate with tools like Coalesce for data modeling and transformation workflows.
Optimize data storage and retrieval processes for scalability and performance.

Required Skills & Experience:

5+ years of experience in data engineering roles.
Strong expertise in AWS services including Glue, DMS, EC2, VPC, IAM, S3, CloudWatch, and KMS.
Solid understanding of networking and security in AWS, including NACLs, security groups, and VPNs.
Hands-on experience with Python for scripting and data processing.
Proven track record of migrating ETL workflows to serverless architectures.
Experience with data masking, encryption, and compliance frameworks (e.g., GDPR, PCI-DSS).
Familiarity with IaC tools like Terraform or AWS CloudFormation.
Working knowledge of Coalesce or similar data orchestration platforms is a plus.
Experience managing long-running data jobs and optimizing for cost and performance.