Senior Data Engineer

Work set-up: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

6+ years of experience in the IT industry with a focus on Data Engineering., Strong expertise in Oracle to PostgreSQL migration and AWS DMS., Proficient in Python and PySpark for data pipeline development., Excellent problem-solving and communication skills..

Key responsibilities:

  • Lead and execute data migration initiatives from Oracle to PostgreSQL.
  • Design and implement AWS DMS solutions for database migration.
  • Collaborate with teams to understand data requirements and ensure smooth migration processes.
  • Develop and optimize data pipelines while ensuring data integrity and quality.

ProArch logo
ProArch SME https://www.proarch.com
201 - 500 Employees
See all jobs

Job description

ProArch is seeking a highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration projects and ensure seamless data transformations.

Key Responsibilities:

    • Lead and execute data migration initiatives, specifically from Oracle to PostgreSQL.
    • Design, develop, and implement AWS DMS solutions to migrate databases.
    • Collaborate with cross-functional teams to understand data requirements and ensure smooth migration processes.
    • Develop and optimize data pipelines using Python and PySpark.
    • Troubleshoot migration issues and implement corrective actions to ensure minimal disruptions during data transfer.
    • Ensure data integrity, accuracy, and quality throughout the migration process.
    • Create and maintain detailed documentation for migration processes, workflows, and data transformations.
    • Stay up to date with the latest technologies, best practices, and tools in data engineering and migration.

Requirements

Requirements

    • 5+ years of experience in the IT Industry, with a focus on Data Engineering.
    • Strong hands-on experience with Oracle to PostgreSQL migrations.
    • Expertise in using AWS DMS (Database Migration Service) for seamless data migration.
    • Proficient in Python and PySpark, with a strong understanding of data engineering concepts and data pipeline development.
    • Solid understanding of database architecture, SQL, and data modeling.
    • Experience in troubleshooting, optimizing, and scaling data migration workflows.
    • Ability to work independently and in a team environment with strong problem-solving skills.
    • Excellent written and verbal communication skills.

Preferred Qualifications:

    • Experience with other AWS services such as AWS LambdaS3, and Redshift is a plus.
    • Familiarity with other database migration tools and technologies.
    • Certifications in AWS or other relevant data engineering domains.

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Teamwork
  • Communication
  • Problem Solving

Data Engineer Related jobs