Match score not available

Cloud Data Engineer

Remote: 
Full Remote
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

3+ years of experience in ETL design and development, Experience with Big Data technologies, AWS services, relational and No-SQL databases.

Key responsabilities:

  • Design, develop and document ETL solutions
  • Manage data administration tasks and ensure data quality throughout ETL process
  • Follow standards and best practices for data engineering
Supersourcing logo
Supersourcing https://supersourcing.com/
201 - 500 Employees
See more Supersourcing offers

Job description

Job Overview

We are on an exciting journey to build and scale our advanced analytics practice. We are looking for a

Cloud Data Engineer. The suitable candidate should have demonstrated experience in designing and

implementing ETL solutions on-premises and cloud platforms to support Enterprise data warehouse,

Data Lake and advanced analytics capabilities. Success in this role comes from marrying a strong data

engineering background with product and business acumen to deliver scalable data pipeline and BI

solutions that can enable data for Self Service and Advanced Analytics at TE in a simple and standard

manner.

Primary Responsibilities:

  • Design and develop ETL solutions using data warehouse design best practices for Next Generation Analytics platform on Big Data.
  • Analyze data requirements, complex source data, data models, and determine the best methods in extracting, transforming, and loading the data into the data staging, warehouse, and other system integration projects.
  • Document all ETL and data warehouse processes and flows.
  • Develop and deploy ETL job workflow with reliable error/exception handling and rollback.
  • Design, Develop, Test, Adapt ETL code & jobs to accommodate changes in source data and newbusiness requirements.
  • Manage foundational data administration tasks such as scheduling jobs, troubleshooting job  errors, identifying issues with job windows, assisting with Database backups and performance tuning.
  • Ensure data quality throughout entire ETL process, including audits and of truth. Create or update technical documentation for transition to support teams.
  • Develop, contribute, and adhere to the development of standards and sound procedural practices.

Competencies & Experience Required/Desired:

  • 3+ years of Data Engineering experience in ETL design, development & optimization using tools like Talend, AWS Glue, etc.
  • 3+ years of experience on Big Data technologies like Hadoop, Spark with Scala or Python for developing flows using Batch, Realtime and Streaming processes3+ years of experience in Relational and No-SQL database design, optimization, and performanc with AWS Redshift, AWS Aurora, Oracle & SAP HANA, BW, etc.
  • 3+ years of PL/SQL, Complex SQL Tuning, Stored Procedures, Data Warehousing best practices experience2+ years of experience with AWS Services like S3, EMR, Athena, Glue, Lambda, Redshift, Aurora, etc.
  • Solid understanding of ETL pipeline and workflow managements tools such as AWS Glue, AWS
  •  Kinesis, AWS App Flow, AWS Step Functions, etc.
  • Proficiency with modern software development methodologies such as Agile, source control CI/CD, project management and issue tracking with JIRA
  • Strong problem-solving capabilities. Results oriented. Relies on fact-based logic for decision making.
  • Ability to work with multiple projects and work streams at one time. Must be able to deliver results based upon project deadlines
  • Willing to flex daily work schedule to allow for time-zone differences for global team communications.
  • Strong interpersonal and communication skills

Education

A masters or bachelors degree in computer science, applied mathematics, software engineering, physics, or related quantitative discipline.

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Problem Solving
  • Social Skills
  • Verbal Communication Skills

Cloud Engineer Related jobs