Match score not available

AWS Data Engineer

Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

8+ years of experience as a Data Engineer, Proficient in Scala and Spark, Experience with AWS Cloud Development and streaming technologies like Kafka, Familiarity with ETL architecture and Python/Pyspark..

Key responsabilities:

  • Designing and maintaining Scala-based data tasks for data transformation
  • Participating in architectural development for the data pipeline
  • Collaborating with cross-functional teams and mentoring team members
  • Documenting development processes and ensuring compliance with specifications.

Arfa Solutions logo
Arfa Solutions Information Technology & Services Startup https://www.arfasolutions.net/
11 - 50 Employees
See all jobs

Job description

United Airlines

Remote

Sr. AWS Cloud Data Engineer/Architect (AWS Scala/Spark Developer)

Visa friendly

1 year ongoing contract

 

MUST HAVE

8+ years experience as a Data Engineer
Experience with Scala, Spark and Apache Flink streaming
AWS Cloud Development
Experience with Kafka and or other AWS streaming technologies (Apache Flink is idea and will be a start)

Python, Pyspark

SCALA IS NEEDED (PROFICIENT)

Requirements

Pluses:

Java experience

IBM MQ

Proficiency with ETL architecture.

Day to day:

Senior Scala and Spark Solutions Developer and Data Engineer capable of building a data standardized solution. Ideal candidate has extensive experience with both Data streaming and batch solutions including event-driven and microservices architecture. This is a high visibility, fast-paced key initiative that will integrate data across internal and external sources.

Responsibilities

* Designing, creating, and maintaining Scala-based data task to transform raw data into meaningful data models

* Participating in all architectural development tasks related to the data pipeline.

* Writing code in accordance with the data model requirements

* Collaborating with cross-functional teams

* Mentoring team members in Scala development and management

* Document Scala Development processes including Knowledge Documents, build and run books

* Work with business analysts to understand requirements

* Test to ensure designs are in compliance with specifications

* Debug and resolve technical issues

* Make recommendations to existing infrastructure

* Continually engage in professional development

* Develop documentation to track

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Information Technology & Services
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Mentorship
  • Collaboration
  • Problem Solving

Data Engineer Related jobs