Logo for Overture Rede

Big Data

Roles & Responsibilities

  • Ability to handle issue resolution and provide direction to teams both technically and functionally
  • Ability to articulate and convert requirements into solutions
  • Experience with development frameworks and data/integration technologies such as Informatica, Python, Scala
  • Expert knowledge of Agile approaches to software development and able to put key Agile principles into practice to deliver solutions incrementally

Requirements:

  • Design and develop ELT-based transformations to modernize ingestion pipelines and build data transformations at scale
  • Build and maintain a data environment for speed, accuracy, consistency, and uptime
  • Provide technical expertise in the design and implementation of ratings data ingestion pipelines using AWS cloud and technologies such as S3, Hive, Databricks, Scala, Python, and Spark
  • Ensure data governance, data quality checks, and data lineage implemented in each hop of the data

Job description

This is a remote position.

Design & Develop “Transformations” aspects using the ELT framework to modernize the Ingestion pipelines and build data transformations at scale
● Work closely with other data teams & Data Science teams and participate in the development of Ingestion pipelines
● Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark
● Build and maintain a data environment for speed, accuracy, consistency, and ‘up’ time
● Work closely with other data teams & Data Science teams and participate in the development of Ingestion pipelines
● Ensure data governance principles are adopted, data quality checks and data lineage implemented in each hop of the data
● Be in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologies
● Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards

What you'll bring:
● Should be in a position to handle issue resolution and provide direction to teams both technically and functionally
● Should be able to articulate and convert requirements into solutions.
● Experience With Machine Learning Libraries and Frameworks (TensorFlow, MLlib) is an added advantage
● Experience with development frameworks as well as data and integration technologies such as Informatica, Python, Scala
● Expert knowledge of Agile approaches to software development and able to put key Agile principles into practice to deliver solutions incrementally.
● Monitors industry trends and directions; develops and presents substantive technical recommendations to senior management
● Excellent analytical thinking, interpersonal, oral, and written communication skills with a strong ability to influence both IT and business partners
● Ability to prioritize and manage work to critical project timelines in


Salary: 2500000

Related jobs

Other jobs at Overture Rede

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.