Offer summary

Qualifications:

Minimum 3 years of experience in Big Data development., Proficient in Java, Python, and/or Scala for data pipeline development., Experience with Big Data technologies such as Spark, Hive, and Kafka., Conversational English and familiarity with cloud technologies (GCP, Azure, or AWS)..

Key responsabilities:

Design, develop, and operate large-scale data systems at petabyte scale.

Focus on real-time data pipelines and streaming analytics.

Collaborate with engineers, product managers, and BI developers to provide scalable solutions.

Support the implementation and operations of data pipelines and analytical solutions.

Job description

JOB DESCRIPTION

Be part of Stefanini!

At Stefanini we are more than 30.000 geniuses, connected from 41 countries, doing what they are passionate about and co-creating a better future.

We are looking for you!

RESPONSIBILITIES AND ASSIGNMENTS

As part of the Data Engineering team, you will be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You will interact with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions.

REQUIREMENTS AND QUALIFICATIONS

Min 3 years of BIG data development experience.
Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development.
Experience in agile models
Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
Experience with Java, Python and/or Scala to write data pipelines and data processing layers
Experience in Airflow & Github.
English conversational
Experience in writing map-reduce jobs.
Demonstrates expertise in writing complex, highly-optimized queries across large data sets in HIVE & Spark.
Proven, working expertise with Big Data Technologies Spark, Hive, Kafka, BigQuery SQL, HBase.
Highly Proficient in SQL.
Experience with Cloud Technologies ( GCP, Azure or AWS)
Experience with relational model, memory data stores desirable ( Oracle, Cassandra, Druid)
Provides and supports the implementation and operations of the data pipelines and analytical solutions
Performance tuning experience of systems working with large data sets
Experience in REST API data service – Data Consumption
Retail experience is a huge plus.

ADDITIONAL INFORMATION

Personal Skills

Self-though person.
Effective Communication.
Experience working under pressure.
Teamwork & collaboration.
Data story telling & data presentation.
Active listening and empathy.
Critical thinking & problem solving.
Complex problem analysis & resolution.
Informed decision-making.
Time management & priorization.
Flexibility & adaptability.
Integrity and honesty.
Data ethics & privacy.

Conoce a Stefanini

Somos una empresa global con 35 años de experiencia en el mercado, ofrecemos una sólida selección de servicios como: automatización, nube, Internet de las cosas (IoT) y experiencia de usuario (UX).

Creemos que la tecnología puede revolucionar una empresa y la innovación es fundamental para fomentar el desarrollo y la competitividad. También valoramos las nuevas ideas y el poder de una mente abierta, por lo que reconocemos que cada talento es esencial para la calidad de nuestros proyectos y especialmente para nuestro progreso.

Mantenemos nuestra excelencia invirtiendo en innovaciones tecnológicas, las mejores alianzas, adquisiciones de empresas en todo el mundo y la contratación de profesionales altamente capacitados.

Required profile