Key Facts

Remote From:

Full time

Senior (5-10 years)

Portuguese

Hard Skills

SQL (Programming Language) Scala (Programming Language) ETL (Extract Transform Load) Python (Programming Language) Data Modeling Data Duplication Management Medflow EMR Data Transformation Parallel Computing Data Integrity AWS Cloud Services Business Rule Management Systems Amazon S3 Apache Iceberg Process Management Data Consistency Data Governance

Roles & Responsibilities

Proficiency in SQL
Understanding of data modeling
Experience with ETL
Experience with AWS cloud (S3 and EMR)

Requirements:

Creation of workflows for orchestration of transformation processes
Implementation of scripts in Python and Scala
Ensuring data consistency and integrity in the Gold layer
Implementation of Iceberg tables for versioning and governance

Compass.uol

About Compass.uol

Compasso UOL is a Brazilian technology company owned by the UOL Group, which offers technology services, and provides state-of-the-art solutions, contributing to the digital transformation of its customers so they can become leaders in its sectors of activity. Compasso UOL is a company that cultivates people's talent and use state-of-the-art technologies such as Agile Development, Multicloud, Data&Analytics, Cyber Security, Artificial Intelligence/Machine Learning, APIs/Microservices, IoT and others, providing technology and knowledge that help customers in building digital solutions that enable the transformation and evolution of their business.

Company type: XLarge

Founded: 2018

Company size: 5001 - 10000

LinkedIn See all jobs →

Job description

JOB DESCRIPTION

RESPONSIBILITIES AND ASSIGNMENTS

Criação de workflows para orquestração de processos de transformação;
Implementação de scripts em Python e Scala;
Aplicação de regras de negócio (ex.: exclusão de dados originados no positivo);
Garantia de consistência e integridade dos dados na camada Gold;
Utilização de AWS S3 para armazenamento e AWS EMR para processamento distribuído;
Implementação de tabelas com Iceberg para versionamento e governança;
Uso de ClickHouse como tecnologia complementar.

REQUIREMENTS AND QUALIFICATIONS

Proficiência em SQL;
Entendimento de modelagem de dados;
Experiência com ETL;
Experiência com cloud AWS (S3 e EMR);
Experiência com Python;
Experiência com Scala;
Conhecimento desejável: ClickHouse.

Become a Compasser, be part of AI/R.

Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies.

We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets.

To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies.

We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth.

Join us and be part of the AI-driven revolution.

Ready to apply?

APPLY

Share ·