Key Facts

Remote From:

Full time

Senior (5-10 years)

English

Hard Skills

Git (Version Control System) Python (Programming Language) Access Controls Encryption General Security Jenkins Shell Commands Autoscaling Amazon CloudWatch Azure Databricks Databricks Mathematical Optimization Azure DevOps Well Logging Continuous Monitoring Development Environment Release Management Containerization Docker (Software)

Roles & Responsibilities

Extensive experience with AWS cloud services (VPC, S3, IAM, KMS, CloudWatch, Lake Formation, EC2, Lambda) and security best practices
Proven Databricks on AWS expertise (Workspace Admin, Cluster Policies, Instance Profiles, Unity Catalog)
Hands-on Terraform IaC experience for Databricks and AWS, with modular design and automation
Strong CI/CD and automation skills (GitHub Actions, Azure DevOps, Jenkins or equivalent) with Git/GitOps

Requirements:

Provision and manage AWS infrastructure for Databricks (VPCs, subnets, S3 buckets, IAM roles and policies)
Implement Infrastructure as Code (IaC) using Terraform for all environment resources
Create and maintain CI/CD pipelines for automated deployment of notebooks, jobs, and Databricks configurations
Configure Databricks on AWS (workspaces, clusters, instance profiles, Unity Catalog)

Compass.uol

About Compass.uol

Compasso UOL is a Brazilian technology company owned by the UOL Group, which offers technology services, and provides state-of-the-art solutions, contributing to the digital transformation of its customers so they can become leaders in its sectors of activity. Compasso UOL is a company that cultivates people's talent and use state-of-the-art technologies such as Agile Development, Multicloud, Data&Analytics, Cyber Security, Artificial Intelligence/Machine Learning, APIs/Microservices, IoT and others, providing technology and knowledge that help customers in building digital solutions that enable the transformation and evolution of their business.

Company type: XLarge

Founded: 2018

Company size: 5001 - 10000

LinkedIn See all jobs →

Job description

JOB DESCRIPTION

RESPONSIBILITIES AND ASSIGNMENTS

Provisionar e gerenciar a infraestrutura AWS para o Databricks (VPCs, subnets, S3 buckets, IAM roles e policies);
Implementar Infrastructure as Code (IaC) com Terraform para todos os recursos do ambiente;
Criar e manter pipelines de CI/CD para deploy automatizado de notebooks, jobs e configurações do Databricks;
Configurar o Databricks na AWS (workspaces, clusters, instance profiles, Unity Catalog);
Planejar e executar a migração dos Workspaces Databricks de Azure para AWS;
Implementar políticas de segurança, criptografia e controle de acesso (IAM, KMS, Lake Formation);
Configurar monitoramento, alertas e logging (CloudWatch, Databricks Overwatch);
Gerenciar ambientes (dev, staging, produção) e estratégias de promoção de código;
Otimizar custos de infraestrutura (Spot Instances, auto-scaling de clusters, reservas);

REQUIREMENTS AND QUALIFICATIONS

AWS (VPC, S3, IAM, KMS, CloudWatch, Lake Formation, EC2, Lambda);
Databricks on AWS (Workspace Admin, Cluster Policies, Instance Profiles, Unity Catalog);
Terraform (módulos para Databricks e AWS);
CI/CD (GitHub Actions, Azure DevOps, Jenkins ou equivalente);
Docker e containers (quando aplicável);
Git e GitOps;
Shell Script e Python para automação;
Conhecimento em Azure (para planejamento e execução da migração);
Databricks CLI e Databricks REST API;

Become a Compasser, be part of AI/R.

Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies.

We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets.

To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies.

We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth.

Join us and be part of the AI-driven revolution.

Ready to apply?

APPLY

Share ·