Logo for Exavalu

Databricks Platform Engineer (Terraform / AWS / GitLab CI/CD)

Role overview

Summary

This role focuses on managing Databricks infrastructure using Terraform and integrating CI/CD processes with GitLab. You will collaborate with platform engineering to establish infrastructure standards and secure connections, ensuring efficient deployment on AWS.

Qualifications

  • 10+ years of experience in relevant field.
  • Terraform with the Databricks provider
  • Databricks deployment on AWS
  • GitLab CI/CD integration with Databricks
  • Core AWS services: IAM, VPC, S3

Responsibilities

  • Deploy and manage Databricks on AWS using Terraform
  • Build and maintain Terraform code for Databricks resources: workspaces, clusters, jobs, permissions and Unity Catalog
  • Set up GitLab CI/CD pipelines that deploy infrastructure and Databricks assets
  • Configure secure connections between GitLab, Databricks and AWS

Key facts

Hard skills

About the company

Exavalu logo

Exavalu

  • IT Services & Consulting
  • Scaleup
  • 201–500
Exavalu is your sustained strategic partner to deliver meaningful change and lasting value. Our seasoned industry veterans are experienced in solving your most challenging problems. We stay with you until the results are achieved. Big firm expertise. Small firm feel. Get the transformation you wish for. Visit www.exavalu.com

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

This is a remote position.

JD: Databricks Platform Engineer (Terraform / AWS / GitLab CI/CD)

Experience: 10+ years

Role summary

This is a hands-on engineer role covering Databricks infrastructure-as-code, deployment on AWS, and CI/CD integration with GitLab. You’ll work closely with platform engineering. It does not involve data science.

Key responsibilities

  • Deploy and manage Databricks on AWS using Terraform
  • Build and maintain Terraform code for Databricks resources: workspaces, clusters, jobs, permissions and Unity Catalog
  • Set up GitLab CI/CD pipelines that deploy infrastructure and Databricks assets
  • Configure secure connections between GitLab, Databricks and AWS
  • Work with platform engineers on infrastructure standards and integrations

Must-have skills

  • Terraform with the Databricks provider
  • Databricks deployment on AWS
  • GitLab CI/CD integration with Databricks
  • Core AWS services: IAM, VPC, S3

Good to have

  • Databricks and data engineering experience
  • OpenTelemetry (OTel) for observability


Requirements

Key responsibilities

  • Deploy and manage Databricks on AWS using Terraform
  • Build and maintain Terraform code for Databricks resources: workspaces, clusters, jobs, permissions and Unity Catalog
  • Set up GitLab CI/CD pipelines that deploy infrastructure and Databricks assets
  • Configure secure connections between GitLab, Databricks and AWS
  • Work with platform engineers on infrastructure standards and integrations

Must-have skills

  • Terraform with the Databricks provider
  • Databricks deployment on AWS
  • GitLab CI/CD integration with Databricks
  • Core AWS services: IAM, VPC, S3

Good to have

  • Databricks and data engineering experience
  • OpenTelemetry (OTel) for observability

Benefits

At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, color, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.

Exavalu also promotes flexibility  depending on the needs of employees, customers and the business. It might be part-time work, working outside normal 9-5 business hours or working remotely. We also have a welcome back program to help people get back to the mainstream after a long break due to health or family reasons.



Related jobs

See all Platform Engineer jobs

Other jobs at Exavalu