10+ years of experience in Databricks administration or cloud data platform support.
Strong hands-on experience with Azure Databricks.
Experience with cluster and workspace administration, Unity Catalog/metastore configuration, and Delta Lake Lakehouse architecture.
Experience with Databricks REST APIs, CLI, Terraform, and Spark configuration and performance tuning.
Requirements:
Administer and manage Databricks platforms (clusters, workspaces, Unity Catalog, metastore configuration) to ensure performance and security.
Configure Delta Lake Lakehouse architecture and optimize Spark configurations for performance.
Utilize Databricks REST APIs, CLI, and Terraform to automate provisioning, deployment, and CI/CD integration.
Ensure IAM, networking, and cloud security principles are implemented and maintained; collaborate with stakeholders in an Agile, fast-paced environment.
Job description
Title: Databricks Admin. (Remote )
Technical Skills
10+ years of experience in Databricks administration or cloud data platform support.
Strong hands-on experience with Azure Databricks
Experience with:
Cluster and workspace administration
Unity Catalog, metastore configuration
Delta Lake & Lakehouse architecture
Databricks REST APIs, CLI, Terraform
Spark configurations and performance tuning
Understanding of IAM, networking, and cloud security principles.
Cloud Knowledge
Proficiency in Azure data services.
Strong understanding of cloud storage (ADLS, S3, GCS).
Programming / Scripting
Knowledge of Python, SQL, Bash, PowerShell, or similar scripting languages.
Familiarity with CI/CD (Azure DevOps, GitHub Actions, Jenkins).
Soft Skills
Strong analytical and troubleshooting skills.
Excellent communication and stakeholder management abilities.
Ability to work in an Agile, fast-paced environment.