10+ years of experience in Databricks administration or cloud data platform support
Strong hands-on experience with Azure Databricks
Expertise in cluster and workspace administration, Unity Catalog and metastore configuration, and Delta Lake/Lakehouse architecture
Experience with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins) and scripting (Python, SQL, Bash)
Requirements:
Administer and support Azure Databricks environments, including workspaces and clusters
Monitor platform performance, identify spikes in cluster usage, and implement optimizations
Manage and troubleshoot job clusters, including incident handling and ticket resolution
Configure and manage Unity Catalog and metastore; ensure security best practices across IAM, networking, and data access
Job description
Databricks Administrator (Remote)
Role Overview We are seeking an experienced Databricks Administrator to manage, monitor, and optimize our cloud-based data platform. The ideal candidate will have deep expertise in Azure Databricks, strong troubleshooting skills, and a proven ability to support CI/CD deployments, cluster performance, and overall platform architecture.
Key Responsibilities
Administer and support Azure Databricks environments, including workspaces and clusters
Monitor platform performance, identify spikes in cluster usage, and implement optimizations
Manage and troubleshoot job clusters, including incident handling and ticket resolution
Oversee configuration management and ensure platform stability and reliability
Support and review CI/CD pipelines for data platform deployments
Analyze and optimize Lakehouse architecture for performance and scalability
Configure and manage Unity Catalog and metastore
Ensure security best practices across IAM, networking, and data access
Collaborate with engineering and DevOps teams in an Agile environment
Technical Skills
10+ years of experience in Databricks administration or cloud data platform support
Strong hands-on experience with Azure Databricks
Expertise in:
Cluster and workspace administration
Unity Catalog and metastore configuration
Delta Lake and Lakehouse architecture
Databricks REST APIs, CLI, and Terraform
Apache Spark configuration and performance tuning
Solid understanding of IAM, networking, and cloud security principles
Cloud Expertise
Proficiency in Azure data services
Strong knowledge of cloud storage solutions such as ADLS, Amazon S3, and Google Cloud Storage (GCS)
Programming & Scripting
Proficiency in one or more scripting/programming languages:
Python, SQL, Bash, PowerShell
Experience with CI/CD tools such as:
Azure DevOps, GitHub Actions, Jenkins
Soft Skills
Strong analytical and problem-solving abilities
Excellent communication and stakeholder management skills
Ability to thrive in a fast-paced, Agile environment
Preferred Qualifications
Experience in large-scale data platform operations
Familiarity with monitoring and observability tools
Proven track record of optimizing distributed data systems
