10+ years of experience in Databricks administration or cloud data platform support
Strong hands-on experience with Azure Databricks
Expertise in cluster and workspace administration
Delta Lake and Lakehouse architecture
Requirements:
Administer and support Azure Databricks environments, including workspace and cluster configurations
Monitor system performance, identify issues such as cluster spikes, and implement optimization strategies
Implement and manage CI/CD pipelines for Databricks deployments
Configure and manage Unity Catalog and metastore
Job description
Job Title: Databricks Administrator Location: Remote Rate: DOE Duration: Contract
Job Summary
We are seeking an experienced Databricks Administrator to manage, monitor, and optimize the Databricks platform environment. The ideal candidate will have strong hands-on experience with Azure Databricks, cluster management, CI/CD deployments, and performance optimization within a cloud-based data ecosystem.
Key Responsibilities
Administer and support Azure Databricks environments, including workspace and cluster configurations
Monitor system performance, identify issues such as cluster spikes, and implement optimization strategies
Manage and configure job clusters, ensuring efficient resource utilization
Handle incident management, create tickets, and perform root cause analysis
Implement and manage CI/CD pipelines for Databricks deployments
Optimize platform architecture and improve overall system performance
Configure and manage Unity Catalog and metastore
Work with engineering teams to resolve platform-related issues
Ensure security best practices across IAM, networking, and data access
Maintain documentation for configurations, processes, and troubleshooting
Required Technical Skills
10+ years of experience in Databricks administration or cloud data platform support