Logo for IDBC Creative Solutions

Databricks Engineer - Data Analytics & AI Division

Role overview

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • More than 4 years of experience in data engineering, big data, or cloud-based analytics
  • More than 2 years of hands-on experience with Databricks (Workflows, Jobs, Notebooks, and Clusters)
  • Expertise in Apache Spark (PySpark/Scala) for large-scale data processing and real-time analytics

Responsibilities

  • Building and optimizing modern data platforms
  • Developing scalable data pipelines
  • Supporting cloud-based analytics solutions
  • Collaborating with data scientists, analysts, and business teams to understand data needs

About the company

IDBC Creative Solutions logo

IDBC Creative Solutions

Staffing & Recruiting

IDBC is a digital recruitment agency providing services in permanent placement and outsourcing, covering a wide range of positions and sectors from IT, bank, finance, through telco, SSC, to energy. Founded in 2014 and consistently growing in the past years, our team of 200+ offers a strong professional focus on results while always being human-centered. Get in touch with us if you're looking for a partner in recruitment. IDBC - creative | digital | fun

Company details

Company typeSME
IndustryStaffing & Recruiting
Company size51 - 200

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

The Project

We are looking for a Data Engineer (Databricks) to join our partner's international team. The role focuses on building and optimizing modern data platforms, developing scalable data pipelines, and supporting cloud-based analytics solutions in a dynamic environment.



Requirements

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • More than 4 years of experience in data engineering, big data, or cloud-based analytics, with a strong preference for experience in banking or fintech sector
  • More than 2 years of hands-on experience with Databricks (Workflows, Jobs, Notebooks, and Clusters), including Delta Lake, Spark Structured Streaming
  • Expertise in Apache Spark (PySpark/Scala) for large-scale data processing and real-time analytics
  • Advanced experience in SQL and Python/Scala, with experience in data transformations and ETL pipelines
  • Strong understanding of Delta Lake architecture for data versioning, ACID transactions, and schema evolution
  • Experience with Cloud Platforms, particularly Databricks on Azure
  • Knowledge of Lakehouse architecture and designing scalable, secure, and cost-efficient data pipelines is a plus
  • Familiarity with streaming architectures (Kafka) is a plus
  • Experience in MLOps and model deployment using MLflow in Databricks is a plus
  • Ability to collaborate with data scientists, analysts, and business teams to understand data needs
  • Strong problem-solving skills, with the ability to troubleshoot performance bottlenecks and optimize workloads
  • Excellent communication skills to explain technical concepts to non-technical stakeholders


Benefits

Benefits

  • Full-remote working
  • International working environment
  • Modern technologies and challenging projects
  • Opportunity to work with experienced professionals
  • Long-term career opportunities


Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Other jobs at IDBC Creative Solutions

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.