DataBricks Architect [EGN] at Crodu

Work set-up: 
Full Remote
Contract: 
Salary: 
200 - 200K yearly
Experience: 
Senior (5-10 years)
Work from: 

Offer summary

Qualifications:

Minimum 8 years of experience in data engineering or related roles., Strong knowledge of Databricks platform and Apache Spark., Proficiency in Python programming., Experience with cloud data migrations, especially in AWS environments..

Key responsibilities:

  • Ensure secure data storage and processing of medical imaging data.
  • Build and manage data processing pipelines and cohorts.
  • Plan and execute database migrations to cloud platforms.
  • Collaborate closely with data engineers, scientists, and clinical staff.

CRODU logo
CRODU Information Technology & Services Scaleup https://crodu.com/
51 - 200 Employees
See all jobs

Job description

🌴 Work format: long-term, full-time, 100% remote πŸ‘ˆ
⏰ Start: ASAP πŸ‘ˆ

Hi there! πŸ‘‹

We’re looking for Databricks Architect for our US-based client. The work involves activities such as data migration, data collection, and optimization of Databricks-based solutions. The client has a steady demand for specialists. Most of the projects are short-term (with a high chance of extension), and thanks to the consistent demand, the client is able to offer new engagements after a project ends.
Currently, we’re looking for specialists for an AI/ML project in the healthcare domain. The project involves processing text data and analyzing images generated by medical devices (X-ray, MRI, etc.). The collected data will be migrated to a cloud-based Databricks platform. The platform is designed to handle the full data lifecycle, with built-in features ensuring compliance, auditability, cohort creation, and model reuse. The goal is to solve existing data management challenges (fragmented sources, manual processes, insufficient security).
We’re looking for individuals with strong Python skills. Cloud experience and knowledge of Databricks and Apache Spark are crucial. The projects are mainly US-based - in most cases, working hours require only a slight overlap (e.g., 10:00 to 18:00 CET), but we’re flexible and happy to accommodate preferences.

Key responsibilities:
πŸ“ Ensuring secure data storage
πŸ“ Processing and indexing DICOM data
πŸ“ Data validation, building processing pipelines, creating and sharing cohorts
πŸ“ Planning and executing database migrations
πŸ“ Close collaboration with the team (including data engineers, data scientists, clinical informatics professionals, and support staff)

Requirements:
⚑️ Solid experience in a data engineering or related role (8+ years)
⚑️ Strong knowledge of the Databricks platform and Apache Spark
⚑️ Proficient in Python
⚑️ Experience with cloud data migrations
⚑️ Experience working in AWS environments (Amazon S3)
⚑️ Background in AI/ML project delivery
⚑️ Strong interpersonal and teamwork skills
⚑️ Initiative and the ability to work independently
⚑️ English fluency for effective communication within the team
Nice to have:

⚑️ Experience with other cloud platforms (e.g., Azure - Data Factory, Synapse, Logic Apps, Data Lake)
⚑️ Experience designing and optimizing data pipelines using DBT, SSIS, TimeXtender, or similar ETL/ELT solutions
⚑️ Exposure to big data or noSQL platforms (Redshift, Hadoop, EMR, Google Data, etc.)

How we work and what we offer:
🎯 We value open communication throughout the recruitment and employment process - we strive for clarity and transparency at every step
🎯 Our recruitment approach is human-centered - we simplify processes to be as smooth and candidate-friendly as possible
🎯 We operate on a "remote first" basis - remote work is the norm, and business travel is kept to a minimum
🎯 We offer private medical care (Medicover) and a Multisport card for contractors

How to apply? πŸ‘ˆ

Send us your application via the form!

Required profile

Experience

Level of experience: Senior (5-10 years)
Industry :
Information Technology & Services
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Social Skills
  • Teamwork
  • Communication

Related jobs