Logo for Virtasant

Senior Databricks Engineer/Architect

Role overview

Summary

This role focuses on designing and optimizing data pipelines and migration strategies to the Databricks platform. You will work with enterprise customers to modernize their data platforms and ensure data quality and performance, bridging technical teams and business stakeholders.

Qualifications

  • Experience as a Senior Data Engineer or Data Architect.
  • Specialization in designing, developing, and optimizing scalable data pipelines using PySpark and Databricks.
  • Skilled in architecting and executing data migrations to Databricks.
  • Ability to translate complex technical requirements into effective data solutions.
  • Experience collaborating with cross-functional teams and presenting technical strategies to stakeholders.

Responsibilities

  • Design, develop, and maintain scalable, high-performance data pipelines.
  • Architect and lead data migration strategies to the Databricks platform.
  • Develop and optimize complex data transformations using PySpark.
  • Build and enhance ETL/ELT processes to support enterprise data initiatives.

Key facts

  • Remote from: United States
  • Full time
  • Senior (5-10 years)
  • English

Hard skills

Other skills

  • Collaboration
  • Communication
  • Presentations

About the company

Virtasant logo

Virtasant

  • IT Services & Consulting
  • SME
  • 51–200
Virtasant is a fully-remote and globally distributed technology and business services company that brings the breadth and capability of more than 4,000 technology professionals in 130 countries. We started working in the public cloud in 2007, and over the last 13 years, our team has built or re-platformed over 200 applications, with over 600 million lines of code currently under management.In this time, our team has developed proprietary software and methodologies that help us quickly and accurately identify opportunities to maximize the speed, scale and cost advantages that come with native cloud computing. Virtasant combines industry-leading cloud specialization with a deep bench of global experts across every aspect of the product lifecycle to deliver superior results to our clients. Virtasant offers services including cloud assessments and migrations, custom product development, information management, machine learning, remote team management, application modernization, full-lifecycle technology outsourcing, and more.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Senior Databricks Engineer/Architect

Job Type: 1099 contract, long-term & ongoing

Location: Remote in US

About Virtasant

Virtasant is a global technology services company with a network of over 4,000 technology professionals across 130+ countries.

We help organizations modernize cloud platforms, improve engineering efficiency, and optimize cloud spend through architecture, automation, and FinOps best practices.

Our teams work directly with enterprise customers to identify inefficiencies, drive modernization efforts, and deliver measurable business outcomes.

What We're Looking For

Experienced Senior Data Engineer or Data Architect specializing in designing, developing, and optimizing scalable data pipelines using PySpark and Databricks.

Skilled in architecting and executing data migrations to Databricks, modernizing data platforms, and building robust ETL/ELT workflows that ensure data quality, performance, and reliability.

Adept at translating complex technical requirements into effective data solutions, collaborating with cross-functional teams, and presenting technical strategies, architecture designs, and project outcomes to business stakeholders and leadership.

What You'll Do

  • Design, develop, and maintain scalable, high-performance data pipelines.

  • Architect and lead data migration strategies to the Databricks platform.

  • Develop and optimize complex data transformations using PySpark.

  • Build and enhance ETL/ELT processes to support enterprise data initiatives.

  • Ensure data quality, integrity, scalability, and performance across data platforms.

  • Present technical solutions, migration roadmaps, and project progress to stakeholders.

  • Bridge the gap between technical teams and business stakeholders to align data solutions with organizational objectives.

Related jobs

See all jobs

Other jobs at Virtasant