Logo for ARK Solutions, Inc.

Databricks Engineer :: Washington, DC (REMOTE)

ARK Solutions, Inc.

Role overview

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Strong experience with the Databricks Lakehouse Platform.
  • Proficiency in PySpark and SQL.
  • Experience implementing Medallion Architecture.

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using the Databricks Lakehouse Platform.
  • Develop data transformation processes using PySpark and SQL.
  • Implement and maintain the Medallion Architecture (Bronze, Silver, and Gold layers) for efficient data processing.
  • Optimize Spark jobs, SQL queries, and Databricks workloads for performance and scalability.

Key facts

Hard skills

Databricks Databricks SQL (Programming Language) CI/CD Azure DevOps Base SAS Unix Linux

Other skills

  • Analytical Skills
  • Troubleshooting (Problem Solving)
  • Problem Solving
  • Communication

About the company

ARK Solutions, Inc. logo

ARK Solutions, Inc.

IT Services & IT Consulting

WE'RE A COMPANY THAT CARES FOR OTHERS BEYOND STAFFING OUR CULTURE SHAPES EVERYTHING WE DO. Our people, clients, and consultants matter to us more than anything. We are driven by a culture of purpose, shared values, and growth. OUR CLIENTS ARE OUR DRIVING FORCE Whether it’s finding the right candidate for a job or seamlessly managing a project end to end, our conviction and commitment to our clients runs deep. No matter what it takes, we’re devoted towards the success of your business. OUR PEOPLE ARE OUR FAMILY Our team members are our family. We’re here for you and we won’t stop until you’re exactly where you want to be. We believe in your potential and we are devoted to helping you achieve your ambition. IT’S ALL ABOUT YOU Your business is our business. We believe in making our relationship and understanding strong, and we know just how to do that. Our mantra is: analyze, identify, recruit, execute. Our mission is to create relationships, not transactions. Our promise is that we'll be there, as questions or issues arise, every step of the way. With experience in staffing and implementing projects, we thrive on sharing our experience and knowledge to help you make a success of your business. Our track record proves that clear communication and expert collaboration will boost your bottom line. ARK was formed in 2003 with the goal of becoming the supplier of choice for clients, employer of choice for our employees and contingent workforce. We provide high-volume staffing, SOW and payrolling services to structured contingent workforce programs and projects across USA. With our deep industry knowledge, business process expertise, comprehensive resources and a proven track record, ARK Solutions, Inc. can mobilize the right talent across various skills. ARK Solutions, Inc. is a certified Minority Women Owned Firm by NMSDC, State of VA, PA, NY and MD.

Company details

Company typeSME
IndustryIT Services & IT Consulting
Company size201 - 500

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Databricks Engineer

Location: Washington, DC (REMOTE)

Duration: 7+ months

Seeking for a Databricks Data Engineer with experience building scalable data pipelines using the Databricks Lakehouse Platform, PySpark, and SQL. This role involves designing and optimizing data solutions, implementing the Medallion Architecture, managing data governance through Unity Catalog, and supporting CI/CD processes for reliable data deployments.

Key Responsibilities:

  • Design, develop, and maintain scalable ETL/ELT data pipelines using the Databricks Lakehouse Platform.
  • Develop data transformation processes using PySpark and SQL.
  • Implement and maintain the Medallion Architecture (Bronze, Silver, and Gold layers) for efficient data processing.
  • Optimize Spark jobs, SQL queries, and Databricks workloads for performance and scalability.
  • Configure and manage Unity Catalog, including row-level security, column-level security, data lineage, and secure data sharing.
  • Develop, test, and deploy Databricks solutions using CI/CD pipelines and version control tools.
  • Monitor and troubleshoot production data pipelines to ensure high availability and reliability.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions that meet business requirements.
  • Implement data quality checks, validation processes, and governance best practices.
  • Document technical designs, workflows, and operational procedures.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Strong experience with the Databricks Lakehouse Platform.
  • Proficiency in PySpark and SQL.
  • Experience implementing Medallion Architecture.
  • Hands-on experience with Unity Catalog, including data governance, row-level security, column-level security, and data lineage.
  • Experience with ETL/ELT pipeline development and data transformation.
  • Knowledge of performance tuning and optimization techniques in Databricks.
  • Experience with CI/CD tools and version control systems such as Azure DevOps, Git, or GitHub.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent verbal and written communication skills.

Preferred Qualifications

  • Experience with SAS.
  • Experience with Unix/Linux environments.
  • Advanced SQL development and optimization skills.
  • Experience working with Delta Lake and modern cloud-based data platforms.
  • Familiarity with Agile development methodologies.

Required Skills

  • Databricks Lakehouse Platform
  • PySpark
  • SQL
  • Medallion Architecture
  • Unity Catalog
  • Delta Lake
  • CI/CD
  • Git / Azure DevOps
  • Data Pipeline Development

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Washington (USA)

Other jobs at ARK Solutions, Inc.

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.