Key Facts

Remote From:

Washington (USA)

Category: Data Engineer

Full time

English

Hard Skills

Databricks Databricks Python (Programming Language) SQL (Programming Language) Autoload Data Streaming

Roles & Responsibilities

Hands-on experience with data engineering on Databricks.
Strong skills in PySpark, Python, and SQL.
Experience with Delta Lake, medallion architecture, Autoloader, Structured Streaming, and Unity Catalog.

Requirements:

Build and maintain data ingestion and transformation pipelines using PySpark and Databricks SQL.
Migrate datasets and ETL logic to Delta Lake on Databricks, ensuring data parity with source systems.
Implement medallion architecture (Bronze/Silver/Gold) with lineage and access controls in Unity Catalog.
Utilize Databricks Autoloader, Lakeflow Connect, and Structured Streaming for incremental data ingestion.

ARK Solutions, Inc.

Human Resources, Staffing & Recruiting

About ARK Solutions, Inc.

WE'RE A COMPANY THAT CARES FOR OTHERS BEYOND STAFFING OUR CULTURE SHAPES EVERYTHING WE DO. Our people, clients, and consultants matter to us more than anything. We are driven by a culture of purpose, shared values, and growth. OUR CLIENTS ARE OUR DRIVING FORCE Whether it’s finding the right candidate for a job or seamlessly managing a project end to end, our conviction and commitment to our clients runs deep. No matter what it takes, we’re devoted towards the success of your business. OUR PEOPLE ARE OUR FAMILY Our team members are our family. We’re here for you and we won’t stop until you’re exactly where you want to be. We believe in your potential and we are devoted to helping you achieve your ambition. IT’S ALL ABOUT YOU Your business is our business. We believe in making our relationship and understanding strong, and we know just how to do that. Our mantra is: analyze, identify, recruit, execute. Our mission is to create relationships, not transactions. Our promise is that we'll be there, as questions or issues arise, every step of the way. With experience in staffing and implementing projects, we thrive on sharing our experience and knowledge to help you make a success of your business. Our track record proves that clear communication and expert collaboration will boost your bottom line. ARK was formed in 2003 with the goal of becoming the supplier of choice for clients, employer of choice for our employees and contingent workforce. We provide high-volume staffing, SOW and payrolling services to structured contingent workforce programs and projects across USA. With our deep industry knowledge, business process expertise, comprehensive resources and a proven track record, ARK Solutions, Inc. can mobilize the right talent across various skills. ARK Solutions, Inc. is a certified Minority Women Owned Firm by NMSDC, State of VA, PA, NY and MD.

Company type: SME

Industry: Human Resources, Staffing & Recruiting

Founded: 2018

Company size: 201 - 500

Website LinkedIn See all jobs →

Job description

Databricks Data Engineer - Remote, Washington, DC

Duration: 3 months

Seeking for a skilled Databricks Data Engineer to develop and maintain data solutions using the Databricks platform. This role involves building user interfaces and dashboards, as well as managing data pipelines for critical data products.

Key Responsibilities:

Build and maintain data ingestion and transformation pipelines using PySpark and Databricks SQL.
Migrate datasets and ETL logic to Delta Lake on Databricks, ensuring data parity with source systems.
Implement medallion architecture (Bronze/Silver/Gold) with lineage and access controls in Unity Catalog.
Utilize Databricks Autoloader, Lakeflow Connect, and Structured Streaming for incremental data ingestion.

Skills/Qualifications:

Hands-on experience with data engineering on Databricks.
Strong skills in PySpark, Python, and SQL.
Experience with Delta Lake, medallion architecture, Autoloader, Structured Streaming, and Unity Catalog.