Key Facts

Remote From:

Full time

English

Hard Skills

Databricks Databricks Python (Programming Language) SQL (Programming Language) Data Processing Data Transformation Data Quality Data Cleansing Query Optimization Analytics

Other Skills

•
Analytical Skills
•
Troubleshooting (Problem Solving)
•
Problem Solving
•
Communication
•
Collaboration

Roles & Responsibilities

Hands-on experience with Databricks
Strong programming skills in Python and PySpark
Strong SQL development and query optimization experience
Experience designing, developing, and maintaining ETL pipelines

Requirements:

Create and maintain ETL pipelines and/or migrate existing legacy pipelines to Databricks
Develop scalable data processing solutions using Python, PySpark, and SQL
Perform data transformation, cleansing, and validation to ensure data quality and consistency
Optimize data workflows and Spark jobs for performance and efficiency

ARK Solutions, Inc.

Human Resources, Staffing & Recruiting

About ARK Solutions, Inc.

WE'RE A COMPANY THAT CARES FOR OTHERS BEYOND STAFFING OUR CULTURE SHAPES EVERYTHING WE DO. Our people, clients, and consultants matter to us more than anything. We are driven by a culture of purpose, shared values, and growth. OUR CLIENTS ARE OUR DRIVING FORCE Whether it’s finding the right candidate for a job or seamlessly managing a project end to end, our conviction and commitment to our clients runs deep. No matter what it takes, we’re devoted towards the success of your business. OUR PEOPLE ARE OUR FAMILY Our team members are our family. We’re here for you and we won’t stop until you’re exactly where you want to be. We believe in your potential and we are devoted to helping you achieve your ambition. IT’S ALL ABOUT YOU Your business is our business. We believe in making our relationship and understanding strong, and we know just how to do that. Our mantra is: analyze, identify, recruit, execute. Our mission is to create relationships, not transactions. Our promise is that we'll be there, as questions or issues arise, every step of the way. With experience in staffing and implementing projects, we thrive on sharing our experience and knowledge to help you make a success of your business. Our track record proves that clear communication and expert collaboration will boost your bottom line. ARK was formed in 2003 with the goal of becoming the supplier of choice for clients, employer of choice for our employees and contingent workforce. We provide high-volume staffing, SOW and payrolling services to structured contingent workforce programs and projects across USA. With our deep industry knowledge, business process expertise, comprehensive resources and a proven track record, ARK Solutions, Inc. can mobilize the right talent across various skills. ARK Solutions, Inc. is a certified Minority Women Owned Firm by NMSDC, State of VA, PA, NY and MD.

Company type: SME

Industry: Human Resources, Staffing & Recruiting

Founded: 2018

Company size: 201 - 500

Website LinkedIn See all jobs →

Job description

Databricks Engineer - Remote, Washington, DC

Duration: 12 months

Seeking for a Databricks Engineer responsible for designing, developing, maintaining, and optimizing scalable data pipelines and ETL processes using Databricks, Python, PySpark, and SQL. This role will play a key part in modernizing data platforms and supporting enterprise data initiatives.

Day-to-day Responsibilities:

Create and maintain ETL pipelines and/or migrate existing legacy pipelines (e.g., synapse) to Databricks
Develop scalable data processing solutions using Python, PySpark, and SQL.
Perform data transformation, cleansing, and validation to ensure data quality and consistency.
Optimize data workflows and Spark jobs for performance and efficiency.
Collaborate with business stakeholders, data architects, and development teams to understand requirements and deliver effective solutions.
Monitor, troubleshoot, and resolve data pipeline issues.

Qualifications: