Role overview

Qualifications

7–10+ years of Data Engineering experience
Extensive hands-on Databricks experience
Strong PySpark programming
Advanced Spark SQL skills

Responsibilities

Design and build scalable ETL/ELT pipelines using Databricks
Develop PySpark and Spark SQL transformations
Build Bronze, Silver, and Gold data layers using Medallion Architecture
Implement Delta Live Tables, Workflows, and Unity Catalog

Key facts

Remote from: Ohio (USA)
Full time
Expert & Leadership (>10 years)
Data Engineer
English

Hard skills

Databricks Apache Spark Amazon Web Services Microsoft Azure gRPC CI/CD Distributed Data Store Data Streaming Corporate Governance Programming Tools

Other skills

Collaboration

About the company

PSI (Proteam Solutions Inc)

Established in 1992, PSI (Proteam Solutions Inc) has grown from a one man start up to a multi-million dollar IT Consulting, Workforce Solutions and Enterprise Resource Solutions firm providing senior-level consulting and talent management solutions to both the Private and Public Sector. We partner with our clients to address their most complex business challenges. Our extensive industry-leading expertise enable us to work collaboratively with our clients to plan, develop, and deliver innovative and integrated solutions. We untangle some of the most complex problems that our clients face. We get better outcomes because we take a more integrated approach to every engagement – addressing the underlying people, processes, as well as technology issues that can make or break a new solution. Our objective is always to deliver measurable return on investment (ROI) and positive business impact for our clients on every engagement. We evaluate opportunities and develop solutions that generate maximum effect with strong, sustainable gains in business performance, productivity, cost management, and customer satisfaction. We look beyond the obvious… To tackle the tough issues. Drive growth. Manage change. Get stuff done. It's our strategy. And it works. Services: • Enterprise Insight Management (EIM) • Enterprise Architecture • Mobility • Business Intelligence and Analytics • IT Infrastructure • Talent Augmentation • Workforce Solutions

Company details

Company typeSME

Company size11 - 50

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About the Role

We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, develop, and optimize enterprise-scale data pipelines. You'll play a key role in building scalable Lakehouse solutions while ensuring reliable, high-quality data for analytics, reporting, and downstream applications.

Key Responsibilities

Design and build scalable ETL/ELT pipelines using Databricks
Develop PySpark and Spark SQL transformations
Build Bronze, Silver, and Gold data layers using Medallion Architecture
Implement Delta Live Tables, Workflows, and Unity Catalog
Optimize Spark jobs for scalability and performance
Design dimensional data models for analytical workloads
Implement data quality validations and monitoring
Collaborate with analytics, engineering, and architecture teams
Build reusable frameworks and automation
Support CI/CD deployment pipelines and Git-based development

Required Qualifications

7–10+ years of Data Engineering experience
Extensive hands-on Databricks experience
Strong PySpark programming
Advanced Spark SQL skills
Experience with Delta Lake
Experience implementing Medallion Architecture
Hands-on Delta Live Tables
Unity Catalog experience
Strong SQL optimization and performance tuning
Experience with AWS, Azure, or GCP
CI/CD and Git experience
Strong understanding of distributed data systems
Experience designing enterprise data models

Preferred Qualifications

Databricks certification
Experience with streaming data
Experience building reusable data frameworks
Experience with enterprise governance
Exposure to AI-assisted development tools including Databricks AI Genie

#LI-WJ1
#PSI2