Logo for EDI Staffing, an EDI Specialists Company

Remote Data Engineer IV

EDI Staffing, an EDI Specialists Company

Role overview

Qualifications

  • Databricks: 5+ years of experience, certification required
  • Azure Data Factory: 5+ years of experience
  • Strong SQL Development: 5+ years of hands-on experience
  • Power BI Development: 3+ years of experience creating enterprise dashboards

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks and Azure Data Factory
  • Develop Spark-based data transformation and processing solutions for large-scale data environments
  • Move and transform data from various source systems into Azure Data Lake environments
  • Lead technical discussions, mentor team members, and promote engineering best practices

About the company

EDI Staffing, an EDI Specialists Company logo

EDI Staffing, an EDI Specialists Company

Staffing & Recruiting

At EDI Staffing, we believe that success starts with a solid foundation: People.Through our honest, resourceful, and innovative approach to staffing, we connect organizations across all industries with the country’s most talented and reliable people.For almost 30 years, EDI Staffing has connected our clients with top talent for contract, contract-to-hire, and direct-hire needs. Between our team of experienced recruiters and our active database of over 2 million professionals across the nation, we have the expertise and resources to help you find the right people. Let us help you do your job more effectively by building a great team around you!

Company details

IndustryStaffing & Recruiting
Company size11 - 50

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

We are seeking seven highly skilled Data Engineer IV professionals to lead the design, development, testing, and optimization of enterprise data solutions within the Azure ecosystem. This role requires deep expertise in Databricks, Azure Data Factory, Spark, SQL, and Power BI, along with strong leadership capabilities and the ability to work independently in a fast-paced Agile environment.
The ideal candidate will be responsible for building and supporting scalable data pipelines that move data from source systems into Azure Data Lake environments for reporting, analytics, and business intelligence. Candidates must have extensive experience working with Databricks, Unity Catalog, Delta Tables, and Power BI reporting solutions while ensuring data quality through effective unit and system testing practices.
All candidates must demonstrate strong communication skills, technical leadership experience, and the ability to guide engineering efforts across multiple workstreams.
Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Databricks and Azure Data Factory.
  • Develop Spark-based data transformation and processing solutions for large-scale data environments.
  • Move and transform data from various source systems into Azure Data Lake environments.
  • Utilize Databricks Unity Catalog and Delta Tables to manage and optimize enterprise data assets.
  • Develop and support Power BI datasets, semantic models, reports, dashboards, and visualizations.
  • Partner with business stakeholders to understand reporting and analytics requirements.
  • Perform unit testing, integration testing, and system testing to ensure complete and accurate data processing.
  • Validate that all required files and transactions are successfully captured and processed.
  • Troubleshoot and resolve data pipeline and reporting issues.
  • Participate in Agile ceremonies and contribute to sprint planning, backlog grooming, and delivery activities.
  • Lead technical discussions, mentor team members, and promote engineering best practices.
Required Qualifications
Must-Have Skills
  • Databricks: 5+ years of experience
    • Databricks Certification required
    • Strong experience with Databricks architecture, optimization, and development
  • Azure Data Factory: 5+ years of experience
  • SQL: 5+ years of strong hands-on development experience
  • Power BI Development: 3+ years of experience creating enterprise dashboards, reports, and data models
  • Strong Spark programming experience
  • Experience with Azure Data Lake environments
  • Experience working with Unity Catalog and Delta Tables
  • Strong understanding of data integration, transformation, and validation processes
  • Experience performing unit testing and system testing of data solutions
  • Strong verbal and written communication skills
  • Strong understanding of Agile development methodologies
  • Proven ability to function as a technical lead and mentor junior team members
Preferred Qualifications
  • Experience within large enterprise data environments
  • Azure cloud certifications
  • Experience with CI/CD and DevOps practices for data engineering
  • Knowledge of data governance, data quality, and security best practices
Leadership Expectations
  • Lead and influence technical solution design and implementation.
  • Provide guidance and mentorship to other engineers.
  • Drive best practices related to data engineering, testing, and reporting.
  • Communicate effectively with technical and business stakeholders.
  • Take ownership of deliverables and provide proactive issue resolution.
Top Required Skills
  1. Databricks (5+ years) - Certification Required
  2. Azure Data Factory (5+ years)
  3. Strong SQL Development (5+ years)
  4. Power BI Development
  5. Spark Programming
  6. Unity Catalog & Delta Tables
  7. Azure Data Lake
  8. Agile Methodology
  9. Strong Communication Skills
  10. Technical Leadership Experience
Ideal Candidate
A senior-level Data Engineer with Databricks certification who possesses extensive experience with Azure Data Factory, SQL, Spark, Power BI, Unity Catalog, and Delta Tables. This individual will be a strong technical lead capable of delivering enterprise-scale data and reporting solutions while ensuring data quality, performance, and business value.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Data Engineer Related jobs

North Carolina (USA)Data Engineer

Other jobs at EDI Staffing, an EDI Specialists Company

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.