Principal Data Engineer II

extra holidays - extra parental leave
Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Minimum of 5 years of experience with Azure Spark on Databricks, Strong programming skills in Scala or Python, Experience with big data technologies such as Hadoop and Hive, Familiarity with cloud computing platforms like Microsoft Azure..

Key responsabilities:

  • Design, build, and maintain data processing pipelines using Azure Spark on Databricks.
  • Optimize Spark jobs for performance and scalability.
  • Monitor and troubleshoot issues in the Spark environment or data processing pipelines.
  • Collaborate with data analysts and stakeholders to translate data requirements into models.

isolved logo
isolved Large https://www.isolvedhcm.com/
1001 - 5000 Employees
See all jobs

Job description

`Why Work Here

  • Headquarters is in Charlotte, NC
  • Recently expanded to nearshore
  • isolved ranked for SMB Payroll in 2023 Sapient Report
  • Voted top places to work in USA 2023

Job Description

isolved is seeking a skilled Azure Spark (Databricks) Engineer to join our team. The successful candidate will be responsible for designing, building, & maintaining data processing pipelines using Azure Spark on Databricks. They will also be responsible for optimizing Spark jobs for performance and scalability and troubleshooting issues that arise. Will maintain the technology roadmap of data utilities aligning with business objectives and priorities. Data Engineer will work with stakeholders (Product Managers and Engineer Leads) to ensure that all the various requirements are considered while designing for the target state platform and the capabilities.

Core Job Duties

  • Design, build, and maintain data processing pipelines using Azure Spark on Databricks.
  • Optimize Spark jobs for performance and scalability
  • Monitor and troubleshoot issues that arise with the Spark environment or data processing pipelines
  • Collaborate with data analysts and stakeholders to understand data requirements and translate them into logical and physical data models
  • Continuously improve our Spark infrastructure and processes
  • Stay up to date with the latest developments in Spark and Databricks technology
  • Leverage disparate data sources, relevant external data, and strong domain expertise, to achieve deliverables.
  • Provide technical skills to analytic projects, performing more intermediate project analysis and data modeling, ultimately ensuring that the deliverable is high-quality and provides impactful insights.

Minimum Qualifications

  • Minimum of 5 years of experience working with Azure Spark on Databricks
  • Strong programming skills in Scala or Python
  • Experience with big data technologies such as Hadoop and Hive
  • Familiarity with cloud computing platforms such as Microsoft Azure
  • Excellent problem-solving and troubleshooting skills
  • Strong communication and collaboration skills

About Isolved

isolved is an employee experience leader, providing intuitive, people-first HCM (Human Capital Management) technology. Our solutions are delivered directly or through our partner network to more than five million employees and 145,000 employers - who use them every day to boost performance, increase productivity, and accelerate results while reducing risk. Our HCM platform, isolved People Cloud, seamlessly connects and manages the employee journey across talent management, HR & payroll, workforce management and engagement management functions. No matter the industry, we help high-growth organizations employ, enable and empower their workforce by transforming employee experience for a better today and a better tomorrow. For more information, visit www.isolvedhcm.com.

EEO Statement

isolved is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. isolved is a progressive and open-minded meritocracy. If you are smart and good at what you do, come as you are.

Disability Accommodation

Visit www.isolvedhcm.com/careers for more information regarding our incredible culture and focus on our employee experience. Visit www.isolvedeebenefits.com for a comprehensive list of our employee total rewards offerings.

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions outlined above.

In adherence to relevant pay transparency legislation and regulations, we endeavor to offer clarity regarding our compensation methodology for this position. While specific pay ranges are presently under review to ensure alignment with competitive market standards, we will furnish this information upon finalization.

At our organization, individual compensation structures are established through a consistent and equitable process, taking into account various pertinent factors. These factors encompass geographic location, job-specific competencies, educational attainment, professional certifications, and pertinent experience. This structured approach enables us to align our total rewards package competitively with each employee's qualifications, duties, and contributions to our collective success.

An employee's comprehensive compensation package comprises diverse components, such as base salary, performance-linked bonuses or commissions, long-term incentives like equity grants, and an extensive benefits portfolio. Should you advance as a finalist candidate, you will have the opportunity to explore our overarching compensation philosophy, practices, and how your unique background informs an appropriate compensation proposition.

Our commitment lies in fostering a fair, impartial, and transparent compensation framework throughout our workforce. All compensation determinations are aimed at justly acknowledging and rewarding the value, qualifications, and significant contributions that our employees bring to their roles and to the company's achievements. We welcome your inquiries about our principles of pay equity, accompanying analyses, and associated procedures throughout the recruitment process.

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Troubleshooting (Problem Solving)
  • Collaboration
  • Communication
  • Problem Solving

Data Engineer Related jobs