Logo for Healthfirst

Sr Data Engineer

Roles & Responsibilities

  • 8+ years of overall IT experience
  • Enterprise experience in Python and PySpark for building enterprise data frameworks
  • Experience with data ingestion using ETL tools (Glue, DBT or equivalents)
  • Experience with data warehousing concepts and big data technologies such as EMR and Hadoop

Requirements:

  • Lead and implement data management strategies across data integration, ingestion, cleansing, transformations, migrations, purging, and backups
  • Collaborate with stakeholders to understand data requirements and translate them into data architecture and Healthfirst data management practices
  • Author artifacts defining standards for storing, processing, and moving data, including business rules, and map these to business processes and technical enablement
  • Identify data trends and develop workflows or algorithms to surface strategic data for the enterprise

Job description

The Senior Data Engineer leads and implements best-in-class data management strategies and practices through various forms of integration, data acquisition/ingestion, data cleansing/refinements, data transformations/conversions, data migrations, data purging, and back-ups. The incumbent works with a variety of users and stakeholders to understand data requirements and supports the data architecture to translate into the data management practice at Healthfirst. The Sr. Data Engineer authors artifacts defining standards and definitions for storing, processing, and moving data including associated processes and business rules. Additionally, the Sr. Data Engineer maps the details within these artifacts to business processes, non-functional characteristics, qualitative criteria, and technical enablement. He/she must constantly think through the needs of the business to support efficient and error-free processes. The Sr. Data Engineer finds trends in datasets and develops workflows and algorithms to highlight strategic raw data as useful to the enterprise. The Sr. Data Engineer creates data acquisition strategy and develops dataset processes in a robust manner according to best practices of standardization.

Minimum Qualifications:

•              8+ Years overall IT experience

•              Enterprise experience in scripting languages primarily Python and Pyspark building enterprise frameworks

•              Enterprise experience in data ingestion methodologies using different etl tools(Glue,DBT or any other)

•              Enterprise experience in data warehousing concepts and big data technologies like EMR, Hadoop

•              Enterprise experience in any cloud infrastructure like AWS,GCP,Azure

•              Strong SQL expertise across different relational and NoSQL Databases.

Preferred Qualifications:

•              Strong knowledge of data security, encryption, and compliance standards.

•              Hands-on experience with CI/CD pipelines and DevOps practices in a data engineering environment.

•              Experience in API building

•              Experience building stream platforms

Compliance and Regulatory Responsibilities: N/A

License/Certification: N/A

WE ARE AN EQUAL OPPORTUNITY EMPLOYER.  HF Management Services, LLC complies with all applicable laws and regulations. Applicants and employees are considered for positions and are evaluated without regard to race, color, creed, religion, sex, national origin, sexual orientation, pregnancy, age, disability, genetic information, domestic violence victim status, gender and/or gender identity or expression, military status, veteran status, citizenship or immigration status, height and weight, familial status, marital status, or unemployment status, as well as any other legally protected basis. HF Management Services, LLC shall not discriminate against any disabled employee or applicant in regard to any position for which the employee or applicant is otherwise qualified.

If you have a disability under the Americans with Disability Act or a similar law and want a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to careers@Healthfirst.org or calling 212-519-1798 . In your email please include a description of the accommodation you are requesting and a description of the position for which you are applying. Only reasonable accommodation requests related to applying for a position within HF Management Services, LLC will be reviewed at the e-mail address and phone number supplied. Thank you for considering a career with HF Management Services,  LLC.

Know Your Rights

All hiring and recruitment at Healthfirst is transacted with a valid “@healthfirst.org” email address only or from a recruitment firm representing our Company. Any recruitment firm representing Healthfirst will readily provide you with the name and contact information of the recruiting professional representing the opportunity you are inquiring about. If you receive a communication from a sender whose domain is not @healthfirst.org, or not one of our recruitment partners, please be aware that those communications are not coming from or authorized by Healthfirst.  Healthfirst will never ask you for money during the recruitment or onboarding process.

Hiring Range*:

  • Greater New York City Area (NY, NJ, CT residents): $134,600 - $194,480

  • All Other Locations (within approved locations): $119,600 - $177,905

As a candidate for this position, your salary and related elements of compensation will be contingent upon your work experience, education, licenses and certifications, and any other factors Healthfirst deems pertinent to the hiring decision.

In addition to your salary, Healthfirst offers employees a full range of benefits such as, medical, dental and vision coverage, incentive and recognition programs, life insurance, and 401k contributions (all benefits are subject to eligibility requirements). Healthfirst believes in providing a competitive compensation and benefits package wherever its employees work and live.

*The hiring range is defined as the lowest and highest salaries that Healthfirst in “good faith” would pay to a new hire, or for a job promotion, or transfer into this role.

Data Engineer Related jobs

Other jobs at Healthfirst

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.