Proficient in Python and SQL with experience in query tuning and performance optimization., Familiarity with ETL pipelines, Databricks workflows, and data warehousing solutions like Snowflake., Knowledge of AWS services such as S3 and SQS, and experience with Terraform and GitLab CICD., Experience working with healthcare clients and understanding FHIR standards..
Key responsibilities:
Build and manage efficient ETL pipelines and data distribution extracts.
Collaborate with clients and implementation teams to understand data requirements.
Perform data analysis and mapping to produce client outputs.
Optimize performance of data extract scripts.
Report This Job
Help us maintain the quality of our job listings. If you find any issues with this job post, please let us know.
Select the reason you're reporting this job:
We are a WBENC and NMSDC certified company helping our clients in their Diversity spending on Staffing or Contingent Workforce Services. Established in 2002 and headquartered out of Princeton-NJ, our 2000+ associates’ strength globally helps clients with talent across Technology, Healthcare, Life Sciences, Aerospace, Automotive, Energy, Pharmaceuticals, Retail, Telecom, Manufacturing and Engineering domains. Our presence in USA, Canada & India helps us support clients in IT, Non-IT, Healthcare, Hospital and Clinical hiring, across the globe.
Data Engineer
Dallas, TX or Remote Contract / fulltime
Job Description :
Proficient with Python and SQL
Build and manage efficient ETL pipelines using Databricks workflows or other orchestration framework
Familiarity with both structured and semi-structured data and ingesting and processing this data using pyspark
Fundamental AWS services (S3, SQS) or similar services for other clouds
Terraform and GitLab CICD
Query tuning and performance optimization in SQL and/or SparkSQL
Familiarity with data warehousing (snowflake or similar)
Spark SQL
AWS, Databricks, Snowflake
Experience working for a cloud-based data services provider to large healthcare clients.
FHIR experience
Spark SQL
AWS, Databricks, Snowflake
Experience working for a cloud-based data services provider to large healthcare clients.
FHIR experience
Additional information:
Work with clients & implementation team and understand the data distribution requirements
Perform data analysis and data mapping required to produce client output.
Build the data distribution extracts and scripts
Optimize the performance of the data extract scripts
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Required profile
Experience
Spoken language(s):
English
Check out the description to know which languages are mandatory.