Logo for Cirium

Senior Data Scientist III**Remote in San Francisco, CA

Role overview

Summary

This role focuses on leading LLM training and fine-tuning projects at LexisNexis Legal & Professional. You will manage data scientists and collaborate with product and engineering teams to ensure effective model deployment and monitoring.

Qualifications

  • Strong understanding of transformer architectures and language modeling objectives.
  • Strong Python and PyTorch skills, with practical experience using Hugging Face Transformers.
  • Demonstrated ability to implement supervised fine-tuning and tune hyperparameters.
  • Practical experience with parameter-efficient fine-tuning methods like LoRA or QLoRA.
  • Experience training models across multiple GPUs using frameworks such as PyTorch FSDP or DeepSpeed.

Responsibilities

  • Lead the design and execution of LLM training and fine-tuning projects.
  • Oversee the preparation of high-quality training datasets.
  • Develop and optimize supervised fine-tuning and parameter-efficient fine-tuning workflows.
  • Establish evaluation frameworks to assess factual accuracy and performance on business-specific tasks.

Key facts

Hard skills

About the company

Cirium logo

Cirium

  • Data & Analytics
  • SME
  • 501–1,000
Cirium® is transforming the worlds of aviation and travel with smart data and advanced analytics solutions. Cirium brings together powerful aviation analytics and data to keep the world moving. Delivering insight built from decades of experience in the sector, enabling travel companies, aircraft manufacturers, airports, airlines and financial institutions, among others, to make logical and informed decisions which shape the future of travel, growing revenues and enhancing customer experiences. Cirium is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers. Track airline and airport reliability with Cirium's monthly and annual On-Time Performance reports. https://www.cirium.com/on-time-performance/ See how to Elevate your business with Cirium, the world’s most trusted Aviation Analytics company: https://www.youtube.com/watch?v=_tR8VXlzWvo

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About the Business


LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services.


Responsibilities


  • Lead the design and execution of LLM training and fine-tuning projects, including model selection, training strategy, experimentation, and evaluation.
  • Oversee the preparation of high-quality training datasets, including data collection, cleaning, deduplication, annotation, and quality validation.
  • Develop and optimize supervised fine-tuning and parameter-efficient fine-tuning workflows; apply preference optimization methods where appropriate.
  • Establish evaluation frameworks to assess factual accuracy, instruction following, domain relevance, safety, and performance on business-specific tasks.
  • Diagnose training issues and improve model quality, training stability, GPU utilization, and computational efficiency.
  • Manage and mentor data scientists, review technical work, and establish reproducible development practices.
  • Partner with product, engineering, and domain experts to define requirements and support model deployment and monitoring.
  • Manage project priorities, timelines, and compute resources, and communicate results and tradeoffs to stakeholders.

Required technical skills


  • LLM fundamentals: Strong understanding of transformer architectures, attention mechanisms, tokenization, language modeling objectives, and the differences between pretraining, continued pretraining, and fine-tuning.
  • Programming and frameworks: Strong Python and PyTorch skills, with practical experience using Hugging Face Transformers, Datasets, or equivalent tools.
  • Hands-on LLM training: Demonstrated ability to implement supervised fine-tuning (SFT), configure training objectives and loss masking, tune hyperparameters, and select model checkpoints.
  • Efficient fine-tuning: Practical experience with parameter-efficient fine-tuning (PEFT), including LoRA or QLoRA, and an understanding of their quality, memory, and compute tradeoffs.
  • Training data engineering: Ability to build instruction-response datasets, apply chat templates, manage sequence lengths and packing, and prevent data leakage and evaluation contamination.
  • GPU and distributed training: Experience training models across multiple GPUs using frameworks such as PyTorch FSDP or DeepSpeed, including mixed precision, gradient accumulation, and gradient checkpointing.
  • Evaluation and debugging: Ability to design reliable benchmarks and human evaluations, analyze model errors, and troubleshoot unstable loss, overfitting, and GPU memory issues.
  • Reproducibility: Experience with experiment tracking, dataset and model versioning, checkpoint management, and documented training pipelines.

Work in a Way That Works for You


We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.


Working Pattern


Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.

About the Business


LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services.



U.S. National Base Pay Range: $115,400 - $192,300. Geographic differentials may apply in some locations to better reflect local market rates.



This job is eligible for an annual incentive bonus.







We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.

Related jobs

See all Data Scientist jobs

Other jobs at Cirium