Logo for EPAM Systems

Senior Director, Frontier AI Research, Bay Area, NY

Role overview

Qualifications

  • Significant experience in machine learning, AI research, or research engineering, with demonstrated work on modern deep learning and large language models
  • Strong understanding of the model training and post-training lifecycle, including SFT, RLHF, reward modeling, and evaluation
  • Advanced degree in Computer Science, Machine Learning, AI, Statistics, or a related field, or equivalent demonstrated research experience
  • Demonstrated ability to communicate complex technical concepts clearly to both technical and cross-functional audiences

Responsibilities

  • Engage directly with researchers, engineers, and technical leaders at frontier AI labs to understand model training, post-training, and evaluation objectives
  • Translate ambiguous research goals into explicit target capabilities, failure modes, and success criteria, advising customers and internal teams on the right technical approach
  • Design rigorous evaluation approaches, including task taxonomies, benchmarks, rubrics, and graders, and analyze model outputs to identify failure modes and improvement opportunities
  • Help architect RL environments, reward functions, and verifiers that provide reliable training and evaluation signals while mitigating reward hacking and weak verification

Key facts

Hard skills

Other skills

  • Communication
  • Relationship Building

About the company

EPAM Systems logo

EPAM Systems

  • IT Services & Consulting
  • XLarge
  • 10,001+
Since 1993, EPAM Systems, Inc. (NYSE: EPAM) has used its software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments. We make GenAI real with our AI LLM orchestration, testing and engineering solutions, EPAM DIAL, EPAM EliteA™ and EPAM AI/RUN™, respectively. We deliver globally, but engage locally with our expert teams of consultants, architects, designers and engineers, making the future real for our clients, our partners and our people around the world. We believe the right solutions are the ones that improve people’s lives and fuel competitive advantage for our clients across diverse industries. Our thinking comes to life in the experiences, products and platforms we design and bring to market. Added to the S&P 500 and the Forbes Global 2000 in 2021 and recognized by Glassdoor and Newsweek as a Top 100 Best Workplace, our multidisciplinary teams serve customers across six continents. We are proud to be among the top 15 companies in Information Technology Services in the Fortune 1000 and to be recognized as a leader in the IDC MarketScapes for Worldwide Experience Build Services, Worldwide Experience Design Services and Worldwide Software Engineering Services. Learn more at www.epam.com.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

EPAM's new Frontier AI business unit partners directly with leading AI labs and advanced AI organizations, translating their research and post-training objectives into technically rigorous, deliverable programs across evaluations, RL environments, and training data. The Senior Director, Frontier AI Research is EPAM's first dedicated Frontier AI research hire, operating across a broad set of capabilities rather than a single research domain. The role sits at the intersection of research, solution architecture, and technical sales, remaining technically engaged through early pilots while delivery leadership owns day-to-day execution. The right person is a genuine technical peer to sophisticated AI researchers: someone who can translate ambiguous research goals into concrete specifications that delivery teams can execute at quality and scale. Req.#1072890310 Responsibilities Engage directly with researchers, engineers, and technical leaders at frontier AI labs to understand model training, post-training, and evaluation objectives Translate ambiguous research goals into explicit target capabilities, failure modes, and success criteria, advising customers and internal teams on the right technical approach Design rigorous evaluation approaches, including task taxonomies, benchmarks, rubrics, and graders, and analyze model outputs to identify failure modes and improvement opportunities Help architect RL environments, reward functions, and verifiers that provide reliable training and evaluation signals while mitigating reward hacking and weak verification Design technically rigorous training data programs (SFT, preference data, RLHF), defining task distributions, annotation criteria, and quality standards Translate recurring customer research needs into repeatable EPAM Frontier AI offerings, methodologies, and technical assets Partner with the Platform and Operations Lead to determine the tooling, infrastructure, and specialist talent required to deliver new offerings Serve as the primary research and technical SME supporting Frontier AI Sellers in strategic customer pursuits, from discovery through solution design Translate customer requirements into technically compelling solution designs, proposals, and pilot plans that establish credibility with sophisticated AI research organizations Convert research requirements into clear specifications, including scope, rubrics, and quality thresholds, that delivery teams can execute without losing the research intent Provide technical oversight during early and strategically important engagements, reviewing outputs and model behavior to confirm the program is producing the intended results Maintain strong familiarity with developments in frontier model training, post-training, RL, agentic systems, and evaluation, and apply that knowledge to EPAM's offerings Build relationships across the Frontier AI research ecosystem and contribute to technically credible customer facing content and thought leadership Requirements Significant experience in machine learning, AI research, or research engineering, with demonstrated work on modern deep learning and large language models Strong understanding of the model training and post-training lifecycle, including SFT, RLHF, reward modeling, and evaluation Demonstrated depth in one or more Frontier AI focus areas (evaluations, RL environments, agentic systems, reward or verifier design, coding agents), with the breadth to operate across adjacent areas Experience translating ambiguous research objectives into structured experiments, datasets, evaluations, or environments Hands-on technical capability, including strong Python skills and experience with modern ML frameworks, LLM APIs, and evaluation tooling Demonstrated ability to communicate complex technical concepts clearly to both technical and cross-functional audiences Advanced degree in Computer Science, Machine Learning, AI, Statistics, or a related field, or equivalent demonstrated research experience Nice to have Peer-reviewed AI/ML research or a strong record of technically substantive applied research Prior experience building solutions or conducting research for frontier AI labs or leading foundation model companies Direct experience with RLHF, RLAIF, preference optimization, or synthetic data generation and curation Comfortable operating as a genuine technical peer to sophisticated researchers, with the commercial awareness to translate research credibility into customer trust Entrepreneurial mindset, comfortable building a new capability and creating structure where established process does not yet exist

Related jobs

See all AI Research Scientist jobs

Other jobs at EPAM Systems