Logo for EPAM Systems

Senior AI Native Engineering

Role overview

Summary

This role focuses on architecting and deploying AI systems that support engineers and customers. You will work within the AI-native team to implement a spec-first and test-first methodology, ensuring the effectiveness of AI solutions in production.

Qualifications

  • At least one AI workflow or system currently running in production or CI.
  • Experience designing multi-step LLM or agent systems.
  • An evaluation methodology that you've either built from scratch or enhanced.
  • Understanding of what drives costs in your own AI work.
  • A minimum of 5 years in professional software engineering with direct production ownership.

Responsibilities

  • Design and operate production LLM systems, including multi-stage pipelines or agents.
  • Build and maintain evaluation frameworks, including golden datasets and regression evaluations.
  • Determine the level of autonomy for tasks and the role of AI assistance.
  • Integrate AI steps into CI/CD pipelines and fine-tune them for quality.

Key facts

  • Remote from: Ukraine, Europe, EMEA
  • Full time
  • Senior (5-10 years)
  • AI Engineer
  • English

Hard skills

Other skills

  • Communication

About the company

EPAM Systems logo

EPAM Systems

  • IT Services & Consulting
  • XLarge
  • 10,001+
Since 1993, EPAM Systems, Inc. (NYSE: EPAM) has used its software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments. We make GenAI real with our AI LLM orchestration, testing and engineering solutions, EPAM DIAL, EPAM EliteA™ and EPAM AI/RUN™, respectively. We deliver globally, but engage locally with our expert teams of consultants, architects, designers and engineers, making the future real for our clients, our partners and our people around the world. We believe the right solutions are the ones that improve people’s lives and fuel competitive advantage for our clients across diverse industries. Our thinking comes to life in the experiences, products and platforms we design and bring to market. Added to the S&P 500 and the Forbes Global 2000 in 2021 and recognized by Glassdoor and Newsweek as a Top 100 Best Workplace, our multidisciplinary teams serve customers across six continents. We are proud to be among the top 15 companies in Information Technology Services in the Fortune 1000 and to be recognized as a leader in the IDC MarketScapes for Worldwide Experience Build Services, Worldwide Experience Design Services and Worldwide Software Engineering Services. Learn more at www.epam.com.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

We are seeking a Senior AI-Native Engineer to become part of our AI-native team. This position focuses on architecting AI systems that fellow engineers and customers rely on, deploying them into production, and evaluating their effectiveness. The role follows an AI-native methodology: specifications come first, testing comes first, and coding agents handle implementation while under review. Responsibilities Design and operate production LLM systems, including multi-stage pipelines or agents with a curated tool set, output schemas, validation, retries, and failure recovery Build and maintain evaluation frameworks: golden datasets, regression evals for every prompt change, LLM-as-judge with spot checks, and production telemetry Determine where tasks should be fully autonomous, where AI should assist, and where human approval is required Execute work using a spec-first and test-first approach alongside coding agents, while maintaining deliberate and token-aware project context files (AGENTS.md, CLAUDE.md, steering files) Integrate AI steps into CI/CD pipelines (review gates, test generation, quality hooks) and fine-tune them to reduce false positives Forecast AI costs before development and track them afterward, applying cost-control levers such as model routing, context trimming, caching, batching, and limits Create and maintain reusable skills, prompts, tool schemas, eval sets, and MCP servers Identify AI failures early and resolve them through structural fixes, while supporting new team members in adopting the team's AI workflow Requirements At least one AI workflow or system currently running in production or CI with minimal daily oversight, which you can describe in detail: the trigger, the users, your specific contribution, and how success is measured Experience designing multi-step LLM or agent systems, including tool restriction, output schemas, validation, fallbacks, and latency trade-offs An evaluation methodology that you've either built from scratch or enhanced A past experience where you corrected a flawed output through a structural fix rather than simply rerunning the process Understanding of what drives costs in your own AI work, along with hands-on use of at least one cost-reduction lever with measurable results A minimum of 5 years in professional software engineering with direct production ownership At least 2 years of hands-on experience building with LLMs or agents in real-world projects Strong communication skills, such that a colleague could recreate your work based solely on your explanation Nice to have Experience with multi-agent systems in a production environment Background in brownfield discovery within a legacy codebase Experience embedding AI steps into CI/CD with measurable results (PR cycle time, defect density, AI acceptance rate) Familiarity with multiple model providers or platforms, along with the rationale for choosing each Experience with tracing and observability tools for LLM systems Background working in security-sensitive environments

Related jobs

See all AI Engineer jobs

Other jobs at EPAM Systems