Logo for EPAM Systems

Python AI Engineer

Role overview

Summary

This role focuses on evolving the infrastructure behind an enterprise knowledge base platform as it transitions to a broader knowledge system. You will work closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Qualifications

  • Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments.
  • Experience building CLI tools using Python, Golang, or Rust.
  • Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
  • Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.
  • Experience with ingestion, ETL, or content-processing pipelines at scale.

Responsibilities

  • Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg
  • Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity
  • Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls
  • Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions

Key facts

Hard skills

Other skills

  • Reliability

About the company

EPAM Systems logo

EPAM Systems

  • IT Services & Consulting
  • XLarge
  • 10,001+
Since 1993, EPAM Systems, Inc. (NYSE: EPAM) has used its software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments. We make GenAI real with our AI LLM orchestration, testing and engineering solutions, EPAM DIAL, EPAM EliteA™ and EPAM AI/RUN™, respectively. We deliver globally, but engage locally with our expert teams of consultants, architects, designers and engineers, making the future real for our clients, our partners and our people around the world. We believe the right solutions are the ones that improve people’s lives and fuel competitive advantage for our clients across diverse industries. Our thinking comes to life in the experiences, products and platforms we design and bring to market. Added to the S&P 500 and the Forbes Global 2000 in 2021 and recognized by Glassdoor and Newsweek as a Top 100 Best Workplace, our multidisciplinary teams serve customers across six continents. We are proud to be among the top 15 companies in Information Technology Services in the Fortune 1000 and to be recognized as a leader in the IDC MarketScapes for Worldwide Experience Build Services, Worldwide Experience Design Services and Worldwide Software Engineering Services. Learn more at www.epam.com.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

We are hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it transitions from a Confluence-focused RAG chatbot into a broader, agentic knowledge system. Today, our platform supports Confluence/GitHub ingestion → chunking → pgvector → RAG retrieval → FastAPI serving. In our next growth phase, we are expanding toward hybrid retrieval (vector + sparse + graph), multi-source ingestion, robust evaluation pipelines, agent infrastructure, and shared chat platform primitives. If you are passionate about building scalable, reliable, and production-grade AI infrastructure rather than just chasing demo behavior, we want to hear from you. Req.#1093687315 Responsibilities Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions Ingestion infrastructure across current and future content sources Full-stack observability across application, pipeline, database, and model-serving behavior Cost, latency, throughput, and failure-mode management for AI-heavy workloads Release workflows that validate AI behavior changes, not just code compilation Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform Requirements Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments Experience building CLI tools using Python, Golang, or Rust Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows Systems Understanding: Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems Strong skills across metrics, tracing, dashboards, alerting, and log analysis Experience with ingestion, ETL, or content-processing pipelines at scale An innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery Nice to have Experience with Qdrant, Neo4j, or other vector/graph infrastructure Prior experience supporting RAG, search, evaluation, or agent platforms Background in enterprise or highly regulated environments Familiarity with enterprise tooling such as Vault, Splunk, Artifactory, or ECR Comfort leveraging AI-assisted engineering workflows in day-to-day work

Related jobs

See all AI Engineer jobs

Other jobs at EPAM Systems