Logo for EPAM Systems

Senior GPU Compute & AI Kernel Engineer

Role overview

Qualifications

  • 5+ years of software development experience with modern C++ (C++17/20 preferred)
  • Strong experience developing high-performance compute kernels
  • Hands-on GPU programming experience with one or more of CUDA, SYCL, OpenCL, Triton or Apple Metal
  • Solid understanding of GPU and AI accelerator architectures

Responsibilities

  • Design, implement and optimize high-performance compute kernels for GPUs and AI accelerators
  • Accelerate machine learning workloads in PyTorch or TensorFlow, including custom operators and kernels
  • Map deep learning operators onto target accelerator architectures
  • Collaborate with compiler engineers on kernel code generation and lowering paths

Key facts

  • Remote from: Serbia, Europe, EMEA
  • Full time
  • Senior (5-10 years)
  • AI Engineer
  • English

Hard skills

Other skills

  • Collaboration

About the company

EPAM Systems logo

EPAM Systems

  • IT Services & Consulting
  • XLarge
  • 10,001+
Since 1993, EPAM Systems, Inc. (NYSE: EPAM) has used its software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, and a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments. We make GenAI real with our AI LLM orchestration, testing and engineering solutions, EPAM DIAL, EPAM EliteA™ and EPAM AI/RUN™, respectively. We deliver globally, but engage locally with our expert teams of consultants, architects, designers and engineers, making the future real for our clients, our partners and our people around the world. We believe the right solutions are the ones that improve people’s lives and fuel competitive advantage for our clients across diverse industries. Our thinking comes to life in the experiences, products and platforms we design and bring to market. Added to the S&P 500 and the Forbes Global 2000 in 2021 and recognized by Glassdoor and Newsweek as a Top 100 Best Workplace, our multidisciplinary teams serve customers across six continents. We are proud to be among the top 15 companies in Information Technology Services in the Fortune 1000 and to be recognized as a leader in the IDC MarketScapes for Worldwide Experience Build Services, Worldwide Experience Design Services and Worldwide Software Engineering Services. Learn more at www.epam.com.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

We are looking for a Senior GPU Compute & AI Kernel Engineer to work at the lowest and most performance-critical layer of the AI stack — where compute kernels, accelerator architecture and machine learning workloads meet. This is a hands-on engineering role for a systems-minded C++ practitioner who is fluent in GPU and AI accelerator programming models and who measures success in achieved throughput, latency and memory efficiency rather than in features shipped. The successful candidate will design and optimize high-performance kernels for modern deep learning workloads, collaborate closely with compiler, hardware and ML engineering teams, and contribute to the software stacks that make AI accelerators usable in production. The role suits an engineer who is comfortable moving across the full stack — from framework-level operator implementations down to instruction-level performance analysis on the target hardware. Responsibilities Design, implement and optimize high-performance compute kernels for GPUs and AI accelerators using modern C++ and one or more of CUDA, SYCL, OpenCL, Triton or Apple Metal Profile, analyze and tune parallel algorithms for performance and memory efficiency, identifying and removing bottlenecks across compute, bandwidth and occupancy Accelerate machine learning workloads in PyTorch or TensorFlow, including the implementation of custom operators and kernels for Transformer, LLM and CNN architectures Map deep learning operators onto target accelerator architectures, taking advantage of memory hierarchies, tensor units and vendor-specific execution models Collaborate with compiler engineers on kernel code generation and lowering paths, working with technologies such as LLVM and MLIR Partner with hardware and architecture teams to evaluate performance characteristics of new accelerators and inform hardware/software co-design decisions Establish and maintain performance benchmarking, regression tracking and profiling methodology for kernel and workload performance Debug complex correctness and performance issues spanning framework, runtime, compiler and hardware layers Contribute to accelerator software stacks, runtimes and framework integrations, upstream where applicable Apply and uphold software engineering best practices across Linux development environments — version control, code review, automated testing and CI/CD Document design decisions, optimization techniques and performance findings, and share knowledge across compiler, hardware and ML engineering teams Requirements 5+ years of software development experience with modern C++ (C++17/20 preferred) Strong experience developing high-performance compute kernels Hands-on GPU programming experience with one or more of CUDA, SYCL, OpenCL, Triton or Apple Metal Solid understanding of GPU and AI accelerator architectures Experience optimizing parallel algorithms for performance and memory efficiency Experience developing or optimizing machine learning workloads using PyTorch or TensorFlow Good understanding of modern deep learning architectures, including Transformers, LLMs and CNNs Familiarity with compiler technologies such as LLVM and/or MLIR Knowledge of High Performance Computing (HPC) concepts and performance optimization techniques Experience working with low-level hardware or processor architectures (RISC-V an advantage) Strong debugging, profiling and performance analysis skills Ability to work across the software stack in close collaboration with compiler, hardware and ML engineers Experience with Linux development environments and software engineering best practices (Git, CI/CD, code reviews) Nice to have Experience with AI accelerator software stacks Experience implementing custom ML operators or kernels Knowledge of distributed AI training or inference Experience contributing to compiler, runtime or framework development Background in embedded systems or computer architecture Familiarity with tensor compilers and graph optimization frameworks

Related jobs

See all AI Engineer jobs

Other jobs at EPAM Systems