Logo for Lemurian Labs

Runtime Engineer

Role overview

Summary

The Runtime Engineer role at Lemurian Labs focuses on designing and building a multi-target runtime for the AI compiler stack. This position involves collaboration with compiler and product teams to enhance performance across various hardware targets, contributing to the development of a hardware-agnostic platform.

Qualifications

  • BS degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • 4+ years of experience working with compilers or runtime systems.
  • Deep understanding of asynchronous and concurrent programming.
  • 4+ years of experience with C/C++ (C++14 or newer).
  • Understanding of hardware architecture: vector vs. scalar registers and instructions, memory hierarchies.

Responsibilities

  • Design, develop, maintain, and improve the multi-target runtime.
  • Apply techniques in parallelization and partitioning to automate kernel generation.
  • Benchmark and analyze outputs produced by the optimizing compiler on target hardware.
  • Build tools to collect and analyze performance bottlenecks.

Key facts

Hard skills

Key skills for this role

About the company

Lemurian Labs logo

Lemurian Labs

  • 11–50
AI development is stuck in the past—bloated costs, rigid hardware dependencies, and systems so complex they require a support group to navigate. We think that’s ridiculous. Lemurian Labs is here to change that. Our AI compute platform works across any hardware—no vendor lock-in, no overhyped “breakthroughs” that require a million-dollar budget, just raw performance, and total flexibility. Build, train, and deploy AI wherever you want, without the usual hoops to jump through. We’re engineers, mathematicians, and builders who are done watching AI get buried under unnecessary complexity. Speed and efficiency shouldn’t come at the cost of accessibility. AI should work for you, not force you to play by someone else’s rules. 🔗 www.lemurianlabs.com

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About Us

At Lemurian Labs, we're reimagining the foundations of computing to make AI accessible to everyone. Our mission is to remove the limits of scale, hardware, and cost that hold back innovation, so the people solving humanity's hardest problems can move faster.

We're building a new kind of software stack: a hardware-agnostic platform that makes every system — from a laptop to a supercomputer — feel like one seamless engine. Developers can write once, run anywhere, and get state-of-the-art performance across any chip, any cloud, at any scale. It's a complete rethink of how software and hardware interact — designed for the era beyond Moore's Law.

We're not looking for the comfortable or the conventional; we're looking for the bold. The engineers who crave frontier problems, who want to bend the limits of what's possible, who see infrastructure not as a constraint but as a canvas. If you want to build the foundation for the next era of AI and change what humanity can achieve in the process, join us.

About the Role

We're looking for a Runtime Engineer to design and build the multi-target runtime that sits at the heart of our AI compiler stack. This is a systems-level role where you'll take the output of our optimizing compiler and make it execute — efficiently, correctly, and at scale — across a diverse landscape of hardware targets.

You'll work on low-level parallelization, kernel scheduling, and performance analysis, and collaborate closely with our compiler and product teams to push the boundaries of what's possible on modern AI hardware.

What You'll Do

  • Design, develop, maintain, and improve our multi-target runtime.
  • Apply the latest techniques in parallelization and partitioning to automate kernel generation and exploit highly optimized execution paths.
  • Rapidly prototype and data-drive exploration of new runtime ideas.
  • Benchmark and analyze the outputs produced by our optimizing compiler on target hardware.
  • Build tools to collect and analyze performance bottlenecks.
  • Work closely with our product team to understand the evolving needs of ML engineers and drive improvements in runtime architecture.

Requirements

Essential Skills and Experience

  • BS degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • 4+ years of experience working with compilers or runtime systems.
  • Deep understanding of asynchronous and concurrent programming.
  • 4+ years of experience with C/C++ (C++14 or newer).
  • Understanding of hardware architecture: vector vs. scalar registers and instructions, memory hierarchies.
  • Knowledge of operating system kernel development or hypervisor development.

Preferred Skills and Experience

  • Master's or PhD in Computer Science, Computer Engineering, or equivalent.
  • Experience developing or maintaining GPU compute libraries such as CUDA or ROCm.
  • Experience with GPU programming and optimization.
  • Background in high-performance computing (HPC).
  • Knowledge of deep learning frameworks such as PyTorch, JAX, or Triton.
  • Experience programming large compute clusters.

Why Join Lemurian Labs

  • Build the runtime that makes next-generation AI infrastructure actually go fast.
  • Work across the full stack — from hardware intrinsics to compiler output to distributed execution.
  • Join a team that approaches infrastructure as a canvas, not a constraint.
  • Competitive compensation including equity, medical/dental/vision, retirement savings, and wellness benefits.

Lemurian Labs is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of gender identity, race, ethnicity, sexual orientation, disability status, age, or background.

Compensation depends on experience and geographic location and will be narrowed during the interview process. Additional benefits include equity, company bonus opportunities, medical, dental, and vision coverage, a retirement savings plan, and supplemental wellness benefits.

Related jobs

See all jobs

Other jobs at Lemurian Labs