Logo for Level AI

Senior Backend Engineer- AI Agents (Remote)

Role overview

Qualifications

  • 5+ years of experience in backend engineering, distributed systems, or platform engineering
  • Strong experience building high-scale, production-grade backend systems
  • Experience designing systems for real-time processing, streaming, or event-driven architectures
  • Strong understanding of API design (REST, gRPC) and microservices architectures

Responsibilities

  • Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
  • Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)
  • Build systems for agent memory, context management, and state persistence across interactions
  • Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services

About the company

Level AI logo

Level AI

Customer Experience & Contact Centers

Our state-of-the-art AI-native solutions are designed to drive efficiency, productivity, scale, and excellence in sales and customer service. With a focus on automation, agent empowerment, customer assistance, and strategic business intelligence, we are dedicated to helping our clients exceed customer expectations and drive profitable business growth. Companies like Affirm, Carta, Vista, Toast, Swiss Re, ezCater, etc. use Level AI to take their business to new heights with less effort.

Company details

Company typeScaleup
IndustryCustomer Experience & Contact Centers
Company size51 - 200

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About Level AI

Level AI is on a mission to turn every customer interaction into a strategic advantage. Our AI-native platform helps enterprises transform contact centers from cost centers into engines of customer intelligence, operational efficiency, and business growth. By combining advanced AI with deep domain understanding of customer experience, Level AI empowers teams to unlock actionable insights, automate workflows, and deliver more consistent, higher-quality support across the customer journey.

Headquartered in Mountain View, California, Level AI is a Series C company backed by leading investors including Battery Ventures and ENIAC. Our platform leverages Large Language Models and Custom Small Language Models (SLMs) to power AI Agents across the entire CX journey—customer-facing agents, agent-assist, and backend automation—along with deep conversation analytics for QA, coaching, and insights.

About the role

As a Senior Engineer – AI Agents, you will play a critical role in building the scalable backend systems that power Level AI’s next-generation AI Agents. These systems operate in real-time, high-volume enterprise environments and are central to delivering intelligent, production-grade AI experiences.

You will work at the intersection of distributed systems, cloud infrastructure, and AI-powered applications—bringing agentic AI capabilities into production at scale.


What you’ll get to do at Level AI (and more as we grow together):
  • Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
  • Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)

  • Build systems for agent memory, context management, and state persistence across interactions

  • Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services

  • Implement evaluation (evals) frameworks to measure agent performance, accuracy, and reliability

  • Enable continuous improvement loops (feedback → retraining → deployment) for AI agents in production

  • Design and manage event-driven, asynchronous workflows for complex agent tasks

  • Optimize systems for high throughput, low latency, and cost-efficient inference at scale

  • Build and maintain robust APIs and service layers (REST / gRPC) for agent capabilities

  • Partner closely with Applied AI / ML teams to productionize models and agent behaviours.

  • Collaborate with Product and Solutions teams to translate real customer workflows into agentic systems

  • Drive best practices in observability, monitoring, safety, and guardrails for AI systems

  • Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms

  •  

     


    We'll love to explore more about you if you have:
                           
  •  5+ years of experience in backend engineering, distributed systems, or platform engineering
  • Strong experience building high-scale, production-grade backend systems
  • Experience designing systems for real-time processing, streaming, or event-driven architectures
  • Strong understanding of API design (REST, gRPC) and microservices architectures
  • Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
  • Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
  • Strong fundamentals in system design, concurrency, and performance optimization

    Strong Plus (Agent / AI focus):

  • Experience working with LLMs, conversational AI, or AI-powered products in production
  • Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
  • Experience building or integrating RAG pipelines, vector databases, or retrieval systems
  • Exposure to evaluation systems (offline/online evals, A/B testing for AI systems)
  • Understanding of prompting strategies, context windows, and model behavior optimization
  • Experience with real-time decisioning systems or workflow orchestration engines
  • Perks & Benefits

    • Competitive compensation with performance-based upside

    • Flexible vacation policy

    • Health insurance coverage

    • Work with a globally distributed, high-impact team

    • Opportunity to build cutting-edge AI products at scale

    • Regular team offsites and in-person collaboration 

    To learn more visit : https://thelevel.ai/

    Apply once. Then go straight to the hiring manager.

    After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

    MR

    Marcus Rivera

    Chief Revenue Officer

    m.rivera@company.com
    linkedin.com/in/marcusrivera
    Unlocked after you apply
    ·

    Back-End Engineer Related jobs

    Other jobs at Level AI

    Premium

    Reach out to the hiring manager directly.

    Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

    • Full match report with fit score and gaps
    • Career diagnostics on how recruiters read you
    • Curated company matches and warm intros
    • 48h early access to new roles

    Cancel anytime.