Key Facts

Remote From:

Anywhere

Full time

Mid-level (2-5 years)

English

Hard Skills

Other Skills

•
Teamwork
•
Communication
•
Problem Solving

Roles & Responsibilities

4+ years of backend engineering experience, with Python as a must
Strong background in distributed systems, job orchestration, and task queues
Hands-on experience with Temporal, Redis, Airflow, Celery, RabbitMQ (or similar)
Familiarity with cloud platforms (AWS/GCP) and infrastructure as code (Terraform)

Requirements:

Design and implement scalable backend architectures for AI workloads (inference, orchestration, monitoring)
Own distributed job orchestration with Temporal and related systems
Build observability, monitoring, retries, and fault tolerance into all workflows
Partner with ML engineers to bring models to production at scale

StackAI

About StackAI

Enterprise AI trusted by IT - power your GenAI strategy with Stack AI. Backed by YC and Google. We are a small dedicated team of insanely talented individuals relentlessly pushing the boundaries of what’s possible with AI. We are pioneering a new horizontal platform allowing anyone to build and deploy AI agents and automations. Companies across industries—including healthcare, legal, financial, logistics, and defense—use StackAI make their organizations faster, more efficient, and scalable, leveraging the power of AI. With strong backing from YC and Google, we're set to double our team size in 2025. This is an exciting time to join if you want to build a category-defining product with strong customer momentum. We're looking for user-centric, craft-focused, creative minds who work hard but don't take themselves too seriously. We're ambitious yet pragmatic. We move fast, but care about the important details. We're hiring for a range of roles. Reach out if you'd like to learn more!

Founded: 2018

Company size: 51 - 200

Website LinkedIn See all jobs →

Job description

About the Role

We’re hiring an AI Infrastructure Engineer to shape and scale the backend systems that power our AI platform. As a Series A company, your work will be foundational, enabling safe, efficient, and reliable AI workflows from end to end.

What You’ll Do

Design and implement scalable backend architectures for AI workloads (inference, orchestration, monitoring).
Own distributed job orchestration with Temporal and related systems.
Improve data pipeline performance by designing smarter caching strategies (e.g., file deduplication, hot/cold storage, Redis caching layers) to reduce redundant compute and API calls.
Build observability, monitoring, retries, and fault tolerance into all workflows.
Manage infrastructure reliability, incident response, and performance.
Develop tooling and platform infrastructure to support rapid growth.
Partner with ML engineers to bring models to production at scale.

What We’re Looking For

4+ years of backend engineering (Python is a must).
Strong background in distributed systems, job orchestration, and task queues.
Deep knowledge of concurrency, parallelism, and multithreading—including async/await, event loops, thread pools, synchronization primitives, deadlocks, and race conditions—is a must. You should know how to design systems that maximize throughput without sacrificing correctness or safety.
Hands-on experience with Temporal, Redis, Airflow, Celery, RabbitMQ (or similar).
Experience with LLM serving and routing fundamentals (rate limiting, streaming, load balancing, budgets).
Comfortable with containers & orchestration: Docker, Kubernetes.
Familiarity with cloud platforms (AWS/GCP) and IaC (Terraform).
Experience with multiple storage systems: S3, Postgres, MongoDB, Redis, and Elasticsearch.
Track record scaling systems in startups or fast-paced environments.
Understanding of deploying, monitoring, and optimizing AI/ML systems in production with strong CI/CD practices.

Why You’ll Love Working Here

Play a foundational role at a fast-growing Series A startup that is shaping the future of AI in enterprise workflows.
Collaborate across Product, ML, and Platform teams, being the bridge between AI logic and scalable execution.
Build infrastructure that enables real value for large enterprises: low-code, secure, and scalable AI workflows.
Join a company that’s scaling thoughtfully and values developer experience.