Logo for Parallel Partners

AI Backend Engineer, Work From Home

Role overview

Qualifications

  • Strong backend engineering experience in production systems.
  • Experience building or operating high-throughput, low-latency services.
  • Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows).
  • Experience with distributed systems and production debugging.

Responsibilities

  • Build and operate backend systems that serve AI-powered insurance workflows in production.
  • Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.
  • Build inference pipelines for LLM-based and AI-assisted automation systems.
  • Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing).

Key facts

  • Remote from: California (USA)
  • Full time
  • Senior (5-10 years)
  • AI Operations (AI Ops) Engineer
  • English

Hard skills

Other skills

  • Distributed Team Management

About the company

Parallel Partners logo

Parallel Partners

Staffing & Recruiting

Parallel Partners / Next Step Systems specializes in the recruitment of information technology personnel for direct hire positions in the financial services and trading industries. Our clients include International Hedge Funds, Proprietary Trading Firms, Investment Banks, On-line Brokerages, Market Data Providers, Start-up Trading Firms, Trading Software Product Vendors and many others. Established in 1995, Parallel Partners is headquartered in Chicago and handles searches nationwide. We work with the Fortune 500 as well as emerging technology firms. 90% of our business is repeat business. Next Step Systems Acquires Parallel Partners Naperville, IL - April 9, 2014 - Next Step Systems announced today that it has acquired information technology staffing specialists, Parallel Partners in order to better serve its company clients and job seeker candidates. Founded in 1995, Parallel Partners is a leading staffing firm successfully placing information technology professionals in full time permanent positions. Prior to the acquisition, Next Step Systems and Parallel Partners have had a long-term strategic partnership and have shared philosophies on recruiting practices. The acquisition will expand on Next Step Systems’ leadership in information technology recruiting, its key employee, candidate and client base, and its well-established technology resources. About Next Step Systems Next Step Systems is an information technology recruiting firm founded in 1995. Next Step Systems specializes in placing all levels of information technology talent in full time permanent positions across all industries throughout the U.S. To reach Parallel Partners, please email jobs@parallelpartners.com or call 630-428-0600 x14.

Company details

IndustryStaffing & Recruiting
Company size2 - 10

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Job Description

AI Backend Engineer, Work From Home

We are looking for talented AI Backend Engineers to build systems that power AI-driven decisioning, automation, and orchestration across our platform.  This role sits at the core of our AI stack, between models, backend systems, and real users, where latency, correctness, reliability, and cost directly impact production experience.  This is a fully remote position where you will be part of a global engineering team working across multiple countries to build reliable, scalable AI systems.  We have multiple openings for this position.  This position is 100% Remote.

AI Backend Engineer Responsibilities:

- Build and operate backend systems that serve AI-powered insurance workflows in production.

- Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.

- Build inference pipelines for LLM-based and AI-assisted automation systems.

- Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing).

- Design stable service boundaries between backend systems, ML components, and product APIs.

- Implement observability: logging, metrics, tracing, alerting, and incident response workflows.

- Debug production issues across distributed AI systems and resolve root causes.

- Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features.

- Continuously improve system reliability, scalability, and performance.

AI Backend Engineer Outcomes:

- AI backend systems run reliably at scale with low latency and high availability.

- AI workflows are stable, observable, and production-ready across multiple products.

- System performance improves continuously through real-world feedback and optimization.

- Production incidents are quickly detected, diagnosed, and resolved.

- AI capabilities are seamlessly integrated into global customer and internal workflows.

Qualifications

AI Backend Engineer Qualifications:

- Strong backend engineering experience in production systems.

- Experience building or operating high-throughput, low-latency services.

- Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows).

- Experience with distributed systems and production debugging.

- Strong understanding of APIs, data flows, and system design principles.

- Experience with observability tools (logging, monitoring, tracing).

- Strong ownership mindset and bias toward shipping.

- Comfortable working in fast-paced, globally distributed teams.

- Tech Stack:  Anthropic, Artificial Intelligence (AI), Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL.

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

Keywords:  San Francisco CA Jobs, AI Backend Engineer, AI, Anthropic, Artificial Intelligence, Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Low Latency, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL, Software Engineer, Software Developer, Programming, Programmer Analyst, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting

Looking to hire an AI Backend Engineer in San Francisco, CA or in other cities?  Our IT recruiting agencies and staffing companies can help.

We help companies that are looking to hire AI Backend Engineers for jobs in San Francisco, California and in other cities too.  Please contact our IT recruiting agencies and IT staffing companies today!

Additional Information

All your information will be kept confidential according to EEO guidelines.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

AI Operations (AI Ops) Engineer Related jobs

Other jobs at Parallel Partners

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.