Logo for Coderio Software Company

Senior IA Engineer

Role overview

Qualifications

  • Senior-level experience (typically 5+ years) delivering and operating production-grade systems in Software Engineering, AI Engineering, or ML Engineering.
  • Advanced hands-on proficiency in Python, RESTful/async APIs, microservices, and cloud services (AWS or GCP).
  • Proven experience building reliable applications using LLMs, RAG pipelines, agent orchestration (e.g., LangGraph, CrewAI), and Model Context Protocol (MCP).
  • Hands-on experience with LLM proxies/gateways, model routing, evaluation harnesses, and AI observability tools (e.g., LangSmith, Datadog, Logfire).

Responsibilities

  • Design, implement, and operate production-grade, reusable AI capabilities and services adopted by multiple engineering and product teams.
  • Build and evolve LLM gateways, proxies, model routing mechanisms, prompt/context strategies, and agentic workflows.
  • Design evaluation frameworks, guardrails, and observability pipelines to measure task success, latency, security, and token costs.
  • Define standards for production AI adoption across the organization, including automated testing, versioning, context segregation, and incident response.

About the company

Coderio Software Company logo

Coderio Software Company

Software Development

Accelerate your digital transformation with our expert nearshore engineering teams. From experienced Software Engineers to augment your tech team, to fully managed expert Development Squads. We design, engineer, and deliver customized technology solutions for companies of every size. We can assemble your enterprise-level dev squad within 7 days. Scale fast with our on-demand timezone-aligned software development talent. Contact us: hello@coderio.com

Company details

IndustrySoftware Development
Company size201-500

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About Us

Coderio designs and delivers scalable digital solutions for global companies. We combine strong technical expertise with a product mindset to lead complex software initiatives end-to-end. We work with international clients, value autonomy and clear communication, and build long-term partnerships through technical excellence.

🌍 More information: http://coderio.com

This is a high-impact technical role. We are looking for a Senior AI Engineer to join our AI Engineering Core initiatives. You will operate at the intersection of backend engineering, cloud platforms, and applied AI, building shared AI foundations that help software developers and product teams adopt Generative AI safely, observably, and efficiently. Your primary mission is to design, build, and operate reusable AI capabilities, LLM gateways, model routing, evaluation frameworks, and guardrails across the organization.

This is a hands-on execution and engineering-driven role. You are responsible for designing, benchmarking, and deploying production-grade AI capabilities and agentic workflows directly into internal platforms and software ecosystems.

What To Expect In This Role (Responsibilities)

  • Shared AI Foundations: Design, implement, and operate production-grade, reusable AI capabilities and services adopted by multiple engineering and product teams.

  • LLM Infrastructure & Gateways: Build and evolve LLM gateways, proxies, model routing mechanisms, prompt/context strategies, and agentic workflows (e.g., LangGraph, PydanticAI, MCP).

  • Evaluations & Observability: Design evaluation frameworks (golden sets, LLM-as-a-judge), guardrails, and observability pipelines to measure task success, latency, security, and token costs.

  • Engineering Standards & Best Practices: Define standards for production AI adoption across the organization, including automated testing, versioning, context segregation, and incident response.

  • End-to-End Delivery: Own delivery end-to-endβ€”from problem framing and architectural design through implementation, deployment, monitoring, and continuous iteration.

  • Automation & DevEx: Identify high-impact opportunities to eliminate repetitive manual work by implementing internal tools, scripts, and intelligent workflows that boost developer velocity.

Requirements

  • Software & AI Engineering Foundation: Senior-level experience (typically 5+ years) delivering and operating production-grade systems in Software Engineering, AI Engineering, or ML Engineering.

  • Development Skills: Advanced hands-on proficiency in Python, RESTful/async APIs, microservices, and cloud services (AWS or GCP).

  • GenAI & Agentic Systems: Proven experience building reliable applications using LLMs, RAG pipelines, agent orchestration (e.g., LangGraph, CrewAI), and Model Context Protocol (MCP).

  • LLM Infrastructure & Evals: Hands-on experience with LLM proxies/gateways, model routing, evaluation harnesses, and AI observability tools (e.g., LangSmith, Datadog, Logfire).

  • Architecture & Trade-offs: Ability to make sound architectural decisions balancing quality, latency, reliability, security, privacy, scalability, and cost.

  • Language & Communication: Advanced English proficiency (mandatory) with clear communication skills to collaborate effectively with cross-functional technical stakeholders.

Nice to Have

  • Experience with container orchestration (Docker, Kubernetes) and Infrastructure-as-Code (Terraform) in cloud environments.

  • Experience building, scaling, or contributing to Internal Developer Platforms (IDP) or developer tooling.

  • Background in prompt engineering optimization, fine-tuning open-source models, or custom vector database indexing.

Benefits

  • High-impact, strategic role driving shared AI foundations and internal developer adoption.

  • Collaborative international environment with senior technical leadership.

  • High autonomy to research, prototype, and implement cutting-edge GenAI workflows.

  • Long-term 100% remote engagement with competitive compensation and growth opportunities.

Why Join Coderio?

At Coderio, we value talent and technical excellence. We are passionate about modern engineering, high autonomy, and building solutions that make a real difference. We offer an inclusive and challenging environment where innovation is encouraged and technical leadership is valued. If you are eager to research and deploy next-generation AI solutions that elevate engineering teams, apply now.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
Β·

Field Engineer (Solutions) Related jobs

Other jobs at Coderio Software Company

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.