Logo for Quantiphi

Technical Program Manager

Roles & Responsibilities

  • 10+ years of program or project management experience, including 5+ years leading AI/ML or data-driven initiatives, with a proven track record delivering enterprise-scale AI programs across global teams and strong executive communication
  • Hands-on experience with cloud platforms (GCP, AWS, Azure) for LLM hosting, GPU-based inference, and cost optimization; strong experience with LLM ecosystems (Llama, GPT, Claude, Mistral)
  • Deep expertise in RAG (Retrieval-Augmented Generation) and Agentic AI systems; vector databases (FAISS, Pinecone, Weaviate, ChromaDB); LLM fine-tuning techniques (LoRA, quantization, distillation); Bachelor's degree in Computer Science, Information Technology, or related field; MBA or advanced degree is a strong plus
  • Familiarity with multi-GPU scaling, model optimization, and inference pipelines; frameworks such as LangChain, NVIDIA NeMo, Triton Inference Server; understanding of AI governance, ethics, explainability, and risk mitigation

Requirements:

  • Lead end-to-end execution of large-scale AI/ML programs, delivering production-grade LLM, RAG, and Agentic AI solutions; define roadmaps, PI planning, milestones, and KPIs across multiple workstreams with governance and ROI reporting
  • Align technical delivery with client business objectives and drive the design and implementation of scalable GenAI solutions, including RAG pipelines, multi-agent systems, and agentic workflows; define infrastructure strategies (GPU optimization, hosting, inference pipelines)
  • Guide architectural decisions on model deployment, fine-tuning, and MLOps integration; ensure AI governance, security, responsible AI practices; oversee AI stacks (LangChain, NVIDIA NeMo, Triton Inference Server) and vector databases
  • Serve as primary client contact and build strong executive relationships; drive customer satisfaction, retention, and account growth; lead cross-functional teams of data scientists, ML engineers, software developers, and consultants; mentor and scale global teams

Job description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.


If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on delivering high-impact Services and Solutions that help organizations solve what truly matters. We partner with enterprises to reimagine their businesses through intelligent, scalable, and transformative AI driving measurable outcomes at the very core of their operations.

Since our founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value, not just technology for technology’s sake.

Headquartered in Boston, Quantiphi is a global organization with 4,000+ professionals serving clients across key industry verticals, including BFSI, Healthcare & Life Sciences, CPG, MFG, TME etc. As an Elite and Premier partner to leading cloud and AI platforms such as NVIDIA, Google Cloud, AWS, and Snowflake, we build and deliver enterprise-grade AI services and solutions that create real-world impact. 

We’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years.

  • 3x AWS AI/ML award wins.

  • 3x NVIDIA Partner of the Year titles.

  • 2x Snowflake Partner of the Year awards.

  • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.

  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. 

Your next big opportunity starts here!

For more details, visit: Website or LinkedIn Page.

Experience Level: 10+  years of experience  

Work Location: Rochester, Minnesota  

About the Role:

Quantiphi is seeking a seasoned Technical Program Manager to drive the end-to-end delivery of cutting-edge Generative AI solutions. This role is ideal for a strategic and hands-on leader who can translate business needs into scalable AI architectures, while managing complex, multi-workstream programs across global teams.

You will lead high-impact initiatives focused on LLMs, Retrieval-Augmented Generation (RAG), and Agentic AI systems owning delivery, stakeholder alignment, and measurable business outcomes.

Key Responsibilities:

  • Lead end-to-end execution of large-scale AI/ML programs, ensuring timely delivery of production-grade LLM, RAG, and Agentic AI solutions

  • Define and drive program roadmaps, including PI planning, milestones, KPIs, and deliverables across multiple workstreams

  • Own program governance, risk management, and executive-level reporting on progress, outcomes, and ROI

  • Ensure strong alignment between technical delivery and client business objectives

  • Drive the design and implementation of scalable GenAI solutions, including RAG pipelines, multi-agent systems, and agentic workflows

  • Partner with architects and engineering teams to define infrastructure strategies, including GPU optimization, LLM hosting, and inference pipelines

  • Guide architectural decisions across model deployment, fine-tuning, and MLOps integration

  • Ensure adoption of best practices in AI governance, security, and responsible AI

  • Oversee implementation of modern AI stacks including LangChain, NVIDIA NeMo, and Triton Inference Server

  • Provide direction on vector databases (e.g., FAISS, Pinecone, Weaviate, ChromaDB) and retrieval strategies

  • Guide optimization techniques such as quantization (GPTQ, AWQ), LoRA-based fine-tuning, and multi-GPU scaling

  • Support evaluation frameworks for model performance, accuracy, and efficiency

  • Act as the primary point of contact for client stakeholders, ensuring delivery aligns with contractual expectations and business goals

  • Build strong executive relationships and drive customer satisfaction, retention, and account growth

  • Lead cross-functional collaboration across data scientists, ML engineers, software developers, and consultants

  • Lead, mentor, and scale high-performing global teams

  • Foster a culture of innovation, accountability, and continuous learning

  • Support career development and upskilling of team members in emerging AI technologies

Basic Qualifications:

  • 10+ years of experience in program or project management, with at least 5+ years leading AI/ML or data-driven initiatives

  • Proven track record managing complex, multi-workstream programs with global teams

  • Strong leadership, stakeholder management, and executive communication skills

  • Experience delivering enterprise-scale AI solutions with measurable business impact

  • Hands-on experience with cloud platforms: GCP, AWS, or Azure (LLM hosting, GPU-based inference, cost optimization)

  • Strong experience with LLM ecosystems (e.g., Llama, GPT, Claude, Mistral)

  • Deep expertise in:

    • RAG (Retrieval-Augmented Generation) and Agentic AI systems

    • Vector databases (FAISS, Pinecone, Weaviate, ChromaDB)

    • LLM fine-tuning techniques (LoRA, quantization, distillation)

  • Familiarity with:

    • Multi-GPU scaling, model optimization, and inference pipelines

    • Frameworks such as LangChain, NVIDIA NeMo, Triton Inference Server

  • Understanding of AI governance, ethics, explainability, and risk mitigation frameworks

  • Bachelor’s degree in Computer Science, Information Technology, or related field

  • MBA or advanced degree is a strong plus

What’s in it for YOU at Quantiphi:

  • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.

  • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.

  • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.

  • Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Technical Program Manager Related jobs

Other jobs at Quantiphi

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.