Logo for Creative Chaos

Director of Innovation Delivery

Role overview

Summary

This role focuses on building AI-native products by leading cross-functional Innovation Delivery Squads. You will be responsible for scoping, architecting, and delivering outcomes across various platforms while ensuring safe AI operations.

Qualifications

  • 8–12+ years of engineering experience.
  • 4+ years of experience leading multi-team delivery.
  • Experience shipping production web/mobile systems at scale.
  • Experience with at least one production AI app using Claude/GPT/Gemini/Llama/Mistral.
  • Excellent client communication and commercial sense.

Responsibilities

  • Stand up and run squads through the stages of Discovery, Prototype, Product, and Platform & SRE.
  • Design and ship RAG/agent systems by selecting models and defining tools/functions.
  • Operate AI safely by implementing evaluations, guardrails, and structured outputs.
  • Own delivery outcomes including SLOs, quality, cost, and velocity.

Key facts

Hard skills

Key skills for this role

Other skills

  • Problem Solving
  • Coaching

About the company

Creative Chaos logo

Creative Chaos

  • IT Services & Consulting
  • SME
  • 201–500
Creative Chaos is an integrated technology innovation firm that specializes in building MVPs for startups and Fortune 500 companies. Our mission is to help startups and enterprises bring their ideas to life. We believe that innovation can only be delivered through ruthless commitment, grit, and resolve of the team. Our process is driven by a proven MVP Development Framework and powered by passionate people who are committed to delivery and excellence. We specialize in building web applications, mobile apps and IOT solutions. Key Facts: • Established in 2000 • Headquartered in Boston • Global Delivery Network with offices in Europe, Middle East, South East, and Far East Asia • 300+ full-time associates globally • Specialize in product innovation and agile development • 400+ successful projects across multiple industry verticals • Focus on full life-cycle technology implementation and solutions • Diverse technology expertise

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Job Summary:
As a Director of Innovation Delivery you will build AI-native products. You’ll lead cross-functional Innovation Delivery Squads—owning outcomes end-to-end across web, mobile, AI agents, and streaming backends. You’re a hands-on technical leader who can scope, architect, staff, and ship; then run the product safely at scale.

Responsibilities:

  • Stand up and run squads (Discovery → Prototype → Product → Platform & SRE).
  • Design and ship RAG/agent systems: pick models (e.g., Anthropic Claude, OpenAI, Google, or open-weights like Llama/Mistral), define tools/functions, and choose retrieval (default Postgres + pgvector, scale to Weaviate/Qdrant/Pinecone when needed).
  • Operate AI safely: evals & guardrails, structured outputs (JSON/Schema), PII redaction, refusal policies, cost/latency budgets, and LLM observability.
  • Own delivery outcomes: SLOs, quality, cost, velocity; release with feature flags and canaries.
  • Be client-facing: discovery, scoping, SoW, roadmap, QBRs.
  • Hire/coach Tech Leads, EMs, and PMs; level up practices.

Requirements

  • 8–12+ yrs engineering; 4+ yrs leading multi-team delivery; shipped production web/mobile systems at scale.
  • Shipped at least one production AI app using Claude/GPT/Gemini/Llama/Mistral, backed by retrieval (pgvector or a vector DB) and a basic eval/guardrail pipeline.
  • Implemented orchestration (LangGraph/DSPy or Temporal for durable workflows), rerankers (e.g., Cohere/Jina/Voyage), and prompt/tool versioning.
  • Built with modern cloud + data: serverless/K8s, Terraform, OpenTelemetry, feature flags/experimentation.
  • Excellent client communication and commercial sense (SoWs, staffing, utilization).

Tech stack (you have hands on experience)

  • Models: Anthropic Claude; OpenAI; Google; open-weights (Llama, Mistral).
  • Orchestration & agents: LangGraph (or DSPy) for graphs; Temporal for durable, long-running tasks and SLAs.
  • Retrieval: Postgres + pgvector (default); Weaviate/Qdrant/Pinecone when scale/ops require; hybrid search with OpenSearch/Typesense.
  • Embeddings / rerankers: OpenAI/Voyage/E5/BGE; Cohere/Jina/Voyage rerank.
  • Guardrails & evals: JSON/Pydantic schemas, red-team sets, promptfoo/Ragas/DeepEval; content/PII filters.
  • Observability: OpenTelemetry traces incl. prompt/tool spans; Langfuse/Arize Phoenix (or equivalent) + Sentry/Grafana.
  • App & data: Next.js 15 (RSC), TypeScript/Go/Python; Postgres; Kafka/Redpanda/NATS; dbt/lakehouse optional.
  • Ops: Cloud Run/ECS/K8s; Terraform/OpenTofu; GitHub Actions; LaunchDarkly/Unleash; Statsig/GrowthBook.

Related jobs

See all Innovation Director jobs

Other jobs at Creative Chaos