Logo for ARMRA®

Sr. Director of AI Infrastructure

Roles & Responsibilities

  • 8-12+ years in infrastructure engineering, solutions architecture, or senior technical leadership, with experience building and scaling enterprise-scale integration systems in CPG, consumer brands, or omnichannel retail.
  • Strong hands-on experience with AWS and deploying cloud-native environments for production API services.
  • Deep experience with REST APIs, webhooks, middleware design, and data pipeline architecture across multiple departments.
  • Direct experience deploying and managing production AI systems (LLM API integrations, prompt management, agentic workflows) with governance and security considerations.

Requirements:

  • Own and continuously develop the integration architecture connecting ARMRA's core platforms (e-commerce, retail, marketing, finance, operations) into unified, queryable data flows.
  • Build, maintain, and extend middleware and API integrations enabling AI agents to perform real actions across business functions with safeguards.
  • Architect, deploy, and optimize AWS cloud environments for performance, reliability, cost efficiency, and scalability across the full AI ecosystem.
  • Serve as the primary technical consultant for department heads and executive leadership on AI architecture, investment trade-offs, and long-term capability planning, aligning initiatives with ROI.

Job description

Job Title: Senior Director of AI Infrastructure

Job Type: Full-Time (Remote)

ARMRA Schedule: Monday-Friday, 9 am - 6 pm EST

About ARMRA: ARMRA® was born from a personal health crisis that forced its Founder & CEO, Dr. Sarah Rahal, to uncover what modern life has stolen. As a former pediatric neurologist, she turned to scientific literature and ancient wisdom to find a solution—not just for herself, but for everyone. Your body isn’t broken—it’s brilliantly designed for resilience, recovery, and vitality. But the modern world scrambles the signal, disconnecting you from the intelligence encoded within. ARMRA Colostrum™ is nature’s original blueprint with 400+ bioactive nutrients that help support key aspects of health impacted by modern lifestyles. It works at the cellular level to remind your body of its original code and reawaken its innate intelligence—so you can reclaim your birthright to thrive.

Who We Are

  • Builders, not passengers – We take ownership, create momentum, and move ideas forward.
  • Resilient and resourceful – We find a way forward, even when the answer isn’t obvious.
  • Mission-driven – We care deeply about the impact of our work and the people it serves.
  • Direct and constructive – Clear communication and thoughtful feedback help us improve together.
  • ONE ARMRA – We win as a team. Collaboration and shared success matter more than individual credit.

Who We Are Not

  • Performative – We don’t play games, manipulate optics, or curate an image for external approval.
  • Entitled – Opportunity here comes with accountability and contribution.
  • Clock punchers – We don’t attract those looking for just a "job"; we seek individuals who want to build careers, take ownership, and find joy in their work every day.
  • Divisive – We talk about problems and projects, not people. There’s no “your team” or “my team” - there’s only ARMRA’s team.

The Role: ARMRA is seeking a Sr. Director of AI Infrastructure to own, build, and scale the foundational AI infrastructure across the entire organization. As ARMRA's dedicated AI leader, you will be the single owner of technical standards, governance, and the scalable architecture that connects all of ARMRA's business systems into a unified intelligent automation layer — partnering cross-functionally with the Director of IT as needed to ensure alignment across the broader technology ecosystem.

This is a critical, high-visibility, company-wide role. ARMRA has established a strong foundational infrastructure connecting platforms across customer experience, e-commerce, retail, marketing, finance, and operations. You will inherit that foundation and take full ownership of it — driving improvements, closing gaps, implementing new capabilities, and expanding the infrastructure as the business evolves — while enabling AI agents to take real action on real data in real time.

This role is the definitive bridge between leadership's strategic vision and the enterprise-grade execution required to sustain and advance a company-wide AI backbone. You will own and continuously develop a uniform, resilient, and high-performance AI playbook that serves every function of the business equally — from Retail and Operations to Marketing, Finance, and Customer Experience.

The right person for this role has built, owned, and scaled production integration systems end-to-end. You understand that the best AI architecture is not about training models — it's about connecting systems, enforcing governance, and making intelligent automation reliable enough to trust across every surface of the business. Whether you come in at the Director or Senior Director level, you bring deep technical ownership, sound strategic judgment, and the ability to move with urgency in a fast-paced environment..

Responsibilities:

Integration Architecture & Data Foundations

  • Own and continuously develop the integration architecture connecting ARMRA's core business platforms across e-commerce, retail, marketing, finance, operations, and customer experience into unified, queryable data flows.
  • Build, maintain, and extend middleware and API integrations that enable AI agents to perform real actions across business functions: modifying orders, managing subscriptions, surfacing inventory, pulling financial data, and automating operational workflows — all gated to appropriate system states with hard fail safeguards.
  • Assess, enhance, and expand the existing centralized data architecture to ensure it remains optimized for real-time inference, business intelligence, unified reporting, and AI-driven decision-making as business needs evolve.
  • Establish and enforce enterprise-wide standards for API security, latency, and throughput across all integrated systems.
  • Own pipeline reliability, monitoring, and documentation. When something breaks, you fix it. When something's fragile, you rebuild it.
  • Evaluate and recommend new tools, connectors, and platforms based on API capability, data governance requirements, and integration feasibility.

Cloud Infrastructure & Production AI Systems

  • Architect, deploy, and optimize AWS cloud environments for performance, reliability, cost efficiency, and scalability across the full AI ecosystem.
  • Deploy and manage production AI systems — primarily LLM API integrations, workflow automation, and agentic AI agents — with appropriate monitoring, guardrails, and escalation paths.
  • Build and extend agentic AI systems that execute multi-step tasks autonomously across departments with clear boundaries and human handoff protocols.
  • Own prompt architecture at the infrastructure level: API configuration, system prompt management, version control, and testing frameworks for production AI workflows.
  • Drive optimization of cloud computing resources and API usage across the entire AI ecosystem to ensure cost efficiency, elasticity, and scalability.

Data Governance & Compliance

  • Ensure all AI implementations and data integrations comply with ARMRA's privacy policy, data security SOPs, and regulatory requirements (CCPA/CPRA, GDPR where applicable).
  • Enforce data sovereignty across the enterprise: ARMRA's customer and business data stays on ARMRA's infrastructure. No PII traverses third-party rails without explicit governance approval.
  • Maintain and update the subprocessor inventory as new tools and integrations come online.
  • Partner with Legal and Compliance on AI-specific governance: customer disclosure requirements, model training prohibitions, vendor data protection standards, and PII handling protocols.
  • Own the technical side of data retention enforcement, deletion workflows, and audit trails across integrated systems.
  • Build and evolve the AI governance framework in partnership with Compliance, including approved tool lists, subprocessor documentation, and model training restrictions.

Cross-Functional Technical Leadership

  • Serve as the primary technical consultant for department heads and executive leadership on AI architecture, investment trade-offs, and long-term capability planning.
  • Partner with leaders across all departments — Operations, Marketing, Finance, Retail, and Customer Experience — to identify high-impact automation opportunities and translate business needs into technical requirements.
  • Collaborate closely with the Director of IT to ensure AI infrastructure decisions are aligned with the broader technology ecosystem and organizational standards.
  • Run discovery sessions with stakeholders to map current workflows, quantify manual effort, and prioritize builds based on ROI and feasibility.
  • Build and maintain dashboards and reporting infrastructure that give leadership visibility into AI performance, automation coverage, and operational efficiency gains across the business.
  • Stay current on emerging AI tools, APIs, and integration patterns. Bring recommendations with a plan, not just awareness. If something can make us faster, flag it with a build timeline.

Skills & Qualifications:

  • 8–12+ years in infrastructure engineering, solutions architecture, or a principal/lead technical role, with direct experience building and scaling enterprise-scale integration systems in CPG, consumer brands, or omnichannel retail environments. Candidates with deeper experience will be considered for the Senior Director level.
  • Strong hands-on experience with AWS (required). Experience architecting and managing cloud-native environments for production API services, not just dev/test workloads.
  • Deep experience with REST APIs, webhooks, middleware design, and data pipeline architecture. You've connected messy real-world business systems across multiple departments, not just built demos.
  • Direct experience deploying and managing LLM-powered systems in production (API integrations, prompt management, agentic workflows). You don't need to train models — you need to make them work reliably at scale.
  • Experience building and maintaining business intelligence infrastructure: data warehousing, unified reporting, and cross-departmental analytics.
  • Strong understanding of data governance, privacy compliance (CCPA, GDPR), and security best practices for handling customer PII across integrated systems.
  • Exceptional ability to lead complex technical initiatives with cross-departmental impact, requiring alignment from multiple executive stakeholders.
  • Ability to translate between business stakeholders and technical execution. You can sit in a room with a VP and a developer and make sure both walk out aligned.
  • Strong documentation habits. If you build it, you document it. If you change it, you update the docs.
  • Comfortable working autonomously in a fast-paced, remote environment where priorities shift and you're expected to move without waiting for permission.
  • Bias toward building and shipping over planning and presenting. We need someone who gets things into production, not someone who makes great slide decks about what could be.

Nice to Have: 

  • Hands-on experience with LLM APIs and building agentic AI systems in production.
  • Background in CX platforms, e-commerce infrastructure, or retail technology systems.
  • Experience with containerization (Docker) and orchestration for deploying AI microservices.
  • Familiarity with emerging AI integration standards and protocols.
  • Experience with data warehousing platforms and modern ETL/ELT tools.
  • Prior experience building internal tools or dashboards for non-technical users.

We are proud to be an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, ancestry, sex, religion, gender, gender identity or expression, sexual orientation, marital status, national origin, genetics, disability, age, veteran status or other characteristics.

Related jobs

Other jobs at ARMRA®

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.