AI Operations Analyst

This is a remote position.

We are seeking an AI Operations Analyst to support the day-to-day operations, monitoring, and performance of AI-driven applications and data platforms. This role focuses on ensuring the accuracy, reliability, and ongoing optimization of AI solutions deployed across AWS, Azure, Tableau, Power BI, and DealCloud CRM integrations.

This position sits at the intersection of production support, data analysis, and AI performance monitoring, making it ideal for someone with a blend of technical troubleshooting and analytical skills.

Key Responsibilities

• Monitor and support AI/ML-driven applications in production environments
  
• Track and analyze AI model performance, identifying issues such as data drift, anomalies, or degradation
  
• Validate data inputs and outputs across data pipelines and reporting tools (Tableau, Power BI)
  
• Investigate and resolve production issues, alerts, and inconsistencies related to AI and data systems
  
• Support data pipelines (ETL/ELT) and ensure data quality across integrated systems
  
• Assist with incident management, root cause analysis, and resolution tracking
  
• Validate integrations across systems including CRM platforms (DealCloud)
  
• Collaborate with data engineers, QA, and AI teams to ensure ongoing model accuracy and system performance
  
• Maintain documentation, runbooks, and operational procedures
  
• Identify opportunities for automation and optimization of AI operations workflows
  

Requirements

Required Qualifications

• 2–5 years of experience in Production Support, Data Analysis, QA, or IT Operations
  
• Strong analytical skills with experience in data validation and troubleshooting
  
• Proficiency in SQL for querying and analyzing data
  
• Familiarity with cloud environments (AWS and/or Azure)
  
• Experience working with or supporting data pipelines and ETL/ELT processes
  
• Experience with monitoring tools or dashboards
  
• Strong problem-solving skills and attention to detail
  

Key Traits for Success

• Strong attention to detail and data accuracy
  
• Curiosity about how AI systems behave and evolve
  
• Ability to analyze issues and identify root causes
  
• Strong collaboration across technical teams
  
• Adaptability in a fast-paced, AI-driven environment