Accounting AI Analyst | Colombia | Remote

Job Title: Accounting AI Analyst
Schedule: Full-Time, 45 hours/week
Work Days: Monday to Friday
Work Hours: Staggered shifts between 8:00 AM to 8:00 PM EST
Work Setup: Fully Remote

Apply here: https://operationsarmy.com/application

About the Role

Were looking for highly detail-oriented Accounting AI Analyst to support our AI operations team. In this role, you will be responsible for labeling and reviewing AI-generated outputs, identifying inconsistencies, and helping improve overall model performance. This is a great opportunity for candidates with experience in data entry, finance operations, QA, or similar roles, who thrive in a structured, fast-paced, and fully remote environment.

Key Responsibilities

• Label and Tag AI Conversations: Accurately annotate AI agent conversations using internal tools such as LangSmith or other proprietary platforms.
• Review and QA AI Outputs: Analyze and correct AI-generated outputs related to contracts, accounts receivable transactions, reconciliations, and similar data.
• Identify and Escalate Issues: Flag logic errors, inconsistencies, or unclear agent behavior, and escalate them to leads or relevant stakeholders.
• Document and Report Edge Cases: Help document unique cases, recurring patterns, or workflow challenges to support model training and improvements.
• Contribute to Workflow Development: Support the creation of efficient tagging workflows and quality assurance best practices.
• Maintain Quality and Productivity: Meet or exceed daily output goals while ensuring consistent quality, accuracy, and attention to detail.

Qualifications

• 1 to 3 years of experience in data entry, finance operations, customer support, quality assurance, or tagging/labeling roles
• Strong reading comprehension and ability to follow detailed workflows and task instructions
• Good written English communication skills for internal documentation and feedback
• Familiarity with accounting or finance terms (e.g., invoices, cash applications, aging reports) is a plus
• Comfortable using tools such as Airtable, Google Sheets, and AI annotation platforms
• Highly reliable, self-motivated, and organized
• Ability to thrive in a fully remote and fast-paced team environment

Tools & Software

• Airtable
• Google Sheets
• AI Annotation Tools (e.g., LangSmith or similar proprietary platforms)

Apply here: https://operationsarmy.com/application