Logo for BPM LLP

AI Prompt Engineer

Role overview

Qualifications

  • 2+ years building software or AI/LLM components, including hands-on experience crafting and iterating prompts for real applications.
  • Working knowledge of LLM fundamentals: context windows, few-shot prompting, function/tool calling, structured outputs, and RAG basics.
  • Proficiency in Python (or similar) and comfort with APIs, JSON, and version control (Git).

Responsibilities

  • Design, build, test, and iterate on prompts and prompt chains for production LLM workflows across client delivery and internal automation.
  • Implement evaluation harnesses, guardrails, and regression tests so output quality is measurable and stays stable over time.
  • Integrate LLM components with business systems and data — APIs, retrieval/RAG pipelines, and structured outputs.
  • Partner with AI Specialists to convert solution designs into production builds, and document patterns for reuse.

About the company

BPM LLP logo

BPM LLP

Accounting

Hi there, we're BPM! Welcome to our community dedicated to empowering businesses for lasting success. With a global team of over 1000 professionals collaborating across industries and time zones, we aim to uplift individuals for success in both work and life. Recognized as a premier provider of accounting services, we’ve received ClearlyRated's Best of Accounting award eight times and stand out as a top firm for supporting female professionals. When you connect with us, you're not just choosing a financial partner — you're joining a group of advocates who genuinely care about your growth and well-being. At BPM, we prioritize people and believe that together, we can make a meaningful impact. Let's work together to empower your business journey with our professional expertise and genuine support. Learn more at: https://www.bpm.com/

Company details

Company typeLarge
IndustryAccounting
Company size1001 - 5000

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Caravel BPM Technology Solutions – where caring and community is in our company DNA, we are always striving to be our best selves and we’re compelled to ask the questions that lead to innovation. As a Managed Services NetSuite Consultant, you will lead and understand a client’s subscription terminology, gather requirements, configure, test, and walk the client through end-to-end processes and train end users. Industry experience in the software and services verticals are preferred. Our team of consultants is a smart and friendly team who enjoy working together in a collaborative and supportive work environment.
 
Working with Caravel BPM means using your experiences, broadening your skills, and reaching your full potential in work and life—while also making a positive difference for your clients, colleagues, and communities.  Our shared entrepreneurial spirit drives us to see and do things differently.  Our passion for people makes BPM a place where everyone feels welcome, valued, and part of something bigger.  Because People Matter. 
 
BPM India Advisory Service Private Limited - Formerly known as “Burr Pilger Mayer India Private Limited”. (BPM India) is a subsidiary of BPM LLP. Founded in 1986, BPM is one of the largest California-based accounting and consulting firms, ranking in the top 50 in the country. With 17 different office locations, BPM serves emerging and mid-cap businesses as well as high-net-worth individuals in a broad range of industries, including financial services, technology, life science, manufacturing, food, wine and craft brewing, automotive, nonprofits, real estate and construction. The Firm’s International Tax Practice is one of the largest on the West Coast and its well-recognized SEC practice serves approximately 35 public reporting companies, mostly in the technology industry. 

Job Summary:

As an AI Prompt Engineer at Caravel, you'll build the production layer of our AI practice — the prompts, prompt chains, and LLM-driven components that power client solutions and the internal accelerators our consultants rely on. You'll partner with our AI Specialists to turn solution designs into reliable, evaluated, production-ready builds. This is a hands-on build role for someone who cares about getting model behavior right, not just getting it to run.


Key Responsibilities:
  • Design, build, test, and iterate on prompts and prompt chains for production LLM workflows across client delivery and internal automation.
  • Implement evaluation harnesses, guardrails, and regression tests so output quality is measurable and stays stable over time.
  • Integrate LLM components with business systems and data — APIs, retrieval/RAG pipelines, and structured outputs.
  • Partner with AI Specialists to convert solution designs into production builds, and document patterns for reuse.
  • Tune for accuracy, cost, latency, and safety against real evaluation data — not vibes.
  • Grow Caravel's library of reusable AI accelerators.

  • Preferred Qualifications
  • 2+ years building software or AI/LLM components, including hands-on experience crafting and iterating prompts for real applications.
  • Working knowledge of LLM fundamentals: context windows, few-shot prompting, function/tool calling, structured outputs, and RAG basics.
  • Proficiency in Python (or similar) and comfort with APIs, JSON, and version control (Git).
  • A test-and-measure mindset — you evaluate output quality, you don't eyeball it.
  • Clear written English and strong documentation habits.
  • Ability to collaborate across time zones with an onshore/nearshore team.
  • Preferred Skills:

  • Experience with evaluation frameworks (e.g., promptfoo, Ragas, or custom eval harnesses).
  • Familiarity with embeddings, vector databases, and retrieval pipelines.
  • Exposure to ERP/CRM ecosystems (NetSuite, Salesforce) or business-process automation.
  • Experience with agentic frameworks and orchestration.
  •   

    Apply once. Then go straight to the hiring manager.

    After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

    MR

    Marcus Rivera

    Chief Revenue Officer

    m.rivera@company.com
    linkedin.com/in/marcusrivera
    Unlocked after you apply
    ·

    Related jobs

    Other jobs at BPM LLP

    Premium

    Reach out to the hiring manager directly.

    Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

    • Full match report with fit score and gaps
    • Career diagnostics on how recruiters read you
    • Curated company matches and warm intros
    • 48h early access to new roles

    Cancel anytime.