Logo for Otter.ai

Senior Software Engineer, AI Agent & LLM

Role overview

Qualifications

  • Masters degree in Computer Science or a relevant field, PhD a plus
  • 5+ years of experience in search, recommendation or question answering systems
  • In-depth knowledge of relevance measurement, tuning, and modeling
  • Engineering experience with large language models and RAG systems

Responsibilities

  • Design, develop, and oversee our enterprise search infrastructure
  • Understand the user's information needs by developing deep learning-based NLP algorithms
  • Design, implement, and deploy various ranking algorithms
  • Constantly track and analyze end-to-end system performance

About the company

Otter.ai logo

Otter.ai

AI-powered note-taking and chat app that lets you remember search, and share your voice conversations. Use OtterPilot to join meetings, write notes and summarize the discussion automatically. Otter AI Chat is collaborative AI intelligence that acts as a meeting participant, instantly answering questions, collaborating with meeting participants, and generating content based on meeting data. Teams can collaborate using Otter AI Chat to message each other and Otter, bringing the smart AI assistant into the meeting discussion.

Company details

Company typeScaleup
Company size51 - 200

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

The Opportunity

We're excited to welcome a talented and passionate Senior Software Engineer to join our highly skilled team. The ideal candidate will hold a deep comprehension of search and recommendations algorithms and infrastructure, including retrieval augmented generation (RAG), semantic search using embeddings, text indexing and retrieval, query understanding, various ranking algorithms etc.. In your crucial role, you'll be responsible for managing every aspect of our sophisticated enterprise search system, spearheading the design, development, and optimization of search system accuracy and performance.

Your Impact

  • Design, develop, and oversee our enterprise search infrastructure, employing a mix of vector databases, full-text search engine, and relational database techniques.
  • Understand the user's information needs by developing deep learning-based NLP algorithms to analyze, reformulate and suggest search queries effectively.
  • Design, implement, and deploy various ranking algorithms to deliver the most relevant results with the best user experience.
  • Evaluate and optimize algorithm accuracy by focusing on key metrics..
  • Constantly track and analyze end-to-end system performance, leading improvement initiatives as required.
  • Stay informed about the latest industry developments and emerging technologies, aligning our search system with, or advancing it beyond, the industry benchmarks.

We're looking for someone who

  • Holds a Masters degree in Computer Science, or a relevant field, PhD a plus.
  • 5+ years of experience in search, recommendation or question answering systems.
  • In-depth knowledge of relevance measurement, tuning, and modeling.
  • Engineering experience with large language models and RAG systems.
  • Expertise in Python and/or C++.
  • Exceptional problem-solving capabilities coupled with meticulous attention to detail.
  • Outstanding communication skills to explain complex concepts convincingly to non-technical team members.
  • Abilities to contribute individually while functioning effectively as part of a team.
  • Familiarity with embedding-based search systems will be considered a major advantage.

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world’s leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace.  We provide reasonable accommodations for qualified applicants throughout the hiring process. 

Accessibility & Accommodations 

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process.  If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary range

Salary Range: $185,000 to $230,000 USD per year

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.
#LI-Remote

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
Β·

Software Engineer Related jobs

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.