Senior Product Quality Analyst

POSITION OVERVIEW

The Senior Product Quality Analyst plays a critical role in driving quality for key audio experiences and surfaces within a defined product area. Partnering closely with product, design, data science, engineering, and tech research, this role ensures audio recommendations and discovery features are high-quality, systematic, and culturally aware. By balancing strategic leadership with hands-on evaluation, the Senior Product Quality Analyst directly shapes listener engagement and product direction.

DAY-TO-DAY RESPONSIBILITIES

Define and oversee quality criteria and success measures for targeted audio discovery surfaces and recommendations. Design and execute structured qualitative evaluations across core audio features. Leverage LLMs and AI tools to support quality assessments while maintaining human-in-the-loop oversight. Develop, maintain, and scale reusable evaluation frameworks and guidelines adopted across teams. Collaborate with cross-functional leads to embed quality standards early into product roadmaps and design iterations. Communicate evaluation findings, risks, and trade-offs clearly to influence product decision-making.

TOP 3 REQUIRED SKILLS

• Product Quality & Qualitative Analysis (5+ years)
• Audio Culture & Listener Behavior Expertise (3+ years)
• AI/LLM-Powered Feature Evaluation (2+ years)

ADDITIONAL DESIRED SKILLS

Evaluation Framework & Process Design Cross-Functional Stakeholder Management Product Ops & QA Standards Coaching Data Interpretation & Synthesis

Define and oversee quality standards and success metrics for core discovery surfaces and recommendations. Design and execute structured qualitative evaluations using AI tools and LLMs to support assessments. Develop and maintain reusable evaluation frameworks and guidelines adopted across teams. Communicate qualitative findings, risks, and strategic trade-offs to cross-functional stakeholders.