Logo for Smart Working

AI Search Analyst (Remote, Full-Time) [HR224] (PK)

Role overview

Summary

The AI Search Analyst role focuses on evaluating AI-powered search performance for a leading UK online electrical retailer. You will collaborate with various teams to develop measurement frameworks and deliver insights that inform business decisions and enhance revenue through AI search initiatives.

Qualifications

  • 3+ years of experience in digital, marketing or ecommerce analytics.
  • Strong Python and SQL skills, including API scripting and automated data collection.
  • Experience with GA4, BigQuery and Looker Studio, or an equivalent analytics stack.
  • Solid understanding of statistics, including sampling, variance, significance and limitations of observational data.
  • Ability to analyse complex, changing datasets and communicate clear, evidence-based insights to senior stakeholders.

Responsibilities

  • Lead end-to-end AI search measurement, competitive benchmarking and performance reporting.
  • Conduct weekly AI visibility benchmarks across various AI platforms.
  • Automate prompt testing, scoring and data collection using LLM APIs.
  • Deliver weekly performance updates, highlighting key findings and actionable recommendations.

Key facts

Hard skills

Key skills for this role

Other skills

  • Microsoft Excel
  • Analytical Skills
  • Verbal Communication Skills

About the company

Smart Working logo

Smart Working

  • Staffing & Recruiting
  • 51–200
Smart Working are specialists in sourcing, vetting and providing best-in-class permanent remote Software Developers. We achieve three main things for our clients: 1 - We attract the very best candidates in the market and find developers with the precise skills our clients require. 2 - For each hire we save our clients 40-50% on an annual basis. 3 - Once onboarded, we set up the remote developer to work as a fully integrated member of our client’s team (working the same hours and in permanent communication). We put vetted candidates in front of our clients at no cost within one week. We are able to attract the best talent at Smart Working because here we put our people first. We are proud to have the highest Glassdoor rating of any business in India with 50+ reviews.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About Smart Working   At Smart Working, we believe your job should not only look right on paper but also feel right every day. This isn’t just another remote opportunity - it’s about finding where you truly belong, no matter where you are. From day one, you’re welcomed into a genuine community that values your growth and well-being.   Our mission is simple: to break down geographic barriers and connect skilled professionals with outstanding global teams and products for full-time, long-term roles. We help you discover meaningful work with teams that invest in your success, where you’re empowered to grow personally and professionally. Join one of the highest-rated workplaces on Glassdoor and experience what it means to thrive in a truly remote-first world.   About the Role

As an AI Search Analyst, you will track and evaluate how a leading UK online electrical retailer performs across AI-powered search platforms, turning insights into meaningful business decisions. As more customers turn to AI assistants for product recommendations, understanding AI visibility and its commercial impact is becoming increasingly important.

You will lead AI search measurement as part of an embedded AEO/GEO programme, collaborating closely with the AEO/GEO Lead, commercial analytics, paid search, trading and senior marketing stakeholders.

You will develop robust measurement frameworks, strengthen attribution and deliver actionable insights that enable senior leaders to assess performance, identify opportunities and understand how AI search contributes to revenue.


Responsibilities
  • Lead end-to-end AI search measurement, competitive benchmarking and performance reporting.
  • Conduct weekly AI visibility benchmarks across ChatGPT, Gemini, Perplexity, Copilot and Google AI experiences, covering large appliances, TVs and audio, mobiles, small appliances and smart home categories.
  • Automate prompt testing, scoring and data collection using LLM APIs and AI visibility platforms.
  • Build and maintain clean, structured and easily accessible datasets.
  • Assess AI-generated responses for citations, product recommendations, ranking positions, sentiment and factual accuracy against competitors.
  • Apply statistical techniques to evaluate data variance, sample sizes, confidence intervals and changes in AI models.
  • Track AI-driven traffic, conversions and revenue through GA4 and BigQuery.
  • Measure the effectiveness of AEO/GEO initiatives and structured data improvements using controlled comparisons where possible.
  • Analyse the relationship between AI search, paid search and organic search performance.
  • Develop and maintain Looker Studio dashboards for marketing and retail stakeholders.
  • Deliver weekly performance updates, highlighting key findings and actionable recommendations.
  • Prepare targeted performance reports for Black Friday and major product launches.
  • Identify and investigate inaccuracies in AI-generated information relating to pricing, delivery, price matching and customer reviews.
  • Work closely with analytics, paid search, trading and marketing teams to turn insights into business actions.

  • Requirements
  • 3+ years of experience in digital, marketing or ecommerce analytics.
  • Strong Python and SQL skills, including API scripting and automated data collection.
  • Experience with GA4, BigQuery and Looker Studio, or an equivalent analytics stack.
  • Confident Excel skills.
  • Solid understanding of statistics, including sampling, variance, significance and limitations of observational data.
  • Experience with, or a clear interest in, LLM APIs and evaluating model outputs.
  • Understanding of SEO or paid search data and its relationship with revenue.
  • Ability to independently build and maintain data pipelines.
  • Ability to analyse complex, changing datasets and communicate clear, evidence-based insights to senior stakeholders.
  • Strong analytical rigour and the ability to explain findings to non-technical audiences.
  • A sceptical, evidence-led mindset with the confidence to challenge weak attribution assumptions.

  • Nice to Have
  • Hands-on experience with AI visibility platforms such as Profound, Peec AI, Ahrefs Brand Radar or Semrush's AI toolkit.
  • Experience with LLM evaluation methods, including automated scoring of model responses.
  • Experience working in retail businesses with significant seasonal demand peaks.
  • Background in consumer electricals or high-consideration retail.
  • Experience with experiment design or causal inference in marketing.
  • Related jobs

    See all jobs

    Other jobs at Smart Working