AI Product Analyst

Office based opportunity I''m working with a business that''s investing heavily in AI and building products used across multiple professional services sectors. What will you actually be doing? Getting under the skin of AI products, analysing user behaviour, output quality, performance trends and areas where things aren''t working as expected. Building dashboards, defining KPIs and using SQL and Python to turn complex datasets into meaningful insights. Working closely with AI engineers and product teams to evaluate LLM outputs, identify regressions and understand whether new features are genuinely improving performance. Developing evaluation datasets and scoring frameworks to measure AI accuracy, reliability and quality. Looking beyond the obvious numbers, whether that''s understanding why certain users abandon tasks, why answers are being regenerated or why performance varies between different types of queries. Presenting your findings directly to senior stakeholders and helping influence product priorities and future investment. What kind of background would work? You could be a Product Analyst, Senior Data Analyst, AI Analyst, Data Science Consultant or someone working in AI evaluation. Interested in people who bring a combination of: Strong SQL and Python skills, with experience independently building analysis and dashboards. Product analytics, including KPIs, experimentation, user behaviour, segmentation or A/B testing. Exposure to AI, machine learning, generative ..... full job details .....