AI Evaluation Engineer

AI Evaluation EngineerRate / Duration / Location 700- 750/day Inside IR35 Duration: 4 months Clearance: BPSS + SC eligible Location: London, Bristol or Manchester Hybrid: 2 days onsite per week.OverviewWe''re looking for an experienced AI Evaluation Engineer to join a specialist Public Sector Technology team. This hands-on role focuses on building evaluation frameworks, tooling and harnesses for AI systems, particularly LLM and agentic AI solutions. The role requires ownership, experimentation and rapid delivery.Key ResponsibilitiesDesign evaluation frameworks and toolingDevelop evaluation harnessesEvaluate model and agentic AI systemsDefine metrics and methodologiesBuild repeatable evaluation processesInvestigate AI failuresWork directly with government teamsPrototype and test solutionsPresent findings and recommendationsContribute to strategic direction.What We Are Looking ForStrong software engineering experienceExperience building and evaluating AI systemsUnderstanding of LLMs and agentic AIExperience with AI evaluation frameworksAbility to code independentlyStrong problem-solving and communication skillsComfortable working autonomously.Technical ExperienceAI/LLM Evaluation, RAG Evaluation, Ragas, Agentic AI Evaluation, Evaluation Harnesses, LLM Testing and Benchmarking, Prompt Engineering, Python Development, Model and Agent Integration.Ideal BackgroundAI Evaluation Engineer, Applied AI Engineer, AI Engineer, LLM Engineer, Harness Engineer, Prompt Engineer or Software ..... full job details .....