img
Permanent

Senior QAT (Quality Assurance Tester)

City
money-bag 65000.00-65000.00 Annual
3196694076
Posted Today

Senior QAT (Quality Assurance Tester) Generative AI/RAG Platform (UK Public Sector) Salary: £65''000 per annum Location: Newcastle, one day a week in the office Security clearance: SC eligible, no SC needed Overview We are seeking an experienced Senior Quality Assurance Tester to lead testing strategy and execution for a Generative AI platform for a UK government department. This role goes beyond traditional functional QA. It includes evaluating AI output quality (answer accuracy, retrieval relevance, hallucination rate) alongside conventional API, integration and non-functional testing. Key Responsibilities Test Strategy andamp; Planning Define and own the test strategy across functional, non-functional and AI-specific quality dimensions (answer quality, retrieval accuracy, hallucination rate), covering RAG pipelines, prompt templates and agentic workflows. AI Output Evaluation Design and run structured evaluations of LLM outputs, working with engineering to track answer quality and hallucination rate over time, and flag regressions before release. API andamp; Integration Testing Carry out manual and automated API testing (for example with REST Assured or similar tools) across the application logic that connects RAG pipelines to Legacy and multi-cloud systems. Automation andamp; CI/CD Integration Build and maintain automated test suites integrated into CI/CD pipelines (for example GitLab or Jenkins), enabling shift-left testing across the ..... full job details .....

Perform a fresh search...

  • Create your ideal job search criteria by
    completing our quick and simple form and
    receive daily job alerts tailored to you!

Jobs. Straight to your inbox!