UK remote
AI Quality Lead
About this role
AI Quality Lead | Tripadvisor About Tripadvisor The Tripadvisor Group connects people to experiences worth sharing, and aims to be the world’s most trusted source for travel and experiences. We leverage our brands, technology, and capabilities to connect our global audience with partners through rich content, travel guidance, and two-sided marketplaces for experiences, accommodations, restaurants, and other travel categories.
The subsidiaries of Tripadvisor, Inc. (Nasdaq: TRIP), include a portfolio of travel brands and businesses, including Tripadvisor, Viator, and TheFork. Job Location: Hybrid This role is a hybrid position that requires 1-2 days per week in our London office. What are we looking for? We are seeking a detail-oriented AI QA Lead to monitor, test, and evaluate our AI-driven customer experiences to ensure effortless, accurate, and scalable support for all our customers.
This role focuses on the end-to-end quality of the customer support journey - from Self-Service and AI-Assist through to Human-Assist transitions. Ideal for a hands-on quality specialist with strong process validation experience, this role bridges customer feedback with technical tuning to continuously improve response accuracy, system compliance, and overall resolution quality. Responsibilities: Quality Framework & Testing: Design and execute QA frameworks, test scripts, and evaluation criteria specifically for AI chatbots, automated workflows, and agent copilot tools.
Performance Monitoring: Continuously audit and analyze real-time AI conversations and self-service flows to identify intent misclassifications, hallucinations, inaccurate answers, or broken customer journeys. Closed-Loop Quality Feedback: Identify root causes of AI accuracy failures and customer friction; feed actionable insights directly back to AI Automation Leads, Product, and Engineering teams for sprint training and fine-tuning.
Human-Assist QA Integration: Audit the handover from AI to Human-Assist to ensure context retention, CRM integration accuracy, and seamless agent workflow execution. Benchmarking & Accuracy Scoring: Track and report on key QA metrics, including intent recognition accuracy, resolution precision, containment effectiveness, and compliance standards. Data Validation & Testing: Conduct pre-release user acceptance testing (UAT) and regression testing for all new AI prompt deployments, KB updates, and workflow releases.