RAG and agents
Interview question
- seniorlevel
- 15 minsuggested time
- 3Applied AI, ML engineer, Data scientist
A support assistant answers policy questions with retrieval over the policy library. Policies are re-published under the same title, and the index contains the current version and up to two superseded versions of each. In a 500-question audit (hypothetical), 24% of questions are about policies that have three indexed versions. Users complain that answers quote old fees, yet the retrieval hit rate for "any version of the right policy" is 98%. Explain the failure and design the fix and the evaluation.
Sign in to practise: answers are saved before model answers are shown.