Skip to content
ML Academy

RAG and agents

Interview question

  • midlevel
  • 10 minsuggested time
  • 2Applied AI, Data scientist

For one test question in a RAG system, the retriever returns ten chunks. The chunks that a labeller marked relevant sit at ranks 2, 5 and 9; a fourth relevant chunk exists in the index but was not retrieved. Compute recall@5, precision@5, reciprocal rank and nDCG@10 (binary relevance), and say what each tells you and which one you would track for this system.

Tests: Computing and interpreting retrieval metrics, and linking them to generation quality.

Sign in to practise: answers are saved before model answers are shown.