Skip to content
ML Academy

DL, NLP and LLMs

Interview question

  • stafflevel
  • 25 minsuggested time
  • 3Applied AI, ML engineer, Data scientist

Your company is launching LLM-generated summaries of customer-service conversations for supervisors across four languages. Design the evaluation strategy that decides launch, catches regressions when prompts or models change, and remains trustworthy over time.

Tests: LLM evaluation design: task-specific criteria, human and model-based judging, judge validation, contamination, versioned evaluation sets, regression gates and online monitoring.

day 42day 43day 45day 51day 52

Sign in to practise: answers are saved before model answers are shown.