Skip to content
ML Academy

Production and system design

Interview question

  • stafflevel
  • 25 minsuggested time
  • 3ML engineer, Data scientist, Applied AI

Leadership wants ML-backed services to have service-level objectives like the rest of engineering, but a model can be fast and available while giving worse answers. How would you define SLIs, SLOs and error budgets for a model-backed service, and how would they change decisions?

Tests: Reliability engineering applied to ML: quality SLIs under delayed or partial ground truth, error-budget policy, ownership, and avoiding perverse incentives.

day 19day 52day 58

Sign in to practise: answers are saved before model answers are shown.