Skip to content
ML Academy

Production and system design

Interview question

  • seniorlevel
  • 12 minsuggested time
  • 2ML engineer, Data scientist

A regulator asks your team to explain one specific loan decline from nine months ago: what exactly did the model see, which model version produced the score and why. Nobody can reproduce it. What should the system have recorded, and how would you design reproducibility into a production model?

Tests: Lineage and reproducibility: what to log per prediction, versioning of code, model, features and data, retention cost, and the limits of re-computation.

day 19day 52day 53

Sign in to practise: answers are saved before model answers are shown.