Skip to content
ML Academy

Production and system design

Interview question

  • midlevel
  • 10 minsuggested time
  • 2ML engineer, Data scientist

A monitoring job reports a Population Stability Index of 0.066 for the feature days_to_departure and 0.317 for booking_channel_share. The model's score distribution looks unchanged. Compute how a PSI like this is obtained from binned shares, say what you do with each alert, and what PSI cannot tell you.

Tests: Understanding drift metrics (PSI), triage of alerts, and the link between input drift and model performance.

day 19day 18

Sign in to practise: answers are saved before model answers are shown.