Skip to content
ML Academy

Statistics

Interview question

  • seniorlevel
  • 12 minsuggested time
  • 2Data scientist, Data analyst

An experiment's primary metric was flat. A stakeholder asks for a breakdown by 40 customer segments and finds four segments with p-values 0.004, 0.019, 0.038 and 0.047 (hypothetical; the other 36 are above 0.05). They want to ship the feature to those four segments. How do you respond, and how would you control for multiple comparisons?

Tests: Multiple comparisons in subgroup analysis, Bonferroni and Benjamini-Hochberg control, expected false positives and exploratory vs confirmatory analysis.

day 4day 5

Sign in to practise: answers are saved before model answers are shown.