Skip to content
ML Academy

Statistics, experimentation, causal reasoning · insight-1019

Describe a regression discontinuity effect as local to the cutoff and do not extrapolate it to the whole base

Evidence type
practitioner heuristic
Difficulty
medium
Roles
Data scientist, Data analyst
Industries
aviation, banking, retail

Summary: situation, action, reason, boundary

  1. Situation

    The estimate says a status upgrade raises rebooking by 4 points for members near the threshold, and the sponsor wants to upgrade all 200,000 members.

  2. Action

    State the population as the window around the cutoff and the estimand as the effect there. Look for other cutoffs, past rule changes or a small pilot that test elsewhere; treat any extrapolation as an extra assumption backed by its own evidence.

  3. Reason

    The design compares units on both sides of one threshold, so it speaks only to the units whose score sits close to it.

  4. Boundary

    Threshold-based policies and eligibility rules.

Symptom or risk

Members near the threshold are not typical, and the effect for far-below members could be smaller, larger or reversed.

Exceptions

Settings where effects are known to be homogeneous across the score, which needs outside evidence.

Trade-offs

A narrow claim is less exciting but defensible.

Pitfalls

Quoting the local estimate in a business case sized on the full base.

Lessons and concepts