Skip to content
ML Academy

Statistics, experimentation, causal reasoning · insight-1026

Check residual autocorrelation in an interrupted time series and widen the intervals if it is there

Evidence type
documented fact
Difficulty
medium
Roles
Data scientist, Data analyst
Industries
aviation, public-sector, healthcare

Summary: situation, action, reason, boundary

  1. Situation

    A weekly interrupted time series after a schedule change gives a narrow, significant level shift from an ordinary least squares fit.

  2. Action

    Plot and test the model residuals for autocorrelation. If present, use standard errors robust to it (Newey-West type) or model the serial correlation explicitly, and re-read the level change against the wider interval.

  3. Reason

    Least squares assumes independent errors; positive serial correlation shrinks apparent uncertainty and inflates significance.

  4. Boundary

    Single-series before-and-after evaluations with weekly or daily data.

Symptom or risk

Successive weeks are correlated, so ordinary standard errors are too small and a modest shift looks decisive.

Exceptions

Residuals that look like white noise after seasonal and trend terms.

Trade-offs

Wider intervals make weak effects non-significant; that is the honest answer.

Pitfalls

Fixing autocorrelation by adding many lags that absorb the intervention effect.

Lessons and concepts

Claims and their sources