Skip to content
ML Academy

Time series and forecasting · insight-0207

Choose expanding or sliding training windows by backtest, not by habit

Evidence type
practitioner heuristic
Difficulty
medium
Roles
Data scientist, ML engineer
Industries
logistics, retail

Summary: situation, action, reason, boundary

  1. Situation

    A logistics volume series changed behaviour after a network redesign two years ago, and the model trains on all history.

  2. Action

    Backtest both an expanding window and two or three sliding window lengths over recent origins, and pick the one with the best and most stable error on the horizons you use.

  3. Reason

    Long windows reduce estimation variance; short windows reduce bias from outdated relationships. Which effect dominates is an empirical question for each series.

  4. Boundary

    Series with suspected drift, regime changes, or long histories.

Symptom or risk

Old regime data pull forecasts toward patterns that no longer exist; a sliding window may track the new level better but is noisier.

Exceptions

Rare seasonal events (annual holidays) need enough years in the window to be learned at all.

Trade-offs

Sliding windows forget useful history; sample weights that decay with age are a middle path.

Pitfalls

Choosing the window on the same final block you report as test accuracy.

Lessons and concepts

Claims and their sources