Skip to content
ML Academy

Introduced on day 52

Retry amplification

The multiplication of attempts when several layers each retry the same failing call, turning a partial outage into a flood of requests.

In detail

If the SDK, the gateway and the job queue each allow three retries, one user request can produce 4 x 4 x 4 = 64 attempts. Measure it as provider calls per user request, give retries a single owner, and use retry budgets so failures cannot become a multiple of normal load.