Interactive figure
Parameters, gradients, optimizer states and activations dominate memory (approximate).