Automatic Mixed Precision examples in the PyTorch documentation
= Automatic Mixed Precision examples in the PyTorch documentation
{c}
https://docs.pytorch.org/docs/2.15/notes/amp_examples.html#gradient-accumulation
Pinned PyTorch2.15, Gradient accumulation subsection and example loop. Effective batch size and delayed optimizer step; normalization in the illustrated loop. Used only for gradient accumulation; no new mixed-precision article authored.