CosineAnnealingLR in the PyTorch documentation

ID: cosineannealinglr-in-the-pytorch-documentation

Primary implementation documentation: class description, closed-form cosine learning rate schedule, T_max parameter and explicit note distinguishing the implementation without restarts from SGDR. The example advances the schedule after training and validation.

New to topics? Read the docs here!