CosineAnnealingLR in the PyTorch documentation
ID: cosineannealinglr-in-the-pytorch-documentation
Primary implementation documentation: class description, closed-form cosine learning rate schedule,
T_max parameter and explicit note distinguishing the implementation without restarts from SGDR. The example advances the schedule after training and validation. New to topics? Read the docs here!