Primary author manuscript, version3, revised4January2019. Verified full byline on page1: Ilya Loshchilov and Frank Hutter. Section2, propositions1–2, and AppendixA distinguish SGD coefficient rescaling from inequivalence under adaptive coordinate scaling; Algorithm2 introduces AdamW. The paper's direct shrinkage factor1-lambda and the wiki's explicitly stated PyTorch1-eta*lambda convention must not be silently conflated. Only mathematical mechanisms used; no comparative benchmark claims.

Ancestors (3)

  1. Computer science bibliography
  2. Computer science
  3. Home

Incoming links (6)

View article source

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (0)

There are currently no matching articles.
See all articles in the same topic Create my own version