Attention Is All You Need by Ashish Vaswani and others

By Ashish Vaswani.

2017 paper; inspected arXiv version 7, 2 August 2023. Sections 5.4.2 and 6.2, Table 3: label smoothing and Transformer component variations on newstest2013. Base epsilon_ls=0.1: wordpiece perplexity 4.92 and BLEU 25.8; epsilon_ls=0.0: 4.67 and 25.3. Model-variation runs use no checkpoint averaging. Byline and contribution note identify Ashish Vaswani; other authors retain the published byline.