A Revisit of Transformer

Transformer has achieved state-of-the-art results on many natural language processing tasks. In this work, we revisit Transformer from the following aspects:

• An introduction of Transformer
• A study on IWSLT 2014 German-to-English
• A study on WMT 2014 English-to-French
• A study on WMT 2014 English-to-German

NMT Baselines

We summarize the previous baselines on several benchmark datasets:

• IWSLT2014 German-to-English
• WMT 2014 English-to-French

Support or Contact

This is only a draft and will be kept updating. Use github to track revisions.