It's a pedagogic paper, not scientific paper. People who invent things, and people who teach the things so that they become main stream often are very different kinds of people.

Another take I can recommend is the “Annotated ’Attention is all you need’” which is a collab notebook with relevant code inserted.