For future me, I will add:

What Is ChatGPT Doing … and Why Does It Work? by Stephen Wolfram https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...

and one of the discussions of that article on HN: https://news.ycombinator.com/item?id=34796611