If you look at the about page, it's running purely on CPU (!).

		gwern on Nov 5, 2019 \| parent \| context \| favorite \| on: OpenAI Releases Largest GPT-2 Text Generation Mode... If you look at the about page, it's running purely on CPU (!).