The thing with training a LLM with basically as much of the internet as you can process, is that it basically becomes a automated "wisdom of the crowds" machine, which isn't all bad, but not all-knowing either.