I think there is a bitter lesson to the bitter lesson.
Sure you can throw more compute at it. But it cost a lot of money and you hit resource limits.
We have been doing an end run around the bitter lesson with prompt engineering. Also by using different models for vision vs. text. By getting (human coding) agents to "think" and run code.
The bitter lesson might be that you cant predict what the thing is that will be most optimal tomorrow and any player in the AI game can be innovated out of existence at any time.
Sure you can throw more compute at it. But it cost a lot of money and you hit resource limits.
We have been doing an end run around the bitter lesson with prompt engineering. Also by using different models for vision vs. text. By getting (human coding) agents to "think" and run code.
The bitter lesson might be that you cant predict what the thing is that will be most optimal tomorrow and any player in the AI game can be innovated out of existence at any time.
Maybe anyone except TMSC.