I think what is more likely to happen is that how 'transformers' work may change. Or a new way of working might be introduced.

Transformer models are already reaching peak of their capabilities vs the cost to run them. All I see currently is basically the 'burn' phase, which is important to get to the 'sustain' phase.

With new stuff coming literally every week, I believe it is not a long time till either transformers get replaced, or some new version of them is introduced which is far more efficient.