Oddbean new post about login | logout more powerful models that use multiple times more expensive hardware and much more energy becoming the common standard seems to be the only realistic possibility.
if some company released a model with 10x higher costs per token (due to the sheer hardware requirements for inference) but if it made gpt4 look like gpt2, you bet many people would gladly pay the extra price.