I feel like the promise of these models is to help people make more informed decisions. Improving the knowledge economy and general understanding.
The problem is these are just statistical models at the end of the day, so you need to know something to be able to identify the errors. You can’t let them really be autonomous and you also can’t really have people turn into glorified approvers. If the machine is correct 89% of the time, you cannot make people responsible for that 11%. It’ll just cause automation fatigue.
tl;dr: the actual use cases of these LLM (or generative AI in general) is rather limited, so it is offensive how much hay has been given to them eating the entire capitalist system. They are not fit for purpose.
Why should we not expect a computer vision model to outperform humans on reading medical images?
The human experts are literally just a trained biological neural network. In this domain they are not capable of anything a computer can't already do.