Would it be possible to make GPT3 from GPT2 just by prompting? It doesn't work/scale
Bit of a straw-man there.