Stochastic Parrots Might Even Be More Linguistically Competent Than ChatGPT
This guy put a prompt into ChatGPT and recorded its output. Then he shuffled the words in the prompt text in such a way that the prompt was completely unintelligible to a human being, but still retained some of the correlational statistics of the words. He fed that as a prompt into ChatGPT. The result? Output that was almost identical to the original output.
Gibberish input into ChatGPT will produce coherent-sounding text just as well as a carefully-crafted prompt. This is such a nice and simple demonstration that ChatGPT has no “intelligence” of any kind built into it.