That is it. We cannot concieve it because we are new to it. Just like we would think of Stackoverflow as intelligent if we are fresh off the jungle and are not aware of how Internet works. Because without know that, we cannot conceive how Stackoverflow can produce answers without it "understanding"
You would not know that if you was a cave man. Nor would you understand how a large number of humans are able to come together to answer questions through the Internet..
To you, you type your questions, and answers appear. That would look like how LLMs appear to us now.
That is it. We cannot concieve it because we are new to it. Just like we would think of Stackoverflow as intelligent if we are fresh off the jungle and are not aware of how Internet works. Because without know that, we cannot conceive how Stackoverflow can produce answers without it "understanding"