LLMs/Chatbots confabulate statistically probable texts, there’s no compassion possible.
Don’t fall into the AI-marketing trap of “we don’t know what’s happening in the black box, so we have to assume there’s consciousness in there”. The systems produce convincing deceptive language, but all signs of intelligence or compassion anyone sees in them is just an anthropomorphic projection.
The “reasoning” which is displayed, such as step-by-step explanations or chain-of-thought responses, is only a simulation of reasoning, generated as text based on patterns. It’s in the same form of any text production an LLM is capable of. When an LLM mimics “reasoning,” it is generating text that looks like reasoning because it has seen similar patterns in its training data.
LLMs/Chatbots confabulate statistically probable texts, there’s no compassion possible.
Don’t fall into the AI-marketing trap of “we don’t know what’s happening in the black box, so we have to assume there’s consciousness in there”. The systems produce convincing deceptive language, but all signs of intelligence or compassion anyone sees in them is just an anthropomorphic projection.
Anthropic have actually looked at how their LLMs reason. Don’t use them for anything important.
The “reasoning” which is displayed, such as step-by-step explanations or chain-of-thought responses, is only a simulation of reasoning, generated as text based on patterns. It’s in the same form of any text production an LLM is capable of. When an LLM mimics “reasoning,” it is generating text that looks like reasoning because it has seen similar patterns in its training data.