The Human Blind Spot Around Non-Deterministic Machines
Why LLM’s will always make mistakes and we shouldn’t call them hallucinations I saw a tweet from Paul Graham a while back about how as LLMs become better their hallucinations will become more convincing. And it makes sense, a smart confident person saying something wrong often sounds more reliable than a less confident person saying the right thing timidly. Even more so, as you get good answers from the smart confident person you become more trustworthy and are less likely to question and double-check their future answers. That’s both a reality of and defect of human thinking. ...