ChatGPT learns what it knows by reading reams of text, aided by statistical cues about how text is structured.
Thanks Abhijit! This is the best explanation for ChatGPT's confabulation I've seen. I played around with the GPT-4 based version, which is better, but still makes things up, especially when I get to the long tail.
Great post! Fun to learn about chatgpt from an old friend! Cheers mate.
Thanks Abhijit! This is the best explanation for ChatGPT's confabulation I've seen. I played around with the GPT-4 based version, which is better, but still makes things up, especially when I get to the long tail.
Great post! Fun to learn about chatgpt from an old friend! Cheers mate.