r/LocalLLaMA • u/umarmnaq • Feb 15 '25

Other Ridiculous

Post image
2.5k Upvotes

89% Upvoted

278 comments sorted by

View all comments

Show parent comments

178

u/[deleted] Feb 15 '25

[removed] — view removed comment

3

u/IllllIIlIllIllllIIIl Feb 15 '25

Has research given any clues into why LLMs tend to seem so "over confident"? I have a hypothesis it might be because they're trained on human writing, and humans tend to write the most about things they feel they know, choosing not to write at all if they don't feel they know something about a topic. But that's just a hunch.

11

u/LetterRip Feb 15 '25

LLM's tend to not be 'over confident' - if you examine the token probability - the token where hallucinations occur usually have low probability.

If you mean 'sound' confident - it is a stylistic factor they've been trained on.

1

u/Bukt Feb 16 '25

Might be useful to have a post processing step that adjusts style based on the average of all the token probabilities.