Large Language Model Recall Uncertainty is Modulated by the Fan Effect
This provides in-silico evidence linking fan effects and typicality, which is incremental for understanding cognitive modeling in AI.
The paper investigates whether large language models (LLMs) exhibit cognitive fan effects similar to humans, finding that LLM recall uncertainty is influenced by the fan effect, and removing uncertainty disrupts this effect.
This paper evaluates whether large language models (LLMs) exhibit cognitive fan effects, similar to those discovered by Anderson in humans, after being pre-trained on human textual data. We conduct two sets of in-context recall experiments designed to elicit fan effects. Consistent with human results, we find that LLM recall uncertainty, measured via token probability, is influenced by the fan effect. Our results show that removing uncertainty disrupts the observed effect. The experiments suggest the fan effect is consistent whether the fan value is induced in-context or in the pre-training data. Finally, these findings provide in-silico evidence that fan effects and typicality are expressions of the same phenomena.