LLMs use a surprisingly simple mechanism to retrieve some stored knowledge(news.mit.edu)
336 points by CharlesW | 121 comments
MIT News article on research showing LLMs often retrieve stored facts via simple linear functions, and a technique to probe what a model knows about subjects.