catastrophic-forgetting on Hacker News: 1 stories with screenshots

Screenshot of research.google: Sleep framework: A new way for LLMs to retain knowledge in continual learning

Sleep framework: A new way for LLMs to retain knowledge in continual learning (research.google)

227 points by acossta 16 days ago | 30 comments

Google Research blog post introducing a sleep framework that lets LLMs consolidate short-term context into long-term parameters and self-improve via 'dreaming' during continual learning.

continual-learning llm catastrophic-forgetting mixture-of-experts

#catastrophic-forgetting on Hacker News

Sleep framework: A new way for LLMs to retain knowledge in continual learning(research.google)

Sleep framework: A new way for LLMs to retain knowledge in continual learning (research.google)