Can LLMs learn from a single example?(fast.ai)
387 points by jdkee | 117 comments
A fast.ai blog post by Jeremy Howard and Jonathan Whitaker on unusual fine-tuning loss curves suggesting LLMs can memorize examples after seeing them once.
1 story tagged training-loss, newest first.
387 points by jdkee | 117 comments
A fast.ai blog post by Jeremy Howard and Jonathan Whitaker on unusual fine-tuning loss curves suggesting LLMs can memorize examples after seeing them once.