Do Machine Learning Models Memorize or Generalize?(pair.withgoogle.com)
395 points by 1wheel | 176 comments
Google PAIR interactive explorable from August 2023 explaining grokking, where models suddenly shift from memorizing training data to generalizing.