#generalization on Hacker News

2 stories tagged generalization, newest first.

Screenshot of arxiv.org: Deep Learning Is Not So Mysterious or Different

Deep Learning Is Not So Mysterious or Different (arxiv.org)

445 points by wuubuu 1 year ago | 112 comments

arXiv paper by Andrew Gordon Wilson arguing deep learning generalization phenomena like benign overfitting and double descent are explainable by soft inductive biases.

deep-learning generalization double-descent pac-bayes

Screenshot of pair.withgoogle.com: Do Machine Learning Models Memorize or Generalize?

Do Machine Learning Models Memorize or Generalize?(pair.withgoogle.com)

395 points by 1wheel 3 years ago | 176 comments

Google PAIR interactive explorable from August 2023 explaining grokking, where models suddenly shift from memorizing training data to generalizing.

grokking generalization memorization neural-networks

#generalization on Hacker News

Deep Learning Is Not So Mysterious or Different(arxiv.org)

Do Machine Learning Models Memorize or Generalize?(pair.withgoogle.com)

Deep Learning Is Not So Mysterious or Different (arxiv.org)