The universal weight subspace hypothesis(arxiv.org)
344 points by lukeplato | 121 comments
arXiv paper proposing that deep neural networks trained on diverse tasks converge to shared low-dimensional weight subspaces, based on spectral analysis of 1100+ models.