#high-dimensional-geometry on Hacker News

2 stories tagged high-dimensional-geometry, newest first.

Screenshot of nickyoder.com: Language models pack billions of concepts into 12k dimensions

Language models pack billions of concepts into 12k dimensions (nickyoder.com)

336 points by lawrenceyan 1 year ago | 119 comments

A blog post explaining how language models represent vast numbers of concepts in 12,000-dimensional embedding spaces using near-orthogonality and the Johnson-Lindenstrauss lemma.

johnson-lindenstrauss embeddings high-dimensional-geometry language-models

Screenshot of quantamagazine.org: New sphere-packing record stems from an unexpected source

New sphere-packing record stems from an unexpected source (quantamagazine.org)

414 points by pseudolus 1 year ago | 210 comments

Quanta Magazine article on how a newcomer to sphere packing set a new record, solving a major open problem after just a few months of work.

sphere-packing mathematics geometry high-dimensional-geometry

#high-dimensional-geometry on Hacker News

Language models pack billions of concepts into 12k dimensions(nickyoder.com)

New sphere-packing record stems from an unexpected source(quantamagazine.org)

Language models pack billions of concepts into 12k dimensions (nickyoder.com)

New sphere-packing record stems from an unexpected source (quantamagazine.org)