How to Train a Million Context LLM(latent.space)

9 points by 7d7n 2 years ago | 1 comments

Petaflops to the People: From Personal Compute Cluster to Person of Compute(latent.space)

47 points by tosh 3 years ago | 7 comments

RAG is a hack(latent.space)

36 points by FanaHOVA 3 years ago | 16 comments

The AI Content Flippening(latent.space)

31 points by swyx 3 years ago | 36 comments

The Mathematics of Training LLMs(latent.space)

171 points by FanaHOVA 3 years ago | 58 comments

The state of silicon and the GPU poors(latent.space)

73 points by swyx 2 years ago | 34 comments

Some thoughts on LLMs and software development(martinfowler.com)

378 points by floverfelt 1 year ago | 347 comments

Martin Fowler's blog post sharing scattered thoughts on the state of LLMs and AI and their effect on software development.

Open Source is one person(opensourcesecurity.io)

325 points by LawnGnome 1 year ago | 132 comments

Blog post by Josh Bressers on Open Source Security arguing that many open source projects are maintained by a single person.

LLMs use a surprisingly simple mechanism to retrieve some stored knowledge(news.mit.edu)

336 points by CharlesW 2 years ago | 121 comments

MIT News article on research showing LLMs often retrieve stored facts via simple linear functions, and a technique to probe what a model knows about subjects.

Train Your Own LLM from Scratch(github.com)

376 points by kristianpaul 5 months ago | 43 comments

GitHub repository by angelos-p providing code and docs for training your own large language model from scratch.

CEO fired developers to make room for AI. Developers create open source AI CEO(github.com)

852 points by GrumpySciGuy 2 months ago | 585 comments

GitHub repository for OpenExecutive, an open source AI virtual executive team built from 8 specialist Claude agents using FastAPI and Next.js.

11 of 23 Core Open Source Projects Run on 1 or 2 People(linuxstans.com)

81 points by dxs 17 days ago | 35 comments

Linux Stans news article reporting that 11 of 23 core open source projects are maintained by just one or two people, citing the tz database maintained by Paul Eggert.