Diffusion models explained simply(seangoedecke.com)

123 points by onnnon 1 year ago | 25 comments

SentenceTransformers: Python framework for sentence, text and image embeddings(sbert.net)

162 points by tosh 2 years ago | 48 comments

C++ move semantics from scratch (2022)(cbarrete.com)

73 points by todsacerdoti 11 months ago | 55 comments

Linear transformers are faster after all(manifestai.com)

94 points by JoelEinbinder 2 years ago | 16 comments

Building a Toast Component(emilkowal.ski)

103 points by FragrantRiver 10 months ago | 36 comments

Rust Is Eating JavaScript(leerob.com)

74 points by MrBuddyCasino 1 year ago | 101 comments

Understand how transformers work by demystifying the math behind them(osanseviero.github.io)

408 points by LaserPineapple 2 years ago | 94 comments

A hackerllama blog post walking through an end-to-end worked example of transformer math using small random vectors and matrices.

Deep learning gets the glory, deep fact checking gets ignored(rachel.fast.ai)

549 points by chmaynard 1 year ago | 134 comments

Rachel Thomas blog post on how a high-profile Nature paper using a Transformer to predict enzyme functions contained many errors that received far less attention than the original result.

Show HN: Building a web search engine from scratch with 3B neural embeddings(blog.wilsonl.in)

578 points by wilsonzlin 1 year ago | 97 comments

Wilson Lin's blog post describing how he built a web search engine from scratch in two months using 3 billion neural embeddings.

What are transformer models and how do they work?(txt.cohere.ai)

380 points by tomcam 3 years ago | 91 comments

Cohere blog post explaining what transformer models are and how they work in natural language processing.

LLM from scratch, part 28 – training a base model from scratch on an RTX 3090(gilesthomas.com)

482 points by gpjt 10 months ago | 101 comments

Blog post, part 28 of a series, describing an experiment training a ~163M-parameter base LLM from scratch on a single RTX 3090 at home.

SmolGPT: A minimal PyTorch implementation for training a small LLM from scratch(github.com)

415 points by amrrs 1 year ago | 52 comments

GitHub repository for smolGPT, a minimal PyTorch implementation for training a small GPT-style language model from scratch.