You could have invented transformers from memory(alexwang.ai)
602 points by speckx | 133 comments
Blog post by Alex Wang explaining transformer layers (MLPs, gated MLPs, self-attention) as associative memory stores, with code and an interactive app.
alexwang.ai on Hacker News
2 stories on the front page, newest first. Scroll down to watch the site change over time.
Put a price on breakthroughs(alexwang.ai)
16 points by ketothekingdom | 5 comments
Essay by Alex Wang arguing for pricing research breakthroughs so frontier AI labs, neolabs, and investors can all benefit.