evanmiller.org on Hacker News

Functional Tests as a Tree of Continuations (2010)(evanmiller.org)

60 points by amenghra 1 year ago | 27 comments

Statistical Formulas for Programmers (2013)(evanmiller.org)

219 points by Tomte 1 year ago | 37 comments

How not to sort by average rating (2009)(evanmiller.org)

41 points by notracks 2 years ago | 11 comments

Attention Is Off By One(evanmiller.org)

959 points by elbasti 3 years ago | 307 comments

Evan Miller's blog post arguing that the softmax in the transformer attention formula has an off-by-one flaw and proposing a modified softmax.