Tokasaurus: An LLM inference engine for high-throughput workloads (scalingintelligence.stanford.edu) | HN Screenshots

YHacker Newsscreenshots

Screenshot of scalingintelligence.stanford.edu: Tokasaurus: An LLM inference engine for high-throughput workloads

First screen, captured 1 year ago.

Looks similar

Screenshot of gwern.net: Lean Software Scaling Laws

Lean Software Scaling Laws (gwern.net)

11 points by gmays 3 months ago | 0 comments

Screenshot of johnnysswlab.com: Decreasing the number of memory accesses

Decreasing the number of memory accesses (johnnysswlab.com)

73 points by g0xA52A2A 3 years ago | 43 comments

Screenshot of johnnysswlab.com: Horrible Code, Clean Performance

Horrible Code, Clean Performance (johnnysswlab.com)

112 points by signa11 3 years ago | 89 comments

Screenshot of lilianweng.github.io: Scaling Laws, Carefully

Scaling Laws, Carefully (lilianweng.github.io)

63 points by tehnub 4 months ago | 16 comments

Screenshot of blog.kierangill.xyz: Scaling LLMs to Larger Codebases

Scaling LLMs to Larger Codebases (blog.kierangill.xyz)

284 points by kierangill 10 months ago | 114 comments

Screenshot of johnnysswlab.com: An optimizing compiler doesn't help much with long instruction dependencies

An optimizing compiler doesn't help much with long instruction dependencies (johnnysswlab.com)

25 points by ingve 1 year ago | 4 comments