The path to ubiquitous AI (17k tokens/sec)(taalas.com)
804 points by sidnarsipur | 436 comments
Taalas blog post by Ljubisa Bajic arguing that latency and cost limit AI adoption and presenting its approach to very fast (17k tokens/sec) inference hardware.