8 stories tagged ai-inference, newest first.
804 points by sidnarsipur | 436 comments
Taalas blog post by Ljubisa Bajic arguing that latency and cost limit AI adoption and presenting its approach to very fast (17k tokens/sec) inference hardware.
613 points by nickrubin | 349 comments
CNBC exclusive reporting that Nvidia is acquiring AI chip startup Groq for about $20 billion, its largest acquisition on record.
375 points by vegasbrianc | 278 comments
A Substack deep dive from UncoverAlpha on Google's TPU chips, covering their technical design, strategic position versus GPUs, and financial implications for AI inference.
409 points by adam_gyroscope | 91 comments
GitHub repository for OpenPCC, an Apache-2.0 open-source framework for provably private AI inference modeled on Apple's Private Cloud Compute.
406 points by speckx | 297 comments
Jeff Geerling blog post reviewing a $3000 Raspberry Pi cluster built for AI workloads and explaining why he regrets building it.
432 points by meetpateltech | 159 comments
Google blog post announcing Ironwood, its seventh-generation TPU designed for large-scale AI inference workloads.
834 points by mxstbr | 529 comments
Fly.io blog post reflecting on how the company's bet on offering GPU machines to developers did not pan out as expected.
552 points by andes314 | 196 comments
Fly.io blog post announcing that GPU machines are now available on its cloud platform.