Run LLMs at home, BitTorrent‑style(petals.dev)
404 points by udev4096 | 96 comments
Homepage of Petals, a system for running large language models like Llama 2 and BLOOM collaboratively across volunteer machines, BitTorrent-style.
2 stories tagged bloom, newest first.
404 points by udev4096 | 96 comments
Homepage of Petals, a system for running large language models like Llama 2 and BLOOM collaboratively across volunteer machines, BitTorrent-style.
399 points by sirteno | 162 comments
Simon Willison blog post speculating that a GPT-3-class language model could be trained for about $85,000 using LLaMA and Alpaca techniques and run in a browser.