Guide to running Llama 2 locally(replicate.com)
573 points by bfirsh | 153 comments
Replicate blog post explaining how to run Meta's Llama 2 model locally on M1/M2 Macs, Windows, Linux, and phones without an internet connection.
573 points by bfirsh | 153 comments
Replicate blog post explaining how to run Meta's Llama 2 model locally on M1/M2 Macs, Windows, Linux, and phones without an internet connection.
278 points by swyx | 63 comments
482 points by DanRosenwasser | 145 comments
Microsoft blog post introducing TypeChat, an experimental library that uses TypeScript type definitions to get type-safe structured responses from LLMs.