OpenLLM(github.com)

562 points by fzliu 3 years ago | 142 comments

GitHub repository for BentoML's OpenLLM, an open platform to fine-tune, serve, deploy, and monitor large language models in production.

Try: run a command and inspect its effects before changing your live system(github.com)

1029 points by espressoRunner 3 years ago | 179 comments

GitHub repository for try, a tool that runs a shell command in an overlay sandbox so its filesystem effects can be inspected before committing them.

Zep: Fast, scalable building blocks for production LLM apps(github.com)

91 points by roseway4 3 years ago | 11 comments

Show HN: Moribito – A TUI for LDAP Viewing/Queries(github.com)

89 points by woumn 1 year ago | 23 comments

Show HN: We've open-sourced our LLM attention visualization library(github.com)

172 points by lakshith-403 2 years ago | 15 comments

Jamesob's guide to running SOTA LLMs locally(github.com)

390 points by livestyle 3 months ago | 175 comments

GitHub repository by jamesob collecting notes, runners, and tools for running state-of-the-art LLMs locally.