OpenLLM(github.com)
562 points by fzliu | 142 comments
GitHub repository for BentoML's OpenLLM, an open platform to fine-tune, serve, deploy, and monitor large language models in production.
1 story tagged openllm, newest first.
562 points by fzliu | 142 comments
GitHub repository for BentoML's OpenLLM, an open platform to fine-tune, serve, deploy, and monitor large language models in production.