#model-inference on Hacker News

2 stories tagged model-inference, newest first.

Screenshot of github.com: Show HN: InstinctFlash – Run 5B world-action models in real time on Jetson Thor

Show HN: InstinctFlash – Run 5B world-action models in real time on Jetson Thor (github.com)

17 points by guanming0717 1 month ago | 2 comments

GitHub repository for InstinctFlash, an AGPL-licensed high-performance serving runtime for robotics VLA and world-action models on RTX GPUs and Jetson Thor.

robotics model-inference jetson-thor vision-language-action

OpenLLM (github.com)

562 points by fzliu 3 years ago | 142 comments

GitHub repository for BentoML's OpenLLM, an open platform to fine-tune, serve, deploy, and monitor large language models in production.

llm openllm bentoml model-inference

#model-inference on Hacker News

Show HN: InstinctFlash – Run 5B world-action models in real time on Jetson Thor(github.com)

OpenLLM(github.com)

Show HN: InstinctFlash – Run 5B world-action models in real time on Jetson Thor (github.com)

OpenLLM (github.com)