PyTorch-native TPU back end for vLLM(github.com)
4 points by zniturah | 0 comments
GitHub repository for vllm-torchtpu, a PyTorch-native TPU backend for the vLLM LLM inference engine.
4 points by zniturah | 0 comments
GitHub repository for vllm-torchtpu, a PyTorch-native TPU backend for the vLLM LLM inference engine.
748 points by mrmagoo2 | 97 comments
GitHub repository for OpenAPI DevTools, a Chrome extension that generates OpenAPI specifications in real time from observed network traffic of any website.