Looks similar
PyTorch-native TPU back end for vLLM(github.com)
4 points by zniturah | 0 comments
GitHub repository for vllm-torchtpu, a PyTorch-native TPU backend for the vLLM LLM inference engine.
4 points by zniturah | 0 comments
GitHub repository for vllm-torchtpu, a PyTorch-native TPU backend for the vLLM LLM inference engine.