DeepInfer: High-performance inference framework for DeepSeek models(github.com)
2273 points by ggcr | 890 comments
GitHub repository for DeepInfer, DeepSeek's open-source high-performance, large-scale inference framework for DeepSeek models.
#inference-framework on Hacker News
1 story tagged inference-framework, newest first.