YHacker Newsscreenshots

DeepInfer github.com ↗

DeepSeek's open-source LLM inference engine.

ToolAI & MLinferenceself-hostingllm

Screenshot of github.com, DeepInfer's site

Captured 4 Nov 2026

Recommended in 1 thread

OpenAI seems to be silently re-enabling model training on Codex chats
news.ycombinator.com · 10 days ago
Mentioned as an option for running your own inference.

Similar tools

DeepSeek 4.1 Flash ↗AI & ML
An open-weight language model from DeepSeek.
0 threads
DeepSeek V4 Flash ↗AI & ML
A mixture-of-experts open-weight language model from DeepSeek.
1 thread
DeepSeek V4.1 Flash ↗AI & ML
A low-cost DeepSeek language model available via API.
8 threads
DeepSeek Flash AI & ML
A fast, low-cost open-weight language model from DeepSeek.
2 threads
DeepSeek Harness ↗AI & ML
DeepSeek's coding agent harness.
1 thread
DeepSeek ↗AI & ML
A family of large language models offered via a low-cost API.
12 threads
DeepSeek-v4.1-1017 AI & ML
A DeepSeek large language model release.
0 threads
DeepSeek V4.1 ↗AI & ML
An open-weight large language model family from DeepSeek.
3 threads

Also in AI & ML

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
19 threads
DeepSeek ↗
A family of large language models offered via a low-cost API.
12 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
12 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
11 threads
Qwen ↗
Alibaba's family of open-weight large language models.
9 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
8 threads
Artificial Analysis ↗
A site benchmarking and comparing AI models on quality, price and speed.
7 threads
Claude ↗
Anthropic's AI model and command-line assistant.
7 threads
Qwen 3.8 Flash Next ↗
A Qwen open-weight model that can be run locally.
5 threads
Strata ↗
An open-source project for running large MoE models on small-VRAM GPUs with system RAM.
5 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
4 threads
Pangram ↗
A service that uses a trained model to detect AI-generated text.
4 threads

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/deepseek-ai/DeepInfer