The path to open-sourcing the DeepSeek inference engine (github.com)

Screenshot of github.com: The path to open-sourcing the DeepSeek inference engine

First screen, captured 1 year ago.

Looks similar

Screenshot of github.com: DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling (github.com)

381 points by mfiguiere 1 year ago | 65 comments

GitHub repository for DeepSeek's DeepGEMM, a library of clean and efficient FP8 GEMM kernels with fine-grained scaling, released under the MIT license.

deepseek fp8 gemm cuda

Screenshot of github.com: DeepSeek V4 Flash on a Single AMD MI300X

DeepSeek V4 Flash on a Single AMD MI300X (github.com)

366 points by zhoutong 2 months ago | 88 comments

GitHub repository with patches, tuning files, and config for running DeepSeek V4 Flash on a single AMD MI300X GPU.

deepseek amd-mi300x llm-inference gpu

Screenshot of github.com: DeepSeek open source DeepEP – library for MoE training and Inference

DeepSeek open source DeepEP – library for MoE training and Inference (github.com)

473 points by helloericsf 1 year ago | 66 comments

GitHub repository for DeepEP, DeepSeek's open-source expert-parallel communication library for Mixture-of-Experts model training and inference.

deepseek mixture-of-experts expert-parallelism gpu-communication

Screenshot of github.com: DeepSeekMath 7B achieved 51.7% on MATH benchmark

DeepSeekMath 7B achieved 51.7% on MATH benchmark (github.com)

90 points by mdp 2 years ago | 34 comments

Screenshot of github.com: DeepInfer: High-performance inference framework for DeepSeek models

DeepInfer: High-performance inference framework for DeepSeek models (github.com)

2273 points by ggcr 6 days ago | 890 comments

GitHub repository for DeepInfer, DeepSeek's open-source high-performance, large-scale inference framework for DeepSeek models.

deepseek llm-inference inference-framework open-source

Screenshot of github.com: Fire-Flyer File System from DeepSeek

Fire-Flyer File System from DeepSeek (github.com)

319 points by wenyuanyu 1 year ago | 80 comments

GitHub repository for DeepSeek's 3FS (Fire-Flyer File System), a high-performance distributed file system for AI training and inference workloads.

deepseek 3fs distributed-file-system storage

Looks similar

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling (github.com)

DeepSeek V4 Flash on a Single AMD MI300X (github.com)

DeepSeek open source DeepEP – library for MoE training and Inference (github.com)

DeepSeekMath 7B achieved 51.7% on MATH benchmark (github.com)

DeepInfer: High-performance inference framework for DeepSeek models (github.com)

Fire-Flyer File System from DeepSeek (github.com)

Related stories

DeepSeek-Prover-V2 (github.com)

DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days (github.com)

DeepSeek-R1 (github.com)

DeepSeek open source DeepEP – library for MoE training and Inference (github.com)

An intro to DeepSeek's distributed file system (maknee.github.io)

DeepInfer: High-performance inference framework for DeepSeek models (github.com)