DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling (github.com) | HN Screenshots

YHacker Newsscreenshots

Screenshot of github.com: DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

First screen, captured 1 year ago.

Looks similar

Screenshot of github.com: DeepSeek open source DeepEP – library for MoE training and Inference

DeepSeek open source DeepEP – library for MoE training and Inference (github.com)

473 points by helloericsf 1 year ago | 66 comments

GitHub repository for DeepEP, DeepSeek's open-source expert-parallel communication library for Mixture-of-Experts model training and inference.

deepseek mixture-of-experts expert-parallelism gpu-communication

Screenshot of github.com: Fire-Flyer File System from DeepSeek

Fire-Flyer File System from DeepSeek (github.com)

319 points by wenyuanyu 1 year ago | 80 comments

GitHub repository for DeepSeek's 3FS (Fire-Flyer File System), a high-performance distributed file system for AI training and inference workloads.

deepseek 3fs distributed-file-system storage

Screenshot of github.com: LPLB: An early research stage MoE load balancer based on linear programming

LPLB: An early research stage MoE load balancer based on linear programming (github.com)

27 points by simonpure 11 months ago | 0 comments

Screenshot of github.com: Janus: Decoupling Visual Encoding for Multimodal Understanding and Generation

Janus: Decoupling Visual Encoding for Multimodal Understanding and Generation (github.com)

21 points by jinqueeny 2 years ago | 3 comments

Screenshot of github.com: DualPipe: Bidirectional pipeline parallelism algorithm

DualPipe: Bidirectional pipeline parallelism algorithm (github.com)

165 points by mfiguiere 1 year ago | 19 comments

Screenshot of github.com: DeepSeekMath 7B achieved 51.7% on MATH benchmark

DeepSeekMath 7B achieved 51.7% on MATH benchmark (github.com)

90 points by mdp 2 years ago | 34 comments

Related stories

Screenshot of github.com: DeepSeek Open Source FlashMLA – MLA Decoding Kernel for Hopper GPUs

DeepSeek Open Source FlashMLA – MLA Decoding Kernel for Hopper GPUs (github.com)

403 points by helloericsf 1 year ago | 105 comments

GitHub repository for DeepSeek's FlashMLA, an open-source MLA (multi-head latent attention) decoding kernel optimized for NVIDIA Hopper GPUs.

deepseek flashmla multi-head-latent-attention cuda

Screenshot of github.com: DeepSeek-Prover-V2

DeepSeek-Prover-V2 (github.com)

359 points by meetpateltech 1 year ago | 74 comments

GitHub repository for DeepSeek-Prover-V2, DeepSeek's model for formal theorem proving, containing a paper PDF, README, model license, and miniF2F solutions.

deepseek theorem-proving lean-4 llm

Screenshot of github.com: DeepInfer: High-performance inference framework for DeepSeek models

DeepInfer: High-performance inference framework for DeepSeek models (github.com)

2273 points by ggcr 6 days ago | 890 comments

GitHub repository for DeepInfer, DeepSeek's open-source high-performance, large-scale inference framework for DeepSeek models.

deepseek llm-inference inference-framework open-source

Screenshot of github.com: The path to open-sourcing the DeepSeek inference engine

The path to open-sourcing the DeepSeek inference engine (github.com)

531 points by Palmik 1 year ago | 58 comments

GitHub directory in DeepSeek's open-infra-index repo with a README describing their plan for open-sourcing the DeepSeek inference engine.

deepseek llm-inference vllm open-source

Screenshot of github.com: DeepSeek open source DeepEP – library for MoE training and Inference

DeepSeek open source DeepEP – library for MoE training and Inference (github.com)

473 points by helloericsf 1 year ago | 66 comments

GitHub repository for DeepEP, DeepSeek's open-source expert-parallel communication library for Mixture-of-Experts model training and inference.

deepseek mixture-of-experts expert-parallelism gpu-communication

Screenshot of github.com: DeepSeek-R1

DeepSeek-R1 (github.com)

1582 points by meetpateltech 1 year ago | 585 comments

GitHub repository for DeepSeek-R1, DeepSeek's open reasoning language model, with the paper PDF, figures, README, and MIT license.

deepseek-r1 deepseek llm reasoning-models