#fp8 on Hacker News

2 stories tagged fp8, newest first.

Screenshot of github.com: Fp8 runs ~100 tflops faster when the kernel name has "cutlass" in it

Fp8 runs ~100 tflops faster when the kernel name has "cutlass" in it (github.com)

327 points by mmastrac 1 year ago | 143 comments

GitHub pull request in triton-lang/triton rewriting the Gluon attention tutorial kernel to be persistent, noting fp8 runs ~100 TFLOPS faster when the kernel name contains "cutlass".

triton gpu-kernels fp8 cutlass

Screenshot of github.com: DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling (github.com)

381 points by mfiguiere 1 year ago | 65 comments

GitHub repository for DeepSeek's DeepGEMM, a library of clean and efficient FP8 GEMM kernels with fine-grained scaling, released under the MIT license.

deepseek fp8 gemm cuda

#fp8 on Hacker News

Fp8 runs ~100 tflops faster when the kernel name has "cutlass" in it(github.com)

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling(github.com)

Fp8 runs ~100 tflops faster when the kernel name has "cutlass" in it (github.com)

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling (github.com)