DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon(github.com)280 points by colorant 1 year ago | 94 comments
ILGPU: Write GPU programs with C# and F#(github.com)135 points by neonsunset 2 years ago | 18 comments
Show HN: We've open-sourced our LLM attention visualization library(github.com)172 points by lakshith-403 2 years ago | 15 comments
Show HN: Richard – A CNN written in C++ and Vulkan (no ML or math libs)(github.com)166 points by rjinman 2 years ago | 15 comments
Same model, same Q4_K_M label: 5.02, 5.07 and 5.27 bits per weight(github.com)9 points by logickkk1 3 months ago | 2 comments