Compiling models to megakernels(blog.luminal.com)

29 points by jafioti 9 months ago | 15 comments

We gave terabytes of CI logs to an LLM(mendral.com)

198 points by shad42 8 months ago | 98 comments

Zluda 6 release (run unmodified CUDA applications on non-Nvidia GPUs)(vosen.github.io)

139 points by Tiberium 3 months ago | 13 comments

GLM-5.2: The Most Powerful Open Model yet and the Brutal Reality of Running It(vettedconsumer.com)

32 points by ermantrout 4 months ago | 4 comments

We fine-tuned Llama 405B on AMD GPUs(publish.obsidian.md)

452 points by felarof 2 years ago | 87 comments

Felafax blog post describing how they fine-tuned Llama 3.1 405B on 8 AMD MI300X GPUs using JAX, covering parameter sharding and LoRA.

Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025)(aleksagordic.com)

127 points by sebg 2 months ago | 8 comments