Performance per dollar is getting faster and cheaper(wafer.ai)
345 points by latchkey | 133 comments
Wafer blog post on serving the GLM-5.2 model on AMD MI355X GPUs at 2626 tok/s per node and 213 tok/s single stream, at over 2x lower cost than Nvidia Blackwell.