Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses(quesma.com)271 points by stared 1 month ago | 128 comments
Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs(baseten.co)215 points by philipkiely 1 year ago | 142 comments
GLM-5.2: The Most Powerful Open Model yet and the Brutal Reality of Running It(vettedconsumer.com)32 points by ermantrout 4 months ago | 4 comments
AI paid for by Ads – the GPT-4o mini inflection point(batchmon.com)253 points by thunderbong 2 years ago | 203 comments
RTK reports token savings, but our cost benchmarks disagree(quesma.com)161 points by michalwarda 1 month ago | 80 comments