5 stories tagged inference-costs, newest first.
36 points by marinesebastian | 25 comments
Ornn Data research paper arguing that open-weight model demand extends the economic useful life of older NVIDIA GPU families, comparing inference costs to closed models.
401 points by jnord | 292 comments
Blog post by Martin Alderson rebutting a Forbes claim that Anthropic's $200/month Claude Code Max plan consumes $5,000 in compute per user.
472 points by martinald | 438 comments
Blog post by Martin Alderson doing napkin-math estimates of whether OpenAI and Anthropic actually lose money serving LLM inference at scale.
341 points by admp | 230 comments
Substack essay by Ethan Ding arguing that AI token usage costs are rising and cheaper models won't save consumer AI subscription margins, citing Claude Code and Windsurf.
825 points by kcorbitt | 158 comments
Show HN post sharing notebooks and lessons on fine-tuning Llama 2 7B to match GPT-4 on a recipe classification task at far lower cost.