InferenceX Profit Estimator inferencex.semianalysis.com ↗

A SemiAnalysis tool that estimates profit margins of LLM inference on different GPUs.

ServiceAI & MLinferencegpu-economicsprofitability

Recommended in 1 thread

DeepInfer: High-performance inference framework for DeepSeek models
github.com · 6 days ago
Cited as hard numbers showing inference margins.

Cerebras ↗AI & ML
A hosted fast inference service offering Qwen models.
1 thread
Artificial Analysis ↗AI & ML
A site benchmarking and comparing AI models on quality, price and speed.
0 threads
Liquid AI Decision Models ↗AI & ML
Models from Liquid AI trained specifically to produce decisions with calibrated confidence.
1 thread
scikit-learn ↗AI & ML
A Python machine learning library including probability calibration tools.
1 thread
OpenCode Go ↗AI & ML
A subscription plan for accessing models through the OpenCode coding tool.
2 threads
LIME ↗AI & ML
A technique for locally explaining individual predictions of any classifier.
1 thread
LLM UI Smells ↗AI & ML
A gist listing telltale markers of LLM-generated writing and UI.
1 thread
lean4-mlir ↗AI & ML
A project using Lean 4 to drive PJRT/MLIR for ML workloads.
1 thread

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
7 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
5 threads
llama.cpp
A C/C++ engine for running LLMs locally.
4 threads
GoModel ↗
LLM gateway written in Go, offered as a LiteLLM alternative.
3 threads
DeepSeek
A family of large language models offered via a low-cost API.
2 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
2 threads
Cerebras ↗
A hosted fast inference service offering Qwen models.
1 thread
Claude
Anthropic's AI model and command-line assistant.
1 thread
Claude Code gateways ↗
Documented setup for routing Claude Code through an LLM gateway for centralized control and alternate model providers.
1 thread
Cloudflare Workers AI ↗
Cloudflare's serverless platform for running hosted AI models.
1 thread
CodeCarbon ↗
An open-source Python library for estimating the carbon emissions of compute workloads.
1 thread
Codex
OpenAI's coding agent.
1 thread

Link from a commenter, not checked or endorsed by us: ↗ https://inferencex.semianalysis.com/profit-estimator