The efficient frontier of LLM inference (baseten.co)

Screenshot of baseten.co: The efficient frontier of LLM inference

First screen, captured 1 month ago.

Looks similar

Screenshot of baseten.co: Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs

Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs (baseten.co)

215 points by philipkiely 1 year ago | 142 comments

Screenshot of bentoml.com: LLM Inference Handbook

LLM Inference Handbook (bentoml.com)

330 points by djhu9 1 year ago | 18 comments

BentoML's LLM Inference in Production handbook, a glossary and guide covering inference concepts, performance metrics, optimization techniques, and operational best practices.

llm-inference bentoml continuous-batching prefix-caching

Screenshot of raspasov.posthaven.com: The AGI Final Frontier: The CLJ-AGI Benchmark

The AGI Final Frontier: The CLJ-AGI Benchmark (raspasov.posthaven.com)

10 points by raspasov 1 year ago | 6 comments

Screenshot of efraingaray.com: TabPFN and TabICL vs. tuned XGBoost: the model that doesn't train won 14/14

TabPFN and TabICL vs. tuned XGBoost: the model that doesn't train won 14/14 (efraingaray.com)

21 points by EfrainGaray 28 days ago | 9 comments

Blog post benchmarking TabPFN and TabICL foundation models against tuned XGBoost on fourteen tabular datasets, finding the no-training models won all fourteen.

tabpfn tabicl xgboost tabular-data