The efficient frontier of LLM inference(baseten.co)137 points by philipkiely 1 month ago | 39 comments
Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs(baseten.co)215 points by philipkiely 1 year ago | 142 comments
A guide to open-source LLM inference and performance(baseten.co)86 points by varunshenoy 2 years ago | 11 comments