anyscale on Hacker News: 1 stories with screenshots

Numbers every LLM developer should know (github.com)

365 points by richardliaw 3 years ago | 86 comments

GitHub repository from the Ray project with a cheatsheet of key numbers (costs, token ratios, GPU memory, latency) every LLM developer should know.