How many GPUs is 1M/B/T tokens?(cedana.com)
14 points by kmavm | 4 comments
Cedana's interactive calculator that converts a token volume and model choice into an estimated number of GPUs (e.g., H100s) needed to serve it.
#gpu-capacity-planning on Hacker News
1 story tagged gpu-capacity-planning, newest first.