How many GPUs is 1M/B/T tokens?(cedana.com)
14 points by kmavm | 4 comments
Cedana's interactive calculator that converts a token volume and model choice into an estimated number of GPUs (e.g., H100s) needed to serve it.
1 story on the front page, newest first. Scroll down to watch the site change over time.
14 points by kmavm | 4 comments
Cedana's interactive calculator that converts a token volume and model choice into an estimated number of GPUs (e.g., H100s) needed to serve it.