Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system(tomshardware.com)
501 points by hd4 | 286 comments
News article reporting Alibaba Cloud's Aegaeon GPU pooling system, which it says cut Nvidia GPU use by 82% when serving dozens of large language models.