Furiosa: 3.5x efficiency over H100s(furiosa.ai)196 points by written-beyond 9 months ago | 132 comments
Screenshot pending…Compiler optimizations for 5.8ms GPT-OSS-120B inference (not on GPUs)(furiosa.ai)8 points by olibaw 1 year ago | 0 comments