Ask HN: Resources for GPU Compilers?
61 points by zvikinoza | 17 comments
61 points by zvikinoza | 17 comments
58 points by koch | 39 comments
474 points by superasn | 304 comments
Ask HN thread asking how OpenAI serves ChatGPT to 700M weekly users when a GPT-4-class model is hard to run locally, seeking inference scaling insights.
43 points by vopi | 36 comments
148 points by surrTurr | 129 comments