Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?
474 points by superasn | 304 comments
Ask HN thread asking how OpenAI serves ChatGPT to 700M weekly users when a GPT-4-class model is hard to run locally, seeking inference scaling insights.