Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?

474 points by superasn 1 year ago | 304 comments

Ask HN thread asking how OpenAI serves ChatGPT to 700M weekly users when a GPT-4-class model is hard to run locally, seeking inference scaling insights.

Ask HN: If we train an LLM with “data” instead of “language” tokens

33 points by albert_e 3 years ago | 36 comments

Ask HN: How do your ML teams version datasets and models?

33 points by skadamat 3 years ago | 13 comments

Maybe we can have a specific tab for submitted contents about GPT and AI

66 points by felipemaciel 3 years ago | 20 comments

Ask HN: What happened to Web3 startups?

40 points by Freddie111 3 years ago | 32 comments

Ask HN: How are people doing AI evals these days?

4 points by yelmahallawy 7 months ago | 2 comments