Non-Determinism Doesn't Matter(sklar.rocks)
50 points by sklarsa | 53 comments
A blog post arguing that the non-deterministic output of LLMs is not a real obstacle to using AI as a primary software development tool.
#non-determinism on Hacker News
2 stories tagged non-determinism, newest first.
Non-determinism in GPT-4 is caused by Sparse MoE(152334h.github.io)
360 points by 152334H | 162 comments
Blog post arguing that GPT-4's non-deterministic outputs at temperature zero are caused by its sparse mixture-of-experts architecture and batched routing.