Non-determinism in GPT-4 is caused by Sparse MoE(152334h.github.io)
360 points by 152334H | 162 comments
Blog post arguing that GPT-4's non-deterministic outputs at temperature zero are caused by its sparse mixture-of-experts architecture and batched routing.






