Mixtral 8x7B: A sparse Mixture of Experts language model (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Mixtral 8x7B: A sparse Mixture of Experts language model

First screen, captured 2 years ago.

Looks similar

Screenshot of arxiv.org: Mistral 7B

Mistral 7B (arxiv.org)

228 points by fgfm 3 years ago | 101 comments

Screenshot of arxiv.org: Matryoshka Representation Learning

Matryoshka Representation Learning (arxiv.org)

71 points by fzliu 2 years ago | 10 comments

Screenshot of arxiv.org: Huawei releases an open weight model trained on Huawei Ascend GPUs

Huawei releases an open weight model trained on Huawei Ascend GPUs (arxiv.org)

300 points by buyucu 1 year ago | 292 comments

Screenshot of arxiv.org: Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts (2017)

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts (2017)(arxiv.org)

47 points by georgehill 2 years ago | 8 comments

Screenshot of arxiv.org: MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts

MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts (arxiv.org)

115 points by jonbaer 2 years ago | 35 comments

Screenshot of arxiv.org: Learning Universal Predictors

Learning Universal Predictors (arxiv.org)

52 points by jandrewrogers 2 years ago | 14 comments