MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts

First screen, captured 2 years ago.

Looks similar

Screenshot of arxiv.org: Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Mamba: Linear-Time Sequence Modeling with Selective State Spaces (arxiv.org)

76 points by anigbrowl 2 years ago | 20 comments

Screenshot of arxiv.org: An Empirical Study of Mamba-Based Language Models

An Empirical Study of Mamba-Based Language Models (arxiv.org)

39 points by panabee 2 years ago | 2 comments

Screenshot of arxiv.org: Mixtral 8x7B: A sparse Mixture of Experts language model

Mixtral 8x7B: A sparse Mixture of Experts language model (arxiv.org)

293 points by ignoramous 2 years ago | 110 comments

Screenshot of arxiv.org: SparseGPT: Language Models Can Be Accurately Pruned in One-Shot

SparseGPT: Language Models Can Be Accurately Pruned in One-Shot (arxiv.org)

191 points by tosh 3 years ago | 54 comments

Screenshot of arxiv.org: Jamba: A Hybrid Transformer-Mamba Language Model

Jamba: A Hybrid Transformer-Mamba Language Model (arxiv.org)

58 points by eitanturok 2 years ago | 6 comments

Screenshot of arxiv.org: Vision Mamba: Efficient Visual Representation Learning with Bidirectional SSM

Vision Mamba: Efficient Visual Representation Learning with Bidirectional SSM (arxiv.org)

61 points by andy99 2 years ago | 16 comments