Eagle 7B: Soaring past Transformers(blog.rwkv.com)
341 points by guybedo | 73 comments
RWKV blog post announcing Eagle 7B, an RWKV-v5 linear transformer model trained on 1 trillion tokens across 100+ languages.
1 story on the front page, newest first. Scroll down to watch the site change over time.
341 points by guybedo | 73 comments
RWKV blog post announcing Eagle 7B, an RWKV-v5 linear transformer model trained on 1 trillion tokens across 100+ languages.