Releasing 3B and 7B RedPajama(together.xyz)
336 points by antimatter15 | 96 comments
Together blog post announcing the release of 3B and 7B RedPajama-INCITE language models, including base, instruction-tuned, and chat variants.
#redpajama on Hacker News
2 stories tagged redpajama, newest first.
RedPajama: Reproduction of LLaMA with friendly license(together.xyz)
805 points by tim_sw | 202 comments
Together blog post announcing RedPajama, a project to build open-source LLMs that starts by reproducing the LLaMA training dataset of over 1.2 trillion tokens.