Llama3 implemented from scratch(github.com)
987 points by Hadi7546 | 246 comments
GitHub repository with a Jupyter notebook implementing Meta's Llama 3 model from scratch, one matrix multiplication at a time.
987 points by Hadi7546 | 246 comments
GitHub repository with a Jupyter notebook implementing Meta's Llama 3 model from scratch, one matrix multiplication at a time.
542 points by PaulPauls | 80 comments
GitHub repository with an end-to-end PyTorch pipeline for LLM interpretability using sparse autoencoders on Llama 3.2, replicating Anthropic/OpenAI/DeepMind research.