Screenshot pending…Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU(ai.gopubby.com)42 points by qiakai 2 years ago | 14 comments
Run 70B LLM Inference on a Single 4GB GPU with This New Technique(ai.gopubby.com)80 points by gardenfelder 2 years ago | 39 comments