Run 70B LLM Inference on a Single 4GB GPU with This New Technique(ai.gopubby.com)80 points by gardenfelder 2 years ago | 39 comments
Compiling LLMs into a MegaKernel: A path to low-latency inference(zhihaojia.medium.com)291 points by matt_d 1 year ago | 74 comments
RAG at scale: Synchronizing and ingesting billions of text embeddings(medium.com)140 points by picohen 3 years ago | 45 comments
Career advice for young system programmers(glaubercosta-11125.medium.com)166 points by signa11 3 years ago | 137 comments