Continuous batching to increase LLM inference throughput and reduce p50 latency(anyscale.com)98 points by michellezzz 3 years ago | 19 comments
Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper(anyscale.com)71 points by pallas_athena 3 years ago | 19 comments
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models(anyscale.com)268 points by robertnishihara 3 years ago | 54 comments
Backprop Alternative: Augmented Lagrangian Predictive Coding(pub.sakana.ai)102 points by guld 1 month ago | 34 comments
LLM-Deflate: Extracting LLMs into Datasets(scalarlm.com)53 points by gdiamos 1 year ago | 26 comments