GPT-4o's Memory Breakthrough – Needle in a Needlestack(nian.llmonpy.ai)
430 points by parrt | 193 comments
Page introducing Needle in a Needlestack (NIAN), a benchmark testing LLM attention over long contexts of limericks, showing GPT-4o's strong results versus GPT-4 Turbo and Claude-3.