The Secret Sauce behind 100K context window in LLMs: all tricks in one place(blog.gopenai.com)
406 points by T-A | 92 comments
A Medium blog post explaining techniques for speeding up large language models and enabling context windows of 100K tokens.