Efficient streaming language models with attention sinks(github.com)
401 points by guywithabowtie | 65 comments
GitHub repository from MIT HAN Lab for StreamingLLM, code for efficient streaming language models using attention sinks.
#streaming-llm on Hacker News
1 story tagged streaming-llm, newest first.