mit-han-lab on Hacker News: 1 stories with screenshots

Efficient streaming language models with attention sinks (github.com)

401 points by guywithabowtie 3 years ago | 65 comments

GitHub repository from MIT HAN Lab for StreamingLLM, code for efficient streaming language models using attention sinks.