Memorilla: Latent Semantic Memory for LLMs(arxiv.org)
101 points by handfuloflight | 10 comments
arXiv paper introducing Memorilla, a system that compresses document collections into query-dependent memory tokens in the input embedding space of frozen LLMs.