Llama: Add grammar-based sampling(github.com)
379 points by davepeck | 95 comments
A GitHub pull request to llama.cpp adding an API for grammar-based sampling that constrains LLM output with a BNF-like context-free grammar.
#grammar-sampling on Hacker News
1 story tagged grammar-sampling, newest first.