Llama: Add grammar-based sampling(github.com)
379 points by davepeck | 95 comments
A GitHub pull request to llama.cpp adding an API for grammar-based sampling that constrains LLM output with a BNF-like context-free grammar.
#context-free-grammar on Hacker News
1 story tagged context-free-grammar, newest first.