Guidance github.com ↗
Microsoft's library for constrained and structured LLM generation.
LibraryAI & MLllmconstrained-generationpython
Captured
Recommended in 0 threads
Similar tools
- ExLlamaV3 ↗AI & ML0 threads
A quantization and inference library for running LLMs on consumer and datacenter GPUs.
- XGrammar ↗AI & ML1 thread
A library for efficient grammar-constrained structured generation in LLM inference.
- 1 thread
- 1 thread
- 1 thread
- 4 threads
- Liquid AI Decision Models ↗AI & ML1 thread
Models from Liquid AI trained specifically to produce decisions with calibrated confidence.
- 2 threads
Also in AI & ML
- 19 threads
- 12 threads
- 12 threads
- 11 threads
- 9 threads
- 8 threads
- 7 threads
- 7 threads
- 5 threads
- 5 threads
- 4 threads
- 4 threads
Link from a commenter, not checked or endorsed by us: ↗ https://github.com/guidance-ai/guidance

















