XGrammar

A library for efficient grammar-constrained structured generation in LLM inference.

LibraryAI & MLconstrained-decodingjson-schemagrammar

Recommended in 1 thread

Fixing Tool-Call Accuracy in vLLM
ubicloud.com · 3 days ago
Mentioned as having an option to allow JSON fields in any order.

ExLlamaV3 AI & ML
A quantization and inference library for running LLMs on consumer and datacenter GPUs.
0 threads
LLM UI Smells ↗AI & ML
A gist listing telltale markers of LLM-generated writing and UI.
1 thread
IBM Granite AI & ML
IBM's family of language models reportedly trained on legally obtained data.
1 thread
GLiNER AI & ML
A family of compact models for promptable entity extraction and classification.
1 thread
chatjimmy ↗AI & ML
A chatbot service known for extremely fast text generation.
1 thread
Gemini AI & ML
Google's large language model and chatbot service.
0 threads
mlx-vlm ↗AI & ML
A library for running vision-language models on Apple Silicon via MLX.
1 thread
Pydantic AI AI & ML
Python agent framework with abstractions over LLM providers.
1 thread

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
8 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
6 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
6 threads
Claude
Anthropic's AI model and command-line assistant.
3 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
3 threads
Epoch Capabilities Index ↗
Epoch AI's aggregate index of model capabilities over time.
3 threads
GoModel ↗
LLM gateway written in Go, offered as a LiteLLM alternative.
3 threads
oh-my-pi
A setup built around the pi coding agent.
3 threads
DeepSeek
A family of large language models offered via a low-cost API.
2 threads
Gemini Robotics ↗
Google DeepMind's models for embodied reasoning and robot control.
2 threads
Hermes
A personal AI agent framework that can run locally with local or cloud models.
2 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
2 threads