ExLlamaV3

Recommended in 0 threads

Similar tools

• Artificial Analysis ↗AI & ML

  A site benchmarking and comparing AI models on quality, price and speed.

  1 thread
• XGrammar AI & ML

  A library for efficient grammar-constrained structured generation in LLM inference.

  1 thread
• Liquid AI Decision Models ↗AI & ML

  Models from Liquid AI trained specifically to produce decisions with calibrated confidence.

  1 thread
• GLiNER AI & ML

  A family of compact models for promptable entity extraction and classification.

  1 thread
• Jeffy ↗AI & ML

  An open-source library bundling pretrained task-specific classifiers that train and run locally on CPU.

  1 thread
• TaxCalcBench ↗AI & ML

  An open benchmark from Column Tax for evaluating AI models on tax calculations.

  1 thread
• mlx-vlm ↗AI & ML

  A library for running vision-language models on Apple Silicon via MLX.

  1 thread
• scikit-learn ↗AI & ML

  A Python machine learning library including probability calibration tools.

  1 thread

Also in AI & ML

• OpenRouter ↗

  A marketplace that routes API requests to many LLM inference providers.

  8 threads
• GLM ↗

  An open-weights large language model family from Zhipu AI.

  6 threads
• llama.cpp ↗

  A C/C++ engine for running LLMs locally.

  6 threads
• Claude

  Anthropic's AI model and command-line assistant.

  3 threads
• DeepSeek V4.1 Flash ↗

  A low-cost DeepSeek language model available via API.

  3 threads
• Epoch Capabilities Index ↗

  Epoch AI's aggregate index of model capabilities over time.

  3 threads
• GoModel ↗

  LLM gateway written in Go, offered as a LiteLLM alternative.

  3 threads
• oh-my-pi

  A setup built around the pi coding agent.

  3 threads
• DeepSeek

  A family of large language models offered via a low-cost API.

  2 threads
• Gemini Robotics ↗

  Google DeepMind's models for embodied reasoning and robot control.

  2 threads
• Hermes

  A personal AI agent framework that can run locally with local or cloud models.

  2 threads
• OpenCode Go ↗

  A subscription plan for accessing models through the OpenCode coding tool.

  2 threads