Unsloth unsloth.ai ↗

A project providing quantized model releases and fine-tuning tooling with guides.

ToolAI & MLquantizationlocal-inferencellm

Recommended in 1 thread

We're releasing the weights of Mistral Large 4
mistral.ai · 15 hours ago
Offered day-zero quants of Mistral Large 4 with easy guides.

Unsloth Studio ↗AI & ML
A tool for running and fine-tuning LLMs locally.
2 threads
ExLlamaV3 AI & ML
A quantization and inference library for running LLMs on consumer and datacenter GPUs.
0 threads
Qwen 3.8 Flash Next AI & ML
A Qwen open-weight model that can be run locally.
1 thread
Artificial Analysis ↗AI & ML
A site benchmarking and comparing AI models on quality, price and speed.
1 thread
lean4-mlir ↗AI & ML
A project using Lean 4 to drive PJRT/MLIR for ML workloads.
1 thread
GLiNER AI & ML
A family of compact models for promptable entity extraction and classification.
1 thread
FUTO ASR4All ↗AI & ML
FUTO's small CPU-optimised streaming English ASR models.
1 thread
LM Studio AI & ML
A desktop app for downloading and running local language models.
1 thread

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
8 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
6 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
6 threads
Claude
Anthropic's AI model and command-line assistant.
3 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
3 threads
Epoch Capabilities Index ↗
Epoch AI's aggregate index of model capabilities over time.
3 threads
GoModel ↗
LLM gateway written in Go, offered as a LiteLLM alternative.
3 threads
oh-my-pi
A setup built around the pi coding agent.
3 threads
DeepSeek
A family of large language models offered via a low-cost API.
2 threads
Gemini Robotics ↗
Google DeepMind's models for embodied reasoning and robot control.
2 threads
Hermes
A personal AI agent framework that can run locally with local or cloud models.
2 threads
OpenClaw
An open personal AI assistant agent platform.
2 threads

Link from a commenter, not checked or endorsed by us: ↗ https://unsloth.ai/