Unsloth Studio unsloth.ai ↗

A tool for running and fine-tuning LLMs locally.

ToolAI & MLlocal-inferencellmfine-tuninglocal-llmuimodels

Recommended in 2 threads

Survival LLM: AI assistant and emergency library that runs on your own computer
brangus.io · 2 days ago
A well-supported general tool for running good local models like Gemma or Qwen.
Anthropic S-1
sec.gov · 3 days ago
Used to host quantized Qwen models on a home server.

LM Studio AI & ML
A desktop app for downloading and running local language models.
1 thread
Kapitsa ↗AI & ML
An LLM inference engine for running models locally.
1 thread
Unsloth ↗AI & ML
A project providing quantized model releases and fine-tuning tooling with guides.
1 thread
llama.cpp ↗AI & ML
A C/C++ engine for running LLMs locally.
6 threads
LLM UI Smells ↗AI & ML
A gist listing telltale markers of LLM-generated writing and UI.
1 thread
lean4-mlir ↗AI & ML
A project using Lean 4 to drive PJRT/MLIR for ML workloads.
1 thread
mlx-vlm ↗AI & ML
A library for running vision-language models on Apple Silicon via MLX.
1 thread
SillyTavern AI & ML
A frontend for chatting and roleplaying with LLMs.
1 thread

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
8 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
6 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
6 threads
Claude
Anthropic's AI model and command-line assistant.
3 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
3 threads
Epoch Capabilities Index ↗
Epoch AI's aggregate index of model capabilities over time.
3 threads
GoModel ↗
LLM gateway written in Go, offered as a LiteLLM alternative.
3 threads
oh-my-pi
A setup built around the pi coding agent.
3 threads
DeepSeek
A family of large language models offered via a low-cost API.
2 threads
Gemini Robotics ↗
Google DeepMind's models for embodied reasoning and robot control.
2 threads
Hermes
A personal AI agent framework that can run locally with local or cloud models.
2 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
2 threads

Link from a commenter, not checked or endorsed by us: ↗ https://unsloth.ai/docs/new/studio