Kapitsa github.com ↗

An LLM inference engine for running models locally.

ToolAI & MLllm-inferenceapple-siliconlocal-ai

Recommended in 1 thread

New 14‑inch MacBook Pro with M6
apple.com · 2 days ago
One commenter reports 145+ tokens/sec on an M1 Max.

llama.cpp ↗AI & ML
A C/C++ engine for running LLMs locally.
6 threads
mlx-vlm ↗AI & ML
A library for running vision-language models on Apple Silicon via MLX.
1 thread
Unsloth Studio ↗AI & ML
A tool for running and fine-tuning LLMs locally.
2 threads
LM Studio AI & ML
A desktop app for downloading and running local language models.
1 thread
lean4-mlir ↗AI & ML
A project using Lean 4 to drive PJRT/MLIR for ML workloads.
1 thread
Liquid AI Decision Models ↗AI & ML
Models from Liquid AI trained specifically to produce decisions with calibrated confidence.
1 thread
ExLlamaV3 AI & ML
A quantization and inference library for running LLMs on consumer and datacenter GPUs.
0 threads
Hermes AI & ML
A personal AI agent framework that can run locally with local or cloud models.
2 threads

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
8 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
6 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
6 threads
Claude
Anthropic's AI model and command-line assistant.
3 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
3 threads
Epoch Capabilities Index ↗
Epoch AI's aggregate index of model capabilities over time.
3 threads
GoModel ↗
LLM gateway written in Go, offered as a LiteLLM alternative.
3 threads
oh-my-pi
A setup built around the pi coding agent.
3 threads
DeepSeek
A family of large language models offered via a low-cost API.
2 threads
Gemini Robotics ↗
Google DeepMind's models for embodied reasoning and robot control.
2 threads
Hermes
A personal AI agent framework that can run locally with local or cloud models.
2 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
2 threads

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/nace-ai/kapitsa