YHacker Newsscreenshots

llama-swap github.com ↗

A proxy that swaps between local LLM inference servers on demand.

ToolAI & MLlocal-inferenceproxymodel-switching

Screenshot of github.com, llama-swap's site

Captured 7 Nov 2026

Recommended in 2 threads

Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU
github.com · 5 days ago
Lets users juggle multiple llama.cpp forks transparently.
Anthropic IPO buyers see valuation as low as $1.1T
bloomberg.com · 7 days ago
Used to route opencode to a local inference server.

Similar tools

llama.cpp ↗AI & ML
A C/C++ engine for running LLMs locally.
12 threads
llama.app ↗AI & ML
A desktop interface built on llama.cpp by the same developers.
1 thread
LiteLLM ↗AI & ML
A proxy and SDK that exposes many LLM providers through one API.
1 thread
llm AI & ML
A command-line tool for prompting various language models.
1 thread
lean4-mlir ↗AI & ML
A project using Lean 4 to drive PJRT/MLIR for ML workloads.
1 thread
Hermes AI & ML
A personal AI agent framework that can run locally with local or cloud models.
3 threads
llamafile ↗AI & ML
Mozilla project that packages LLMs into single-file executables.
1 thread
llms.txt ↗AI & ML
A convention for publishing an LLM-friendly markdown index of a site's documentation.
0 threads

Also in AI & ML

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
19 threads
DeepSeek ↗
A family of large language models offered via a low-cost API.
12 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
12 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
11 threads
Qwen ↗
Alibaba's family of open-weight large language models.
9 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
8 threads
Artificial Analysis ↗
A site benchmarking and comparing AI models on quality, price and speed.
7 threads
Claude ↗
Anthropic's AI model and command-line assistant.
7 threads
Qwen 3.8 Flash Next ↗
A Qwen open-weight model that can be run locally.
5 threads
Strata ↗
An open-source project for running large MoE models on small-VRAM GPUs with system RAM.
5 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
4 threads
Pangram ↗
A service that uses a trained model to detect AI-generated text.
4 threads

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/mostlygeek/llama-swap