YHacker Newsscreenshots

go-pherence github.com ↗

An LLM inference project written in Go.

ToolAI & MLllm-inferencegosmall-devices

Screenshot of github.com, go-pherence's site

Captured 13 Nov 2026

Recommended in 1 thread

I'm making LLMs work on small and old devices
github.com · 1 day ago
Its author is pursuing the same goal and offered to swap notes.

Similar tools

DeepInfer ↗AI & ML
DeepSeek's open-source LLM inference engine.
1 thread
OpenRouter ↗AI & ML
A marketplace that routes API requests to many LLM inference providers.
19 threads
OpenCode Go ↗AI & ML
A subscription plan for accessing models through the OpenCode coding tool.
4 threads
GPT-6.1 Sol ↗AI & ML
An OpenAI language model offered at several reasoning effort levels.
1 thread
InferenceX Profit Estimator ↗AI & ML
A SemiAnalysis tool that estimates profit margins of LLM inference on different GPUs.
1 thread
Kapitsa ↗AI & ML
An LLM inference engine for running models locally.
1 thread
Perplexity ↗AI & ML
An AI-powered answer and search engine.
1 thread
Guidance ↗AI & ML
Microsoft's library for constrained and structured LLM generation.
0 threads

Also in AI & ML

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
19 threads
DeepSeek ↗
A family of large language models offered via a low-cost API.
12 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
12 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
11 threads
Qwen ↗
Alibaba's family of open-weight large language models.
9 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
8 threads
Artificial Analysis ↗
A site benchmarking and comparing AI models on quality, price and speed.
7 threads
Claude ↗
Anthropic's AI model and command-line assistant.
7 threads
Qwen 3.8 Flash Next ↗
A Qwen open-weight model that can be run locally.
5 threads
Strata ↗
An open-source project for running large MoE models on small-VRAM GPUs with system RAM.
5 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
4 threads
Pangram ↗
A service that uses a trained model to detect AI-generated text.
4 threads

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/rcarmo/go-pherence