TensorFold

A project building fast inference engines for Qwen models on Mac and CUDA.

ToolAI & MLinferencemlxlocal-llm

Recommended in 1 thread

Memdoor: A team of 5 Qwen3.8-27B models beats Fable 5 on LiveCodeBench Hard
github.com · 1 day ago
Recommended as the project to follow for rapidly improving local inference speed.

ExLlamaV3 AI & ML
A quantization and inference library for running LLMs on consumer and datacenter GPUs.
0 threads
Cerebras ↗AI & ML
A hosted fast inference service offering Qwen models.
1 thread
torch-neuronx ↗AI & ML
AWS's PyTorch backend for Trainium and Inferentia chips.
1 thread
Liquid AI Decision Models ↗AI & ML
Models from Liquid AI trained specifically to produce decisions with calibrated confidence.
1 thread
T3 Code AI & ML
A GUI app for running and managing AI coding agents like Codex and Claude.
1 thread
T3 AI & ML
A session-oriented interface for working with coding agents.
1 thread
TabPFN AI & ML
A transformer model that does tabular prediction via in-context learning.
1 thread
Artificial Analysis ↗AI & ML
A site benchmarking and comparing AI models on quality, price and speed.
3 threads

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
11 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
7 threads
DeepSeek
A family of large language models offered via a low-cost API.
6 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
6 threads
Artificial Analysis ↗
A site benchmarking and comparing AI models on quality, price and speed.
3 threads
Claude
Anthropic's AI model and command-line assistant.
3 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
3 threads
Epoch Capabilities Index ↗
Epoch AI's aggregate index of model capabilities over time.
3 threads
GoModel ↗
LLM gateway written in Go, offered as a LiteLLM alternative.
3 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
3 threads
Qwen
Alibaba's family of open-weight large language models.
3 threads
oh-my-pi
A setup built around the pi coding agent.
3 threads