YHacker News

exo github.com ↗

Software for running AI models across a cluster of local devices.

ToolAI & MLlocal-llmdistributed-inferenceself-hostingclustering

Screenshot of github.com, exo's site

Captured

Recommended in 2 threads

Similar tools

  • oMLX ↗AI & ML

    An MLX-based local LLM inference server for Apple Silicon.

    2 threads
  • Hermes AI & ML

    A personal AI agent framework that can run locally with local or cloud models.

    3 threads
  • JevK5 ↗AI & ML

    A locally runnable decision model variant.

    1 thread
  • Paseo ↗AI & ML

    A tool for running and managing coding agents.

    4 threads
  • noodle ↗AI & ML

    A self-hosted hub for running household AI agents and inference on a single device.

    2 threads
  • ExLlamaV3 ↗AI & ML

    A quantization and inference library for running LLMs on consumer and datacenter GPUs.

    0 threads
  • FUTO ASR4All ↗AI & ML

    FUTO's small CPU-optimised streaming English ASR models.

    1 thread
  • llama-swap ↗AI & ML

    A proxy that swaps between local LLM inference servers on demand.

    2 threads

Also in AI & ML

  • OpenRouter ↗

    A marketplace that routes API requests to many LLM inference providers.

    19 threads
  • DeepSeek ↗

    A family of large language models offered via a low-cost API.

    12 threads
  • llama.cpp ↗

    A C/C++ engine for running LLMs locally.

    12 threads
  • GLM ↗

    An open-weights large language model family from Zhipu AI.

    11 threads
  • Qwen ↗

    Alibaba's family of open-weight large language models.

    9 threads
  • DeepSeek V4.1 Flash ↗

    A low-cost DeepSeek language model available via API.

    8 threads
  • Artificial Analysis ↗

    A site benchmarking and comparing AI models on quality, price and speed.

    7 threads
  • Claude ↗

    Anthropic's AI model and command-line assistant.

    7 threads
  • Qwen 3.8 Flash Next ↗

    A Qwen open-weight model that can be run locally.

    5 threads
  • Strata ↗

    An open-source project for running large MoE models on small-VRAM GPUs with system RAM.

    5 threads
  • OpenCode Go ↗

    A subscription plan for accessing models through the OpenCode coding tool.

    4 threads
  • Pangram ↗

    A service that uses a trained model to detect AI-generated text.

    4 threads

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/exo-explore/exo