YHacker News

llamafile github.com ↗

Mozilla project that packages LLMs into single-file executables.

ToolAI & MLlocal-llmportablesingle-fileinference

Recommended in 1 thread

Similar tools

  • llama.cpp ↗AI & ML

    A C/C++ engine for running LLMs locally.

    6 threads
  • Hermes AI & ML

    A personal AI agent framework that can run locally with local or cloud models.

    2 threads
  • gptel AI & ML

    An Emacs LLM client usable from any buffer.

    1 thread
  • Pydantic AI AI & ML

    Python agent framework with abstractions over LLM providers.

    1 thread
  • lean4-mlir ↗AI & ML

    A project using Lean 4 to drive PJRT/MLIR for ML workloads.

    1 thread
  • clojure-mcp AI & ML

    MCP tooling that lets LLM agents edit Clojure code and interact with a REPL.

    1 thread
  • LLM UI Smells ↗AI & ML

    A gist listing telltale markers of LLM-generated writing and UI.

    1 thread
  • noodle ↗AI & ML

    A self-hosted hub for running household AI agents and inference on a single device.

    1 thread

Also in AI & ML

  • OpenRouter ↗

    A marketplace that routes API requests to many LLM inference providers.

    8 threads
  • GLM ↗

    An open-weights large language model family from Zhipu AI.

    6 threads
  • llama.cpp ↗

    A C/C++ engine for running LLMs locally.

    6 threads
  • Claude

    Anthropic's AI model and command-line assistant.

    3 threads
  • DeepSeek V4.1 Flash ↗

    A low-cost DeepSeek language model available via API.

    3 threads
  • Epoch Capabilities Index ↗

    Epoch AI's aggregate index of model capabilities over time.

    3 threads
  • GoModel ↗

    LLM gateway written in Go, offered as a LiteLLM alternative.

    3 threads
  • oh-my-pi

    A setup built around the pi coding agent.

    3 threads
  • DeepSeek

    A family of large language models offered via a low-cost API.

    2 threads
  • Gemini Robotics ↗

    Google DeepMind's models for embodied reasoning and robot control.

    2 threads
  • Hermes

    A personal AI agent framework that can run locally with local or cloud models.

    2 threads
  • OpenCode Go ↗

    A subscription plan for accessing models through the OpenCode coding tool.

    2 threads

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/mozilla-ai/llamafile