YHacker Newsscreenshots

esp32-ai github.com ↗

A project running language models on ESP32 using per-layer embeddings kept mostly on disk.

LibraryAI & MLesp32per-layer-embeddingsembedded-llm

Screenshot of github.com, esp32-ai's site

Captured 12 Nov 2026

Recommended in 1 thread

I'm making LLMs work on small and old devices
github.com · 1 day ago
Shows a technique for running models in kilobytes of RAM.

Similar tools

ESP-IDF ↗Frameworks & libraries
Espressif's development framework for ESP32 chips, including an x509 certificate bundle API.
1 thread
Hermes AI & ML
A personal AI agent framework that can run locally with local or cloud models.
3 threads
DeepSeek 4.1 Flash ↗AI & ML
An open-weight language model from DeepSeek.
0 threads
DeepSeek V4.1 ↗AI & ML
An open-weight large language model family from DeepSeek.
3 threads
ESPARGOS ESPSDR ↗Hardware
A low-cost ESP32-based approach for observing WiFi and some LTE spectra.
1 thread
ESP32 ↗Hardware
A low-cost microcontroller family from Espressif with built-in Wi-Fi and Bluetooth.
3 threads
DeepSeek V4.1 Flash ↗AI & ML
A low-cost DeepSeek language model available via API.
8 threads
DeepSeek ↗AI & ML
A family of large language models offered via a low-cost API.
12 threads

Also in AI & ML

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
19 threads
DeepSeek ↗
A family of large language models offered via a low-cost API.
12 threads
llama.cpp ↗
A C/C++ engine for running LLMs locally.
12 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
11 threads
Qwen ↗
Alibaba's family of open-weight large language models.
9 threads
DeepSeek V4.1 Flash ↗
A low-cost DeepSeek language model available via API.
8 threads
Artificial Analysis ↗
A site benchmarking and comparing AI models on quality, price and speed.
7 threads
Claude ↗
Anthropic's AI model and command-line assistant.
7 threads
Qwen 3.8 Flash Next ↗
A Qwen open-weight model that can be run locally.
5 threads
Strata ↗
An open-source project for running large MoE models on small-VRAM GPUs with system RAM.
5 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
4 threads
Pangram ↗
A service that uses a trained model to detect AI-generated text.
4 threads

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/slvDev/esp32-ai