Mapping with In-Memory Layers to Reduce LLM Overload (ridgetext.com) | HN Screenshots

YHacker Newsscreenshots

Screenshot of ridgetext.com: Mapping with In-Memory Layers to Reduce LLM Overload

First screen, captured 3 months ago.

Looks similar

Screenshot of jtarchie.com: Optimizing Large-Scale OpenStreetMap Data with SQLite

Optimizing Large-Scale OpenStreetMap Data with SQLite (jtarchie.com)

181 points by thunderbong 2 years ago | 35 comments

Screenshot of tedpiotrowski.svbtle.com: Using Lidar to map tree shadows

Using Lidar to map tree shadows (tedpiotrowski.svbtle.com)

304 points by tppiotrowski 3 years ago | 40 comments

Screenshot of conviva.ai: We Replaced MMAP with Io_uring in Our Rust Query Engine. It Got Slower

We Replaced MMAP with Io_uring in Our Rust Query Engine. It Got Slower (conviva.ai)

36 points by rzk 1 month ago | 18 comments

Screenshot of jola.dev: Running local models on an M4 with 24GB memory

Running local models on an M4 with 24GB memory (jola.dev)

525 points by shintoist 5 months ago | 156 comments

A blog post describing a setup for running local LLMs such as Qwen via LM Studio on an Apple M4 Mac with 24GB of memory.

local-llm apple-silicon qwen lm-studio

Screenshot of seangoedecke.com: Should LLMs just treat text content as an image?

Should LLMs just treat text content as an image?(seangoedecke.com)

159 points by ingve 1 year ago | 94 comments

Screenshot of ngrok.com: Prompt caching for cheaper LLM tokens

Prompt caching for cheaper LLM tokens (ngrok.com)

268 points by samwho 10 months ago | 67 comments