0/1 Knapsack Problem in PyTorch(jedrzej.maczan.pl)
41 points by yu3zhou4 | 6 comments
Blog post introducing dp_knapsack_sliding_hirschberg, a PyTorch activation memory budget solver that cuts peak RAM during memory planning by about 20x.
6 stories tagged memory-optimization, newest first.
41 points by yu3zhou4 | 6 comments
Blog post introducing dp_knapsack_sliding_hirschberg, a PyTorch activation memory budget solver that cuts peak RAM during memory planning by about 20x.
461 points by f311a | 109 comments
Cloudflare engineering blog post explaining how they saved about 100TB of RAM across their fleet using consistent hashing math and Rust.
857 points by TangerineDream | 250 comments
Cloudflare blog deep dive on how optimizing the 1.1.1.1 DNS resolver's cache data structures saved 100 terabytes of memory.
458 points by skaul | 243 comments
Brave blog post announcing an overhaul of its Rust-based adblock engine using FlatBuffers, reducing memory consumption by 75%.
424 points by hochmartinez | 176 comments
VentureBeat article by Ben Dickson on a new LLM optimization technique that reduces memory costs by up to 75%.
557 points by asicsp | 153 comments
A Marginalia blog post describing a week of coding that halved the search engine's RAM use, enabled online upgrades, and lifted index size limits.