Building the heap: racking 30 petabytes of hard drives for pretraining(si.inc)
392 points by nee1r | 267 comments
Standard Intelligence blog post describing how they built a 30-petabyte hard drive storage cluster in a San Francisco colocation center for under $500k to store video pretraining data.
![Screenshot of tom7.org: Harder Drive: hard drives we didn't want, or need (2022) [video]](https://hn.urlbox.com/shots/renders/2024/8/31/16800c55-0542-48d6-af46-c2484cede76a.jpg)