Shredding JSON columns gave Logfire up to 1000x faster queries(pydantic.dev)
19 points by acossta | 14 comments
Pydantic blog post explaining how dynamically shredding JSON columns into typed columns gave Logfire up to 1000x faster queries.
#columnar-storage on Hacker News
3 stories tagged columnar-storage, newest first.
F3(github.com)
593 points by tosh | 126 comments
GitHub repository for F3, an open-source data file format presented at SIGMOD 2026 as a future successor to formats like Parquet.
![Screenshot of db.cs.cmu.edu: F3: Open-source data file format for the future [pdf]](https://hn.urlbox.com/shots/renders/2025/10/2/31749d51-afe4-455e-b01b-88af39f20fa8.jpg)
F3: Open-source data file format for the future [pdf](db.cs.cmu.edu)
366 points by eatonphil | 117 comments
SIGMOD 2025 paper presenting F3, a next-generation open-source columnar data file format that embeds WebAssembly decoders for extensibility and interoperability.