You Wouldn't Download a Hacker News(jasonthorsness.com)
431 points by jasonthorsness | 223 comments
Blog post by Jason Thorsness about downloading the full Hacker News dataset and analyzing topic trends over time with DuckDB.
431 points by jasonthorsness | 223 comments
Blog post by Jason Thorsness about downloading the full Hacker News dataset and analyzing topic trends over time with DuckDB.
98 points by stephc_int13 | 27 comments
566 points by ta988 | 335 comments
A diaspora* post by Dennis Schubert reporting that LLM training crawlers like GPTBot, Amazonbot and ClaudeBot account for about 70% of the project's web infrastructure traffic.