HTTP Archive httparchive.org ↗

A project that regularly crawls millions of websites and publishes data on web technology usage.

ServiceData & analyticsweb-crawlweb-statscrawling

Recommended in 1 thread

Zombie stats: Where the numbers AI quotes come from
trakkr.ai · 14 hours ago
Used to check the PHP usage claim against real crawl data.

Browsertrix ↗Dev tools
A browser-based web crawling and archiving platform from Webrecorder.
1 thread
WebPKI Observatory ↗Security & privacy
A website tracking data about the Web PKI and certificate authorities.
1 thread
End of Term Web Archive ↗Other
A collaborative project that archives US federal government websites at the end of presidential terms.
1 thread
Wayback Machine ↗Other
The Internet Archive's service for capturing and browsing historical snapshots of web pages.
2 threads
htmx Frameworks & libraries
A small JavaScript library that adds AJAX and dynamic behaviour through HTML attributes.
1 thread
Splink ↗Data & analytics
Open-source probabilistic record linkage library that can run on DuckDB.
1 thread
Paulina ↗Other
A Toolforge tool for browsing public domain works and creators using Wikidata and Wikimedia Commons.
1 thread
Jupyter Data & analytics
An open-source interactive notebook environment for code, data and visualization.
1 thread

Electricity Maps ↗
A service showing real-time and historical carbon intensity of electricity grids worldwide.
2 threads
America's Digital Shield ↗
A project that captures ephemeral search and social feed content from politically balanced volunteers to study bias.
1 thread
Credible Data ↗
A platform for building AI-driven BI on top of Malloy semantic models.
1 thread
DQYDJ Stock Return Calculator ↗
A web calculator that computes historical stock returns including reinvested dividends.
1 thread
Distributional Financial Accounts ↗
Federal Reserve data visualization of US household wealth distribution by percentile.
1 thread
GeneCards ↗
A database that collates known gene functions and disease associations.
1 thread
Hex ↗
A collaborative data notebook and analytics platform.
1 thread
Jupyter
An open-source interactive notebook environment for code, data and visualization.
1 thread
Kaggle
A platform hosting datasets and ML competitions.
1 thread
La Fabrique de la Loi ↗
A project that versions French bills in git and visualizes their evolution as open data.
1 thread
Malloy
A semantic modelling and query language from Looker's original founder.
1 thread
Math.NET Numerics ↗
A numerical computing library for .NET.
1 thread

Link from a commenter, not checked or endorsed by us: ↗ https://httparchive.org/