9 stories tagged benchmark, newest first.
14 points by emrahsamdan | 4 comments
GitHub repository for Project Arena, a vendor-neutral Kubernetes incident benchmark for evaluating AI SRE investigation tools with an AI judge.
13 points by mortenvp | 5 comments
NanoPing benchmark page showing live video streamed from a moving laptop over three Wi-Fi networks at once, with every packet arriving within 100 ms.
17 points by FKJ | 2 comments
A benchmark page from the Earn an Honest Dollar agent marketplace testing whether web extractors invent missing fields, showing that a "do not guess" instruction cut fabrication from 70.7% to 20.2%.
6 points by northbridgedev | 2 comments
GitHub repo benchmarking open-source prompt-injection detectors like regex and Meta's Prompt Guard 2 against 629 AgentDojo attacks buried in tool output.
529 points by get-inscribe | 211 comments
Blog post from Inscribe benchmarking Apple's new SpeechAnalyzer API against its predecessor and OpenAI Whisper on 5,559 test utterances, with transcripts released.
454 points by rbanffy | 177 comments
arXiv paper introducing DELEGATE-52, a benchmark showing LLMs corrupt about 25% of document content during long delegated editing workflows.
322 points by Twirrim | 115 comments
A blog post benchmarking many ways to speed up Python, including Cython, Numba, PyPy, mypyc, Mojo and Rust, on Benchmarks Game problems and a JSON pipeline.
333 points by moonikakiss | 77 comments
Mooncake blog post announcing pg_mooncake v0.1 and its ClickBench results showing Postgres performing among top analytics databases.
450 points by dbreunig | 257 comments
GitHub repository from Useful Sensors with code to run and benchmark matrix-multiplication models on Qualcomm NPUs in Windows PCs, comparing them against the CPU and Nvidia GPUs.