Five Years of LLM Progress(finbarr.ca)
32 points by goranmoomin | 0 comments
finbarr.ca on Hacker News
2 stories on the front page, newest first. Scroll down to watch the site change over time.
How Is LLaMa.cpp Possible?(finbarr.ca)
648 points by birriel | 210 comments
Blog post by Finbarr Timbers explaining the math of why llama.cpp can run LLaMA models locally on consumer hardware, focusing on memory bandwidth and compute limits.