If you don't run your own LLM proxy, how do you know whats going on?(jrdsgl.com)
279 points by amrrs | 197 comments
Blog post arguing that developers should run their own LLM proxy to see what requests and responses their AI tools are actually sending.