#llm-proxy on Hacker News

2 stories tagged llm-proxy, newest first.

Screenshot of jrdsgl.com: If you don't run your own LLM proxy, how do you know whats going on?

If you don't run your own LLM proxy, how do you know whats going on?(jrdsgl.com)

279 points by amrrs 7 days ago | 197 comments

Blog post arguing that developers should run their own LLM proxy to see what requests and responses their AI tools are actually sending.

llm-proxy llm observability ai-tooling

Screenshot of jevstiller.pages.dev: Show HN: Jevstiller – Distill Jev into a local model, with a disagreement bound

Show HN: Jevstiller – Distill Jev into a local model, with a disagreement bound (jevstiller.pages.dev)

54 points by tgluck 27 days ago | 8 comments

Documentation post for Jevstiller, a tool that distills the Jev classification API into a local model, explaining its 98% agreement rate and disagreement guarantee.

model-distillation local-models text-classification llm-proxy

#llm-proxy on Hacker News

If you don't run your own LLM proxy, how do you know whats going on?(jrdsgl.com)

Show HN: Jevstiller – Distill Jev into a local model, with a disagreement bound(jevstiller.pages.dev)

Show HN: Jevstiller – Distill Jev into a local model, with a disagreement bound (jevstiller.pages.dev)