#llm-gateway on Hacker News

2 stories tagged llm-gateway, newest first.

Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins

45 points by Andydy25 6 days ago | 21 comments

Launch HN post introducing Respan, an open-source Rust AI/LLM gateway with a small core where providers, protocols, and features are plugins.

llm-gateway rust respan litellm

Launch HN: Consus (YC F24) – LLM gateway for companies handling sensitive data

32 points by ericmags 13 days ago | 16 comments

Launch HN post for Consus, a YC F24 LLM gateway routing AI requests to ITAR- and CUI-compliant government cloud infrastructure for aerospace and defense companies.

consus llm-gateway itar fedramp