{"id":"routellm","name":"RouteLLM","maker":"LMSYS","url":"https://github.com/lm-sys/RouteLLM","repo":"lm-sys/RouteLLM","package":"pypi:routellm","summary":"A framework for serving and evaluating routers that send each query to a stronger or cheaper model.","details":"RouteLLM provides trained routers and an OpenAI-compatible server, plus tools to evaluate routing quality on benchmarks. It is a Python package under the Apache licence and is self-hosted.","open_source":true,"hosted":false,"speaks":["openai-api"],"verified":"2026-11-15","category":"gateways","category_name":"Model gateways and inference APIs","page":"https://modelmoot.com/tools/routellm","reviewed":"2026-11-15","checked":{"at":"2026-11-15T16:10:15.342Z","address_answers":true},"note":"Descriptions are the site's own. Facts under \"checked\" were read automatically from the tool's address and public repository."}