{"id":"litellm","name":"LiteLLM","maker":"BerriAI","url":"https://www.litellm.ai","repo":"BerriAI/litellm","docs":"https://docs.litellm.ai","package":"pypi:litellm","summary":"A Python SDK and proxy server that calls many model providers in the OpenAI format, with keys, budgets and routing.","details":"LiteLLM is used as a Python library or as a self-hosted proxy gateway with virtual keys, spend tracking, load balancing and fallbacks, and it can front MCP servers. The code is MIT licensed apart from an enterprise directory, and the maker also sells a hosted enterprise edition.","open_source":true,"hosted":true,"speaks":["openai-api","mcp","opentelemetry"],"also":["mcp-tooling"],"verified":"2026-11-15","category":"gateways","category_name":"Model gateways and inference APIs","page":"https://modelmoot.com/tools/litellm","reviewed":"2026-11-15","checked":{"at":"2026-11-15T14:03:44.997Z","address_answers":true},"note":"Descriptions are the site's own. Facts under \"checked\" were read automatically from the tool's address and public repository."}