{"id":"llama-cpp","name":"llama.cpp","maker":"ggml-org","url":"https://github.com/ggml-org/llama.cpp","repo":"ggml-org/llama.cpp","summary":"A C and C++ library and server for running language models in the GGUF format on CPUs and many GPUs.","details":"llama.cpp provides command-line tools and llama-server, an HTTP server with an OpenAI-compatible API, and supports quantization to run large models on modest hardware. Many other local tools build on it. It runs on macOS, Linux, Windows and other platforms.","open_source":true,"hosted":false,"speaks":["openai-api"],"verified":"2026-11-15","category":"runtimes","category_name":"Local and self-hosted model runtimes","page":"https://modelmoot.com/tools/llama-cpp","reviewed":"2026-11-15","checked":{"at":"2026-11-15T14:03:44.997Z","address_answers":true},"note":"Descriptions are the site's own. Facts under \"checked\" were read automatically from the tool's address and public repository."}