llama.cpp
#3 v Lokální LLM runtimeGeorgi Gerganov · od March 10, 2023 · 3× · naposledy 09. 10. 2026
75
Momentum
llama.cpp is an open-source C/C++ library for LLM inference, originally developed by Georgi Gerganov and now maintained within the ggml-org project. It runs locally on CPU and GPU and forms the basis of many local LLM tools such as Ollama and LM Studio. The official website llama.app provides an installer and getting-started documentation.
Vývoj momenta
11.07.09.10.
Vlastnosti
| License | MIT |
| Platform | Windows, macOS, Linux (Docker, Homebrew) |
| Price | Free (open source) |
| Protocol Compatibility | OpenAI-compatible API (/v1/chat/completions, /v1/embeddings), Anthropic Messages-compatible, Ollama shim (/api/tags) |
| Release Date | March 10, 2023 |
| Supported Models/Providers | GGUF models (quantized), e.g. Qwen, Llama, Mistral, Gemma |