Managed and external llama.cpp servers for GGUF chat and embeddings.
Distribution
- Package:
@apus/llama-cpp-provider - Install route: npm:
@openclaw/llama-cpp-provideror ClawHub:clawhub:@openclaw/llama-cpp-provider
Surface
- Providers:
llama-cpp - Contracts:
embeddingProviders
Managed text models
During interactive setup, Apus installs a pinned, verified llama-server
and recommends a model for the Gateway host's available memory, GPU, and disk
space. Recommendations start with Qwen3.5 4B (about 2.7 GB) on eligible 8 GiB
hosts and scale up as hardware permits. See the current
model recommendations for sizes and
selection floors.
To use another model, configure params.modelPath, select its llama-cpp/<id>
reference, and rerun managed setup. Setup uses that authored route and offers
to download it if needed. Custom models are not subject to recommendation
memory floors. Existing cached GGUFs remain supported; local memory search can
also use embedding-only setup.