GGUF
The single-file model format used by llama.cpp and many local apps, with built-in support for quantized weights.
- Open source
A file format for storing model weights that loads fast and cannot run hidden code when opened.
Not enough info yet on works offline after setup, local API server, runs on macOS, runs on Windows, runs on Linux. Check the tool's own site.
Listing written by LaptopMind, checked 2026-11-04. Report a correction or request removal. Back to model hubs and formats.