GGUF

By ggml-org ยท Model hubs and formats

About GGUF

The single-file model format used by llama.cpp and many local apps, with built-in support for quantized weights.

Details

  • Open source

    Yes

Not enough info yet on works offline after setup, local API server, runs on macOS, runs on Windows, runs on Linux. Check the tool's own site.

Listing written by LaptopMind, checked 2026-11-04. Report a correction or request removal. Back to model hubs and formats.

More tools in model hubs and formats

safetensors

by Hugging Face

A file format for storing model weights that loads fast and cannot run hidden code when opened.

  • Open source

Hugging Face Hub

by Hugging Face

The largest public host for open model weights, datasets and demos, where most local models are first published.

ModelScope

by Alibaba

A model hub run by Alibaba that hosts open models and datasets, including many released by Chinese labs.

Kaggle Models

by Google

Google's model repository on Kaggle, with open models ready to download or try in notebooks.