KoboldCpp

By LostRuins ยท Local model runners

About KoboldCpp

A single-file runner for GGUF models with a built-in web interface, often used for long-form writing and story sessions.

Details

  • Open source

    Yes

  • Works offline after setup

    Yes

  • Local API server

    Yes

Not enough info yet on runs on macOS, runs on Windows, runs on Linux. Check the tool's own site.

Listing written by LaptopMind, checked 2026-11-04. Report a correction or request removal. Back to local model runners.

More tools in local model runners

Ollama

A command-line runner and local server that downloads open models by name and serves them to other apps on your machine.

  • Open source
  • Works offline after setup
  • Local API server

llama.cpp

by ggml-org

The C and C++ engine behind many local AI apps, for running quantized GGUF models on CPUs, GPUs and Apple silicon.

  • Open source
  • Works offline after setup
  • Local API server

llamafile

by Mozilla

Packs a model and its runtime into one executable file that runs on most operating systems without an install step.

  • Open source
  • Works offline after setup
  • Local API server

LocalAI

A self-hosted server that runs text, image and audio models locally behind an API shaped like common hosted ones.

  • Open source
  • Works offline after setup
  • Local API server

MLX

by Apple

An array framework from Apple research for running and training models efficiently on Apple silicon memory.

  • Open source
  • Runs on macOS

MLC LLM

by MLC AI

Compiles language models to run natively on laptops, phones and in the browser through one deployment workflow.

  • Open source