MLC LLM

By MLC AI ยท Local model runners

About MLC LLM

Compiles language models to run natively on laptops, phones and in the browser through one deployment workflow.

Details

  • Open source

    Yes

Not enough info yet on works offline after setup, local API server, runs on macOS, runs on Windows, runs on Linux. Check the tool's own site.

Listing written by LaptopMind, checked 2026-11-04. Report a correction or request removal. Back to local model runners.

More tools in local model runners

Ollama

A command-line runner and local server that downloads open models by name and serves them to other apps on your machine.

  • Open source
  • Works offline after setup
  • Local API server

llama.cpp

by ggml-org

The C and C++ engine behind many local AI apps, for running quantized GGUF models on CPUs, GPUs and Apple silicon.

  • Open source
  • Works offline after setup
  • Local API server

llamafile

by Mozilla

Packs a model and its runtime into one executable file that runs on most operating systems without an install step.

  • Open source
  • Works offline after setup
  • Local API server

LocalAI

A self-hosted server that runs text, image and audio models locally behind an API shaped like common hosted ones.

  • Open source
  • Works offline after setup
  • Local API server

KoboldCpp

by LostRuins

A single-file runner for GGUF models with a built-in web interface, often used for long-form writing and story sessions.

  • Open source
  • Works offline after setup
  • Local API server

MLX

by Apple

An array framework from Apple research for running and training models efficiently on Apple silicon memory.

  • Open source
  • Runs on macOS