LM Studio
A desktop app for finding, downloading and chatting with open language models, with a built-in local server for other apps.
- Works offline after setup
- Local API server
- Runs on macOS
Jan
An open-source desktop chat app that runs models offline, keeps conversations as local files and can expose a local API.
- Open source
- Works offline after setup
- Local API server
GPT4All
A free desktop app for running open models on ordinary laptops, with a feature for chatting with folders of local documents.
- Open source
- Works offline after setup
- Local API server
Msty
A desktop chat app that runs local models and online ones side by side, with split chats for comparing answers.
- Runs on macOS
- Runs on Windows
- Runs on Linux
Open WebUI
A self-hosted web chat interface for local model runners such as Ollama, with users, document upload and model switching.
- Works offline after setup
- Runs on macOS
- Runs on Windows
Chatbox
A desktop and mobile chat client that can talk to a local Ollama server as well as hosted model APIs.
- Runs on macOS
- Runs on Windows
- Runs on Linux
Pinokio
A launcher that installs and runs open-source AI apps on your computer with one click, each in its own folder.
- Runs on macOS
- Runs on Windows
- Runs on Linux
Text Generation Web UI
A browser-based interface for running local language models with many loaders, sampling settings and extensions.
- Open source
- Works offline after setup
- Local API server
LibreChat
An open-source, self-hosted chat interface that can connect to local model servers and hosted APIs from one place.
- Open source
Ollama
A command-line runner and local server that downloads open models by name and serves them to other apps on your machine.
- Open source
- Works offline after setup
- Local API server
llama.cpp
The C and C++ engine behind many local AI apps, for running quantized GGUF models on CPUs, GPUs and Apple silicon.
- Open source
- Works offline after setup
- Local API server
llamafile
Packs a model and its runtime into one executable file that runs on most operating systems without an install step.
- Open source
- Works offline after setup
- Local API server
LocalAI
A self-hosted server that runs text, image and audio models locally behind an API shaped like common hosted ones.
- Open source
- Works offline after setup
- Local API server
KoboldCpp
A single-file runner for GGUF models with a built-in web interface, often used for long-form writing and story sessions.
- Open source
- Works offline after setup
- Local API server
MLX
An array framework from Apple research for running and training models efficiently on Apple silicon memory.
- Open source
- Runs on macOS
MLC LLM
Compiles language models to run natively on laptops, phones and in the browser through one deployment workflow.
- Open source
vLLM
A high-throughput serving engine for language models on GPUs, often used to share one strong machine with a team.
- Open source
- Local API server
- Runs on Linux
SGLang
A fast serving framework for language and vision models on GPUs, with caching that helps when prompts share long prefixes.
- Open source
- Local API server
TensorRT-LLM
NVIDIA's library for compiling and running language models with kernels tuned for its GPUs.
- Open source
ONNX Runtime
A cross-platform runtime for models in the ONNX format, with backends for CPUs, GPUs and NPUs on many devices.
- Open source
- Runs on macOS
- Runs on Windows
OpenVINO
Intel's toolkit for optimizing and running models on Intel CPUs, integrated graphics and NPUs.
- Open source
ExLlamaV2
A fast inference library for running quantized language models on consumer NVIDIA GPUs.
- Open source
Core ML
Apple's framework for running models on device across the CPU, GPU and Neural Engine in apps for Apple platforms.
- Runs on macOS
ComfyUI
A node-based interface for building image and video generation workflows with open diffusion models on your own GPU.
- Open source
- Works offline after setup
- Runs on macOS
Invoke
An image generation app with a layered canvas for inpainting, outpainting and editing, available as a free local edition.
- Open source
Draw Things
An image generation app for Mac, iPhone and iPad that runs diffusion models fully on the device.
- Works offline after setup
- Runs on macOS
SwarmUI
A web interface for image generation that offers a simple prompt tab on top of a ComfyUI backend for advanced work.
- Open source
Stable Diffusion WebUI Forge
A fork of the classic Stable Diffusion web UI that focuses on lower memory use and faster generation.
- Open source
SD.Next
A web interface for image and video diffusion models with support for several GPU vendors and backends.
- Open source
Mochi Diffusion
A native Mac app that runs Stable Diffusion models converted to Core ML, using the Neural Engine on Apple silicon.
- Open source
- Works offline after setup
- Runs on macOS
whisper.cpp
A C and C++ port of OpenAI's Whisper speech recognition model that transcribes audio offline on ordinary hardware.
- Open source
- Works offline after setup
- Runs on macOS
Superwhisper
A dictation app that turns speech into text in any app, with the option to run speech models locally.
- Runs on macOS
Buzz
A desktop app that transcribes and translates audio files offline with Whisper models.
- Open source
- Works offline after setup
- Runs on macOS
faster-whisper
A Python reimplementation of Whisper on a faster inference engine, using less memory for the same transcripts.
- Open source
- Works offline after setup
Vosk
An offline speech recognition toolkit with small models that run on laptops, phones and single-board computers.
- Open source
- Works offline after setup
Aiko
A simple Mac and iPhone app that transcribes audio and video files on the device with Whisper.
- Works offline after setup
- Runs on macOS
Kokoro
A small open-weight text-to-speech model that produces natural voices quickly, even on a CPU.
- Open source
WhisperX
Adds word-level timestamps and speaker labels to Whisper transcripts for interviews and meetings.
- Open source
AnythingLLM
A desktop and self-hosted app for chatting with your documents through a local model, with workspaces per project.
- Open source
- Runs on macOS
- Runs on Windows
PrivateGPT
An open-source project for asking questions about documents with a local model, with an API for building on top.
- Open source
- Works offline after setup
- Local API server
Khoj
An open-source assistant that searches and chats over your notes and documents and can be self-hosted.
- Open source
h2oGPT
An open-source app for private question answering over documents, images and audio with local models.
- Open source
Kotaemon
A clean web interface for chatting with documents that shows the source passages behind each answer.
- Open source
RAGFlow
An open-source engine for document question answering that parses complex layouts such as tables and scanned pages.
- Open source
LocalGPT
A project for chatting with documents entirely on your own machine, with no data leaving the computer.
- Open source
- Works offline after setup
ChatRTX
An NVIDIA demo app for Windows PCs with RTX graphics that answers questions about your local files.
- Works offline after setup
- Runs on Windows
Continue
An open-source assistant for VS Code and JetBrains that can use a local model for chat, edits and autocomplete.
- Open source
Tabby
A self-hosted code completion server you run on your own GPU, with editor plugins for common IDEs.
- Open source
- Local API server
Refact.ai
An open-source coding assistant and agent that can be self-hosted with your own models.
- Open source
llama.vscode
A VS Code extension for code completion from a llama.cpp server running on your machine.
- Open source
- Works offline after setup
Hugging Face Hub
The largest public host for open model weights, datasets and demos, where most local models are first published.
ModelScope
A model hub run by Alibaba that hosts open models and datasets, including many released by Chinese labs.
Kaggle Models
Google's model repository on Kaggle, with open models ready to download or try in notebooks.
GGUF
The single-file model format used by llama.cpp and many local apps, with built-in support for quantized weights.
- Open source
safetensors
A file format for storing model weights that loads fast and cannot run hidden code when opened.
- Open source
Unsloth
A library for fine-tuning open language models faster and with less GPU memory, with ready notebooks.
- Open source
Axolotl
A configuration-driven tool for fine-tuning open models, from small adapters to full training runs.
- Open source
bitsandbytes
A library for 8-bit and 4-bit model weights, used to load and fine-tune large models on smaller GPUs.
- Open source
MLX LM
Tools built on MLX for running, quantizing and fine-tuning language models on Apple silicon Macs.
- Open source
- Runs on macOS
LLaMA-Factory
A fine-tuning toolkit with a web interface that supports many open model families and training methods.
- Open source
nvtop
A terminal monitor for GPU load, memory and processes on Linux, with support for several GPU vendors.
- Open source
- Runs on Linux
asitop
A terminal monitor for CPU, GPU, Neural Engine and power use on Apple silicon Macs.
- Open source
- Runs on macOS
GPU-Z
A small Windows utility that shows graphics card details, video memory use, clocks and temperatures.
- Runs on Windows
Geekbench AI
A cross-platform benchmark that measures how fast a device runs AI workloads on its CPU, GPU and NPU.
HWiNFO
A Windows hardware monitor with detailed sensor readings for temperatures, power draw and memory.
- Runs on Windows
btop
A terminal resource monitor for CPU, memory, disks and processes, with GPU stats on supported systems.
- Open source
Nothing matches. Try a shorter word, or browse the categories.