PrivateGPT
An open-source project for asking questions about documents with a local model, with an API for building on top.
- Open source
- Works offline after setup
- Local API server
About AnythingLLM
A desktop and self-hosted app for chatting with your documents through a local model, with workspaces per project.
AnythingLLM is an app for asking questions about your own files. You create a workspace, add documents such as PDFs, text files or web pages, and the app splits them into chunks, stores them in a local vector database and pulls the relevant parts into each answer.
It can use a model running on your own computer through runners such as Ollama or LM Studio, or a hosted model if you prefer. A desktop version keeps everything on one machine, and a server version adds multiple users for a small team. Answers can show which documents they came from.
It suits people who want private document search without building a pipeline themselves. Retrieval is only as good as the files and settings behind it, so test it with questions you already know the answers to before you trust it with real work.
Details
Open source
YesRuns on macOS
YesRuns on Windows
YesRuns on Linux
Yes
Not enough info yet on works offline after setup, local API server. Check the tool's own site.
Listing written by LaptopMind, checked 2026-11-04. Report a correction or request removal. Back to private document chat.