AnythingLLM
AI assistantsA private ChatGPT-style assistant that answers from your own documents.
AnythingLLM gives you a ChatGPT-style assistant that you run yourself and point at your own documents. You choose the model, from a local one on your own computer to a cloud provider, and keep files on hardware you control. One person can start with the desktop app, while a team can run the Docker server with separate users and permissions.
- Chat with PDFs, Word files and text documents, with source citations in each answer.
- Build agents with a no-code flow editor, custom skills and MCP servers.
- The Docker version adds user roles, white-labelling and an embeddable website chat widget.
What people use it for
Answer staff questions from company documents
Create a workspace, then drag and drop PDFs, DOCX or text files into it so AnythingLLM embeds them in its vector database. Ask questions in the workspace chat and check the source citations under each answer. Pick a local model through the built-in engine or Ollama to keep the data on your own hardware.
Give each team access to only its own assistant
Run the Docker version and turn on multi-user mode, which creates the first admin account. Add people as Admin, Manager or Default users; Default users can only chat in the workspaces they have been added to. Multi-user mode cannot be switched back to single-user mode, so plan this before you start.
Add a document-based chatbot to your website
In the Docker version, create an embedded chat widget based on a workspace and choose Query mode so it only answers from that workspace's documents. Set the allowed domains and the maximum chats per day or per session. Then paste the script tag AnythingLLM gives you into your site's HTML.