GitHub Repo · Local & Private AI
AnythingLLM
All-in-one desktop and server app to chat with your documents privately.
What AnythingLLM does
AnythingLLM is a desktop app or self-hosted server that lets you chat with PDFs, docs and websites using local or cloud models, with workspaces, agents and an embeddable website chat widget.
Best for
- Non-technical document chat
- Private knowledge bases
- Website chat widgets
How small businesses use AnythingLLM
- Ask questions across your policy manuals
- Build a support bot from your FAQ
- Keep client documents on your own computer
AnythingLLM: common questions
Who should use AnythingLLM?
AnythingLLM suits non-technical document chat, private knowledge bases and website chat widgets.
When should you choose something else instead of AnythingLLM?
Answers from local models are only as good as the model your computer can run. If that matters for your business, compare other options such as Ollama, Jan and Open WebUI.
Is AnythingLLM free?
AnythingLLM pricing: Free and open source; hosted option. Pricing changes often, so confirm current plans on the official repository or website before you buy.
Can a small business self-host AnythingLLM?
Yes. AnythingLLM is open source on GitHub, and its setup level is beginner. You will need a computer or server to run it and someone to keep it updated and backed up, or you can use a hosted option if one is offered.
Featured in these guides
- How to Run Private AI on Your Own Computer (Small Business Guide)Best for chatting with documents
Other options in Local & Private AI
Run open AI models like Llama, Gemma and Qwen on your own computer.
A desktop app that runs AI models offline on your own computer.
A ChatGPT-style interface for local and cloud models, self-hosted.
Fast local inference engine for open language models.
A self-hosted, OpenAI-compatible server for text, image and voice models.