#111 · Primary category: AI Chatbots

llama-gpt

ai chatgpt code-llama codellama gpt gpt-4 gpt4all llama llama-2 llama-cpp llama2 llamacpp llm localai openai self-hosted

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Project last updated:04/23/24

GitHub Stars

10.9K

Forks

706

Contributors

96

License

MIT

Why we included this project

LlamaGPT is a self-hosted chatbot that runs entirely on hardware you control. It bundles a web chat interface with Llama 2 and Code Llama models, so your conversations stay local. It installs on umbrelOS home servers, Apple Silicon Macs, Docker, and Kubernetes, and also exposes an OpenAI-compatible API that lets existing clients talk to the local endpoint without rework. For teams that need privacy but want a familiar ChatGPT-style experience, it's a straightforward way to get a private assistant, with Nvidia GPU support available when you need more compute.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category