#154 · Primary category： Inference & Local Deploy
dalai
The simplest way to run LLaMA on your local machine
Project last updated：06/18/24
GitHub Stars
12.9K
Forks
1.3K
Contributors
20
License
Other
Why we included this project
Dalai was one of the first tools that made LLaMA practical on a normal laptop, and it still works as a simple template for running a local model without touching low-level C++ builds. It wraps llama.cpp and alpaca.cpp behind a command-line interface, so a single npx command installs a quantized 7B or 13B model and a bundled web UI lets you chat with it. Developers can also use its JavaScript API and Socket.io endpoint to embed local inference in Node.js apps. The project runs on Linux, macOS, and Windows, and includes a Docker Compose setup for containerized deployment. If you want a minimal, self-contained way to experiment with LLaMA or Alpaca locally, this is a good starting point.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.