#445 · Primary category: Education & Research
handy-ollama
动手学Ollama,CPU玩转大模型部署,在线阅读地址:https://datawhalechina.github.io/handy-ollama/
Project last updated:01/15/26
GitHub Stars
2.5K
Forks
315
Contributors
17
License
Other
Why we included this project
Most open-source LLMs assume you have a GPU to run them, which rules out a lot of ordinary laptops and desktops. This Chinese-first tutorial closes that gap with Ollama: it covers installing the tool on macOS, Windows, Linux, or Docker, importing GGUF and Safetensors weights, defining custom prompts, and calling the REST API from Python, Java, JavaScript, or C++ code. Later chapters get into real integration, wiring Ollama into LangChain and building RAG and agent examples with FastAPI and WebUI front ends. The project also carries some institutional weight, since the Ollama team listed it as the reference tutorial in their own repository. It is documentation and sample code rather than something you deploy directly, so treat it as a learning resource, but one full of concrete commands that suit teams prototyping local inference on modest hardware.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
JavaGuide
Java Interview & Backend General Interview Guide, covering computer fundamentals, databases, distributed systems, high concurrency, system design, and AI application development.
system-prompts-and-models-of-ai-tools
A curated collection of system prompts, internal tools, and AI models from popular AI assistants and coding agents.
30-seconds-of-code
Coding articles to level up your development skills
generative-ai-for-beginners
21 Lessons, Get Started Building with Generative AI