#136 · Primary category: LLM Application Frameworks
ollama4j
A simple Java library for interacting with Ollama server.
Project last updated:08/08/26
GitHub Stars
507
Forks
83
Contributors
32
License
MIT
Why we included this project
ollama4j is a plain Java wrapper around the Ollama server, so teams on the JVM can reach local language models without hand-rolling HTTP calls. It exposes typed methods for pulling models, running single-pass or multi-turn chats, streaming token output, and requesting embeddings, with built-in support for image inputs, tool or function calling, and MCP-based external tools. Because you run the Ollama server yourself, model traffic stays on your own hardware or a private endpoint while the rest of the application is ordinary Java. That makes it a practical choice for adding generative features to backend JVM services, where the alternative is maintaining REST glue against Ollama's raw API by hand. A type-safe options builder keeps request configuration readable, and hooks for timeouts, authentication, and logging leave the integration code tidy and easy to test.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform