#76 · Primary category: AI Chatbots

web-llm-chat

ai chat chat-application chatbot chatgpt gemma generative-ai hermes large-language-models llama llm mistral nextjs phi2 privacy qwen redpajama tinyllama webgpu

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Project last updated:02/18/26

GitHub Stars

1.1K

Forks

228

Contributors

213

License

Apache-2.0

Why we included this project

This chat interface runs LLMs natively in the browser with WebGPU, so your conversations and data never leave the machine. That matters for developers who need a private, offline-capable demo or an internal assistant that doesn't send prompts to a third-party server. It also accepts image uploads for vision models, renders markdown, and lets you plug in custom models through the MLC-LLM REST endpoint, which makes it a handy testbed for browser-based inference. If you're evaluating WebLLM or WebGPU performance, it's a useful reference for how a polished chat UI connects to the underlying engine.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category