#171 · Primary category: Inference & Local Deploy

FreedomGPT

electron gpt llm react

This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface

Project last updated:06/13/24

GitHub Stars

2.7K

Forks

363

Contributors

2

License

GPL-3.0

Why we included this project

This desktop app runs the FreedomGPT model on your own machine, so your prompts never leave your Mac or Windows computer. It wraps a llama.cpp runtime in an Electron and React chat interface, giving you a familiar chat window without any of the inference happening over the network. Setup is deliberately hands-on: you compile the local binary yourself and point the app at model files you've downloaded, which appeals to people who like understanding what's under the hood rather than installing a black box. That's also what makes it attractive for teams with data-residency or privacy rules, since no conversation data has to leave the device. Just be aware it's a small project with a couple of maintainers, so treat it as a solid base to build on rather than software that's evolving quickly.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category