#146 · Primary category: Inference & Local Deploy
ComfyUI-MultiGPU
ComfyUI custom nodes for virtual VRAM offloading and multi-GPU distribution of UNet/CLIP/VAE layers, boosting latent space capacity and inference efficiency.
Project last updated:05/08/26
GitHub Stars
972
Forks
78
Contributors
8
License
GPL-3.0
Why we included this project
This set of ComfyUI custom nodes helps when your GPU runs out of VRAM on larger image latents or longer video generations. Instead of loading the full UNet, CLIP, and VAE on your main compute card, it moves static model components onto system RAM or a second GPU, so the freed memory goes to actual computation. A single virtual-VRAM slider handles the offload automatically for casual use, while expert modes let you assign exact byte or ratio allocations across devices. It supports both standard .safetensors checkpoints and GGUF-quantized GGML models, and it ships dedicated multi-GPU nodes for WanVideoWrapper pipelines. Dual-GPU owners and people pushing high-resolution video work get the most out of it, but the CPU-RAM donor path also helps anyone stuck on a single card with limited video memory.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.