#168 · Primary category: Image Generation
ziplora-pytorch
Implementation of "ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs"
Project last updated:12/27/23
GitHub Stars
565
Forks
37
Contributors
6
License
MIT
Why we included this project
ZipLoRA is a method for merging two separately trained LoRAs, so you can combine a specific subject with a particular art style in one model. This repo is a working PyTorch implementation built around Stable Diffusion XL, and it covers the whole flow: fine-tune two independent LoRAs, train the merged ZipLoRA, then run inference by injecting the combined weights into the UNet. The code is set up for real use rather than just reproducing the paper, with ready-to-run accelerate training scripts, a Gradio interface for quick experiments, and a memory-saving flag for when VRAM is tight. If you are experimenting with LoRA composition for image generation, this is a solid reference for adapting the technique to your own models and data.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
stable-diffusion-webui
Stable Diffusion web UI
ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
upscayl
🆙 Upscayl - #1 Free and Open Source AI Image Upscaler for Linux, MacOS and Windows.
InvokeAI
InvokeAI is a leading open-source creative engine for Stable Diffusion, offering an industry-leading web UI for generating and editing visual media.