#145 · Primary category: Image Generation
blended-latent-diffusion
Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]
Project last updated:06/04/24
GitHub Stars
632
Forks
37
Contributors
1
License
MIT
Why we included this project
Blended Latent Diffusion is the official implementation of a SIGGRAPH 2023 paper that tackles a specific editing problem: changing one region of an image while leaving the rest untouched. You give it an image, a mask over the area you want to change, and a text prompt, and it regenerates only that masked region to match the prompt. The repo includes the original Latent Diffusion pipeline plus a Diffusers-based path that works with Stable Diffusion v2.1 and SDXL, so you can choose the backbone that fits your hardware. It also has a reconstruction step that restores the background after editing, which helps avoid the artifacts you often get with masked edits. This is research code, not a polished tool, so expect to adapt it, but it is a good reference point if you are building text-guided local editing or studying how latent-space diffusion handles masked regions.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
stable-diffusion-webui
Stable Diffusion web UI
ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
upscayl
🆙 Upscayl - #1 Free and Open Source AI Image Upscaler for Linux, MacOS and Windows.
InvokeAI
InvokeAI is a leading open-source creative engine for Stable Diffusion, offering an industry-leading web UI for generating and editing visual media.