#145 · Primary category: Image Generation

blended-latent-diffusion

computer-vision deep-learning diffusion diffusion-models generative-model image-generation multimodal multimodal-deep-learning pytorch text-driven-editing text-guided-manipulation text-to-image text-to-image-synthesis

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]

Project last updated:06/04/24

GitHub Stars

632

Forks

37

Contributors

1

License

MIT

Why we included this project

Blended Latent Diffusion is the official implementation of a SIGGRAPH 2023 paper that tackles a specific editing problem: changing one region of an image while leaving the rest untouched. You give it an image, a mask over the area you want to change, and a text prompt, and it regenerates only that masked region to match the prompt. The repo includes the original Latent Diffusion pipeline plus a Diffusers-based path that works with Stable Diffusion v2.1 and SDXL, so you can choose the backbone that fits your hardware. It also has a reconstruction step that restores the background after editing, which helps avoid the artifacts you often get with masked edits. This is research code, not a polished tool, so expect to adapt it, but it is a good reference point if you are building text-guided local editing or studying how latent-space diffusion handles masked regions.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category