#152 · Primary category: Image Generation

blended-diffusion

blended-diffusion deep-learning diffusion multimodal openai openai-clip text-guided-manipulation text-to-image

Official implementation for "Blended Diffusion for Text-driven Editing of Natural Images" [CVPR 2022]

Project last updated:06/04/24

GitHub Stars

589

Forks

42

Contributors

1

License

MIT

Why we included this project

Blended Diffusion is the official implementation of a CVPR 2022 paper that introduced a way to edit just one region of a photo using a text prompt. You give it an image, a mask over the area you want to change, and a short description; a CLIP model guides a diffusion process so only that masked region is regenerated, leaving the rest of the photo intact. That makes it a useful reference for anyone building or studying image-editing systems where background fidelity matters. The repo includes a working command-line interface, pretrained checkpoints, and example scripts for common edits like adding an object, replacing one, swapping the background, or extrapolating the image. The README also points to the follow-up Blended Latent Diffusion, which runs faster and produces better results, so this is a good starting point before moving on to that.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category