#328 · Primary category: Computer Vision

daclip-uir

all-in-one-image-restoration deep-learning diffusion-models face-inpainting image-deblurring image-dehazing image-denoising image-deraining image-desnowing image-restoration jpeg-artifacts-removal low-level-vision low-light-image-enhancement prompt pytorch shadow-removal vision-language

[ICLR 2024] Controlling Vision-Language Models for Universal Image Restoration. 5th place in the NTIRE 2024 Restore Any Image Model in the Wild Challenge.

Project last updated:08/07/24

GitHub Stars

816

Forks

51

Contributors

2

License

MIT

Why we included this project

DA-CLIP tackles the messy reality that most image restoration tools handle one problem at a time. Instead of training separate networks for blur, haze, noise, rain, snow, low light, JPEG artifacts, and shadows, it uses a single model that first figures out what is wrong with an image, then runs a diffusion-based pipeline to fix it. The repo includes pretrained weights, a Gradio app for testing your own photos, and Colab and Hugging Face demos, so you can see how it behaves on real images before investing in training. The ICLR 2024 paper and the follow-up wild-IR model, aimed at real-world mixed degradations, make it a solid baseline and a useful starting point for extending restoration to new distortion types.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category