#176 · Primary category: Image Generation

PITI

computer-vision image-generation image-synthesis image-to-image-translation pretraining

PITI: Pretraining is All You Need for Image-to-Image Translation

Project last updated:06/02/24

GitHub Stars

502

Forks

26

Contributors

3

License

MIT

Why we included this project

Most image-to-image translation models are built from scratch per task, but PITI argues that a model already pretrained on large-scale image data can adapt to tasks like turning masks or sketches into full images with very little extra training. The repository provides the official PyTorch implementation from the 2022 paper, including pretrained Base and Upsample checkpoints trained on COCO, so you can reproduce the results or swap in your own conditioning inputs. There is also an online demo to try before you set up the environment. It reads as a reference implementation for researchers and ML engineers interested in how far general image pretraining can carry a specialized synthesis task, rather than a polished end-user tool, but the setup is clean enough for quick experiments once you have the checkpoints downloaded.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category