#176 · Primary category: Image Generation
PITI
PITI: Pretraining is All You Need for Image-to-Image Translation
Project last updated:06/02/24
GitHub Stars
502
Forks
26
Contributors
3
License
MIT
Why we included this project
Most image-to-image translation models are built from scratch per task, but PITI argues that a model already pretrained on large-scale image data can adapt to tasks like turning masks or sketches into full images with very little extra training. The repository provides the official PyTorch implementation from the 2022 paper, including pretrained Base and Upsample checkpoints trained on COCO, so you can reproduce the results or swap in your own conditioning inputs. There is also an online demo to try before you set up the environment. It reads as a reference implementation for researchers and ML engineers interested in how far general image pretraining can carry a specialized synthesis task, rather than a polished end-user tool, but the setup is clean enough for quick experiments once you have the checkpoints downloaded.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
stable-diffusion-webui
Stable Diffusion web UI
ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
upscayl
🆙 Upscayl - #1 Free and Open Source AI Image Upscaler for Linux, MacOS and Windows.
InvokeAI
InvokeAI is a leading open-source creative engine for Stable Diffusion, offering an industry-leading web UI for generating and editing visual media.