#186 · Primary category: Image Generation
parti-pytorch
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
Project last updated:12/08/23
GitHub Stars
537
Forks
25
Contributors
2
License
MIT
Why we included this project
Parti is Google's answer to diffusion-based text-to-image models: instead of denoising pixels, it treats image generation as an autoregressive sequence problem over discrete visual tokens. This repository reimplements that architecture from scratch in PyTorch, and it pairs the transformer with a ViT-based VQ-GAN VAE that comes with working training code, so you can trace the whole pipeline from image encoding to text-conditioned generation. The API is refreshingly direct: train the VAE, plug it into the Parti module, and call generate() with a list of captions to get PIL images, with classifier-free guidance exposed through a conditioning scale. Just know this is a research-oriented implementation, not a turnkey service; you'll need to bring your own dataset and training budget. It's a good fit if you want to compare autoregressive and diffusion approaches side by side, or poke at the architecture before committing to something bigger.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
stable-diffusion-webui
Stable Diffusion web UI
ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
upscayl
🆙 Upscayl - #1 Free and Open Source AI Image Upscaler for Linux, MacOS and Windows.
InvokeAI
InvokeAI is a leading open-source creative engine for Stable Diffusion, offering an industry-leading web UI for generating and editing visual media.