#104 · Primary category: Image Generation
LlamaGen
Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
Project last updated:08/15/24
GitHub Stars
2.0K
Forks
95
Contributors
5
License
MIT
Why we included this project
This research codebase argues that image generation can work much like language modeling: predict visual tokens one after another with a plain Llama-style architecture, no vision-specific inductive biases needed. LlamaGen ships the pieces to judge that claim yourself, two image tokenizers at downsample ratios 8 and 16, seven class-conditional generators from 100M to 3B parameters, and two text-conditional 700M models, along with PyTorch training and sampling code and a live Hugging Face demo. The released weights let you sample images directly, and inference is supported through vLLM, so you can compare its behavior with diffusion baselines without re-training. It is a research implementation rather than a turnkey production service, but that framing is part of the value: the paper, the weights, and the code together make it easy to study how autoregressive scaling holds up against diffusion.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
stable-diffusion-webui
Stable Diffusion web UI
ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
upscayl
🆙 Upscayl - #1 Free and Open Source AI Image Upscaler for Linux, MacOS and Windows.
InvokeAI
InvokeAI is a leading open-source creative engine for Stable Diffusion, offering an industry-leading web UI for generating and editing visual media.