#32 · Primary category: 3D Generation & Asset Creation

Paint3D

diffusion-models generative-ai generative-model stable-diffusion texture texture-synthesis

[CVPR 2024] Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models, a no lighting baked texture generative model

Project last updated:11/05/24

GitHub Stars

809

Forks

44

Contributors

4

License

Apache-2.0

Why we included this project

Paint3D tackles a genuinely awkward part of 3D asset work: taking an untextured mesh and giving it a clean 2K UV texture from a text prompt or a reference image. Its two-stage pipeline starts with a depth-aware diffusion model that paints views of the object and fuses them into a rough texture, then hands off to dedicated UV inpainting and UVHD models that fill the gaps and remove baked-in lighting. What comes out is a lighting-less albedo map, so you can re-light and re-edit it in a normal graphics pipeline instead of fighting pre-baked illumination. That makes it useful for game assets and product visualization, where baked light tends to be a liability. The repo includes the pipeline scripts and a ComfyUI node, so teams can test the approach on their own meshes without rebuilding the framework.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category