#18 · Primary category: 3D Generation & Asset Creation

Make-It-3D

3d-generation 3d-vision computer-vision deep-learning diffusion-models generative-art nerf

[ICCV 2023] Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior

Project last updated:07/05/24

GitHub Stars

1.9K

Forks

135

Contributors

2

License

Other

Why we included this project

Make-It-3D produces a full 360-degree textured 3D model from a single photograph, which makes it a useful reference for anyone in game art or product visualization who needs an asset when only one view exists. The two-stage pipeline first fits a neural radiance field under the frontal view, then converts the coarse result into textured point clouds, while a pretrained 2D diffusion model fills in plausible geometry and texture for the angles the camera never saw. The repo ships the training code for both stages and the test data behind the paper's results, so you can reproduce the outputs instead of trusting the teaser GIFs. Just plan for a fiddly environment: it wants CUDA-specific PyTorch, tiny-cuda-nn, and external tools like Stable Diffusion, DPT, SAM, and BLIP2. The codebase also works well as a base to extend, and since it draws on Stable-Dreamfusion, it is a handy comparison point in the diffusion-based 3D literature.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category