GAUDI: A Neural Architect for Immersive 3D Scene Generation

GAUDI: A Neural Architect for
Immersive 3D Scene Generation

GitHub – apple/ml-gaudi

“We introduce GAUDI, a generative model that captures the distribution of 3D scenes parametrized as radiance fields.

We decompose generative model in two steps: (i) Optimizing a latent representation of 3D radiance fields and corresponding camera poses. (ii) Learning a powerful score based generative model on latent space.

GAUDI obtains state-of-the-art performance accross multiple datasets for unconditional generation and enables conditional generation of 3D scenes from different modalities like text or RGB images…”

Code: github.com/apple/ml-gaudi

Paper: https://arxiv.org/pdf/2207.13751.pdf