Arxiv paper - BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing

In this episode, we discuss BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing by Jiacheng Chen, Ramin Mehran, Xuhui Jia, Saining Xie, Sanghyun Woo. BlenderFusion is a generative visual compositing framework that enables scene synthesis by segmenting inputs into editable 3D elements, editing them in Blender, and recomposing them with a generative compositor. The compositor uses a fine-tuned diffusion model trained with source masking and object jittering strategies for flexible and disentangled scene manipulation. This approach achieves superior performance in complex 3D-grounded visual editing and compositing tasks compared to prior methods.