CVPR 2023 - MobileNeRF: Exploiting the Polygon Rasterization Pipeline

In this episode we discuss MobileNeRF: Exploiting the Polygon Rasterization Pipeline by Authors: - Zhiqin Chen - Thomas Funkhouser - Peter Hedman - Andrea Tagliasacchi Affiliations: - Zhiqin Chen: 1,2 - Thomas Funkhouser: 1 - Peter Hedman: 1 - Andrea Tagliasacchi: 1,2,3 1: Google Research 2: Simon Fraser University 3: University of Toronto. The paper introduces a new representation for Neural Radiance Fields (NeRFs) based on textured polygons that can synthesize novel images efficiently with standard rendering pipelines. This approach enables NeRFs to be rendered with the traditional polygon rasterization pipeline, achieving interactive frame rates even on mobile devices. The NeRF is represented as a set of polygons with textures representing binary opacities and feature vectors interpreted by a small, view-dependent MLP running in a fragment shader to produce a final pixel color.