TY - GEN
T1 - Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis
AU - Sun, Yipengjing
AU - Zhang, Shengping
AU - Wang, Chenyang
AU - Zheng, Shunyuan
AU - Li, Zonglin
AU - Ji, Xiangyang
N1 - Publisher Copyright:
© 2026 Copyright held by the owner/author(s).
PY - 2026/7/19
Y1 - 2026/7/19
N2 - We propose GRGS, a generalizable and relightable 3D Gaussian framework for high-fidelity human novel view synthesis under diverse lighting conditions. Unlike existing methods that rely on per-character optimization or ignore physical constraints, GRGS adopts a feed-forward, fully supervised strategy projecting geometry, material, and illumination cues from multi-view 2D observations into 3D Gaussian representations. To recover accurate geometry under diverse lighting conditions that supports the relighting process, we introduce a Lighting-robust Geometry Recovery (LGR) module trained on synthetically relit data to predict precise depth and surface normals. Based on these geometry estimates, a Physically Grounded Neural Rendering (PGNR) module is further proposed to integrate neural prediction with physics-based shading, supporting editable relighting with shadows and indirect illumination. Moreover, we design a 2D-to-3D projection training scheme leveraging differentiable supervision from ambient occlusion, direct, and indirect lighting maps, alleviating the computational cost of explicit ray tracing. Extensive experiments demonstrate that GRGS achieves superior visual quality, geometric consistency, and generalization across characters and lighting conditions.
AB - We propose GRGS, a generalizable and relightable 3D Gaussian framework for high-fidelity human novel view synthesis under diverse lighting conditions. Unlike existing methods that rely on per-character optimization or ignore physical constraints, GRGS adopts a feed-forward, fully supervised strategy projecting geometry, material, and illumination cues from multi-view 2D observations into 3D Gaussian representations. To recover accurate geometry under diverse lighting conditions that supports the relighting process, we introduce a Lighting-robust Geometry Recovery (LGR) module trained on synthetically relit data to predict precise depth and surface normals. Based on these geometry estimates, a Physically Grounded Neural Rendering (PGNR) module is further proposed to integrate neural prediction with physics-based shading, supporting editable relighting with shadows and indirect illumination. Moreover, we design a 2D-to-3D projection training scheme leveraging differentiable supervision from ambient occlusion, direct, and indirect lighting maps, alleviating the computational cost of explicit ray tracing. Extensive experiments demonstrate that GRGS achieves superior visual quality, geometric consistency, and generalization across characters and lighting conditions.
UR - https://www.scopus.com/pages/publications/105046308010
U2 - 10.1145/3799902.3811132
DO - 10.1145/3799902.3811132
M3 - 会议稿件
AN - SCOPUS:105046308010
T3 - Proceedings - SIGGRAPH 2026 Conference Papers
BT - Proceedings - SIGGRAPH 2026 Conference Papers
A2 - Spencer, Stephen N.
PB - Association for Computing Machinery, Inc
T2 - Conference Papers, SIGGRAPH 2026
Y2 - 19 July 2026 through 23 July 2026
ER -