PhySG
| swMATH ID: | 43951 |
| Software Authors: | Zhang, Kai; Luan, Fujun; Wang, Qianqian; Bala, Kavita; Snavely, Noah |
| Description: | PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting. We present PhySG, an end-to-end inverse rendering pipeline that includes a fully differentiable renderer and can reconstruct geometry, materials, and illumination from scratch from a set of RGB input images. Our framework represents specular BRDFs and environmental illumination using mixtures of spherical Gaussians, and represents geometry as a signed distance function parameterized as a Multi-Layer Perceptron. The use of spherical Gaussians allows us to efficiently solve for approximate light transport, and our method works on scenes with challenging non-Lambertian reflectance captured under natural, static illumination. We demonstrate, with both synthetic and real data, that our reconstructions not only enable rendering of novel viewpoints, but also physics-based appearance editing of materials and illumination. |
| Homepage: | https://arxiv.org/abs/2104.00674 |
| Source Code: |
 https://github.com/Kai-46/PhySG
|
| Dependencies: | Python |
| Keywords: | Computer Vision; Pattern Recognition; arXiv_cs.CV |
| Related Software: | NeuS; NeRV; PatchMatch; NeRF; NeRF++; Adam; BARF; NeRFactor; Nerfies; DeCAF; MeshSDF; OpenGL; DVDnet; Pfinder; MOTS; StyleGAN2; ResMLP; BRISK; EfficientDet; Face2Face |
| Cited in: | 2 Documents |
all
top 5
Cited by 6 Authors
| 1 | Gong, Xu |
| 1 | He, Jiabin |
| 1 | Qin, Hongxing |
| 1 | Szeliski, Richard |
| 1 | Tang, Shu |
| 1 | Yang, Shuli |
Cited in 2 Serials
| 1 | Computer Aided Geometric Design |
| 1 | Texts in Computer Science |
Cited in 2 Fields
| 1 | Numerical analysis (65-XX) |
| 1 | Computer science (68-XX) |
