Get 3D scene using 2D Gaussian surface elements to remove normal ambiguity with Dai

Get 3D scene using 2D Gaussian surface elements to remove normal ambiguity with Dai

High-quality Surface Reconstruction using Gaussian Surfels
arXiv paper abstract https://arxiv.org/abs/2404.17774
arXiv PDF paper https://arxiv.org/pdf/2404.17774

… propose … point-based representation, Gaussian surfels, to combine the advantages of the flexible optimization procedure in 3D Gaussian points and the surface alignment property of surfels.

This is achieved by directly setting the z-scale of 3D Gaussian points to 0, effectively flattening the original 3D ellipsoid into a 2D ellipse.

… By treating the local z-axis as the normal direction, it greatly improves optimization stability and surface alignment.

While the derivatives to the local z-axis computed from the covariance matrix are zero in this setting, … design a self-supervised normal-depth consistency loss to remedy this issue.

Monocular normal priors and foreground masks are incorporated to enhance the quality of the reconstruction, mitigating issues related to highlights and background.

… method demonstrates superior performance in surface reconstruction compared to state-of-the-art neural volume rendering and point-based rendering methods.

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website

LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b

Photo by Dan Paul on Unsplash

--

--

AI News Clips by Morris Lee: News to help your R&D

A computer vision consultant in artificial intelligence and related hitech technologies 37+ years. Am innovator with 66+ patents and ready to help a firm's R&D.