Get many 3D object shapes using SAM, 3DGS, Stabled Diffusion, and SuGaR with OMEGAS
Get many 3D object shapes using SAM, 3DGS, Stabled Diffusion, and SuGaR with OMEGAS
OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentation
arXiv paper abstract https://arxiv.org/abs/2404.15891
arXiv PDF paper https://arxiv.org/pdf/2404.15891.pdf
GitHub https://github.com/CrystalWlz/OMEGAS
… delve into … 3D reconstruction of specific objects within large scenes and propose … OMEGAS: Object Mesh Extraction from Large Scenes Guided by GAussian Segmentation.
OMEGAS employs a multi-step approach … initially… utilize the Segment Anything Model (SAM) to guide the segmentation of 3D Gaussian Splatting (3DGS), thereby creating a basic 3DGS model of the target object.
… leverage large-scale diffusion priors to … refine the details of the 3DGS model, especially aimed at addressing invisible or occluded object portions from the original scene views.
… by re-rendering the 3DGS model onto the scene views, … achieve accurate object segmentation and effectively remove the background.
Finally, these target-only images are used to improve the 3DGS model further and extract the definitive 3D object mesh by the SuGaR model.
… experiments demonstrate that OMEGAS significantly surpasses existing scene reconstruction methods …
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b
