Get 3D scene geometry and segmentation from a single RGB image
Get 3D scene geometry and segmentation from a single RGB image
Panoptic 3D Scene Reconstruction From a Single RGB Image
arXiv paper abstract https://arxiv.org/abs/2111.02444#
arXiv PDF paper https://arxiv.org/pdf/2111.02444.pdf
Understanding 3D scenes … from a single RGB image tend to focus on geometric reconstruction only, or geometric reconstruction with semantic segmentation or instance segmentation.
… propose to unify the tasks of geometric reconstruction, 3D semantic segmentation, and 3D instance segmentation into the task of
panoptic 3D scene reconstruction — from a single RGB image, predicting the complete geometric reconstruction of the scene in the camera frustum of the image, along with semantic and instance segmentations.
… learns to lift and propagate 2D features from an input image to a 3D volumetric scene representation.
… holistic view of joint scene reconstruction, semantic, and instance segmentation is beneficial over treating the tasks independently, thus outperforming alternative approaches
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b
