Get 3D scene, segmentation, and scene completion from one image using 3D context with MonoScene
Get 3D scene, segmentation, and scene completion from one image using 3D context with MonoScene
MonoScene: Monocular 3D Semantic Scene Completion
arXiv paper abstract https://arxiv.org/abs/2112.00726
arXiv PDF paper https://arxiv.org/pdf/2112.00726.pdf
Twitter video https://twitter.com/AnhQuanCAO/status/1542072248147795968
Online demo https://huggingface.co/spaces/CVPR/MonoScene
GitHub https://github.com/cv-rits/MonoScene
Project page https://cv-rits.github.io/MonoScene
MonoScene proposes a 3D Semantic Scene Completion (SSC) framework, where the dense geometry and semantics of a scene are inferred from a single monocular RGB image.
Different from the SSC literature, relying on 2.5 or 3D input, … solve the complex problem of 2D to 3D scene reconstruction while jointly inferring its semantics.
… framework relies on successive 2D and 3D UNets bridged by a novel 2D-3D features projection inspiring from optics and introduces a 3D context relation prior to enforce spatio-semantic consistency.
… show … outperform the literature on all metrics and datasets while hallucinating plausible scenery even beyond the camera field of view …
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b
