Reconstruct 3D unknown object from a single view by mapping image to points with ZeroMesh
Reconstruct 3D unknown object from a single view by mapping image to points with ZeroMesh
ZeroMesh: Zero-shot Single-view 3D Mesh Reconstruction
arXiv paper abstract https://arxiv.org/abs/2208.02676v1
arXiv PDF paper https://arxiv.org/pdf/2208.02676v1.pdf
Single-view 3D object reconstruction is a fundamental and challenging computer vision task that aims at recovering 3D shapes from single-view RGB images.
Most … deep learning based … methods … cannot work well when handling objects from novel categories that are not seen during training.
… propose an end-to-end two-stage network, ZeroMesh, to break the category boundaries in reconstruction.
… factorize the complicated image-to-mesh mapping into … image-to-point mapping and point-to-mesh mapping, while the latter is … less dependent on object categories.
… devise a local feature sampling strategy in 2D and 3D feature spaces to capture the local geometry shared across objects
… method significantly outperforms the existing works on the ShapeNet and Pix3D under different scenarios and various metrics, especially for novel objects.
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b