Get 3D models of objects in scene from multiple images without labeling by using NeRF with ONeRF

Get 3D models of objects in scene from multiple images without labeling by using NeRF with ONeRF

ONeRF: Unsupervised 3D Object Segmentation from Multiple Views
arXiv paper abstract https://arxiv.org/abs/2211.12038
arXiv PDF paper https://arxiv.org/pdf/2211.12038.pdf

… present ONeRF, a method that automatically segments and reconstructs object instances in 3D from multi-view RGB images without any additional manual annotations.

The segmented 3D objects are represented using separate Neural Radiance Fields (NeRFs) which allow for various 3D scene editing and novel view rendering.

At the core of … method is an unsupervised approach using the iterative Expectation-Maximization algorithm, which effectively aggregates 2D visual features and the corresponding 3D cues from multi-views for joint 3D object segmentation and reconstruction.

Unlike existing approaches that can only handle simple objects, … method produces segmented full 3D NeRFs of individual objects with complex shapes, topologies and appearance.

The segmented ONeRfs enable a range of 3D scene editing, such as object transformation, insertion and deletion.

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website

LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b

Photo by Bohdan Stocek on Unsplash

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
AI News Clips by Morris Lee: News to help your R&D

I apply innovative technologies like machine learning, computer vision, and physics to further an organization's goals. Am recognized innovator with 66 patents.