Get optical flow and object orientation even with lighting changes with INV-Flow2PoseNet

Get optical flow and object orientation even with lighting changes with INV-Flow2PoseNet

INV-Flow2PoseNet: Light-Resistant Rigid Object Pose from Optical Flow of RGB-D Images using Images, Normals and Vertices
arXiv paper abstract https://arxiv.org/abs/2209.06562v1
arXiv PDF paper https://arxiv.org/pdf/2209.06562v1.pdf

… presents a novel architecture for simultaneous estimation of highly accurate optical flows and rigid scene transformations for difficult scenarios where the brightness assumption is violated by strong shading changes.

… standard methods for calculating optical flows or poses are based on the expectation that the appearance of features in the scene remain constant between views.

… presented method fuses texture and geometry information by combining image, vertex and normal data to compute an illumination-invariant optical flow.

By using a coarse-to-fine strategy, globally anchored optical flows are learned, reducing the impact of erroneous shading-based pseudo-correspondences.

Based on the learned optical flows, a second architecture is proposed that predicts robust rigid transformations from the warped vertex and normal maps.

… method has been evaluated on a newly created dataset containing both synthetic and real data with strong rotations and shading effects …

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website

LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b

Photo by David von Diemar on Unsplash

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
AI News Clips by Morris Lee: News to help your R&D

I apply innovative technologies like machine learning, computer vision, and physics to further an organization's goals. Am recognized innovator with 66 patents.