Real-time 3D object detection on low CPU headsets
Real-time 3D object detection on low CPU headsets
Realtime 3D Object Detection for Headsets
arXiv paper abstract https://arxiv.org/abs/2201.08812v1
arXiv PDF paper https://arxiv.org/pdf/2201.08812v1.pdf
Mobile headsets should be capable of understanding 3D physical environments to offer a truly immersive experience for augmented/mixed reality (AR/MR).
However, their small form-factor and limited computation resources make it extremely challenging to execute in real-time 3D vision algorithms
… propose DeepMix, a mobility-aware, lightweight, and hybrid 3D object detection framework
… DeepMix intelligently combines edge-assisted 2D object detection and novel, on-device 3D bounding box estimations that leverage depth data captured by headsets.
… achieves 30 FPS (i.e., an end-to-end latency much lower than the 100 ms stringent requirement of interactive AR/MR).
… implement a prototype of DeepMix on Microsoft HoloLens … improves detection accuracy by 9.1–37.3% but also reduces end-to-end latency by 2.68- 9.15x …
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b
