Better predict future scene segmentation having overlapping objects with psf-diffattn
Better predict future scene segmentation having overlapping objects with psf-diffattn
Joint Forecasting of Panoptic Segmentations with Difference Attention
arXiv paper abstract https://arxiv.org/abs/2204.07157v1
arXiv PDF paper https://arxiv.org/pdf/2204.07157v1.pdf
Forecasting of a representation is important for safe and effective autonomy.
For this, panoptic segmentations have been studied as a compelling representation in recent work.
However, recent state-of-the-art on panoptic segmentation forecasting suffers from two issues … first, individual object instances are treated independently … second, individual object instance forecasts are merged in a heuristic manner.
To address both issues … study a new panoptic segmentation forecasting model that jointly forecasts all object instances in a scene using a transformer model based on ‘difference attention.’
It further refines the predictions by taking depth estimates into account.
… attain state-of-the-art on panoptic segmentation forecasting metrics.
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b
