Identify regions in road image mentioned in sentence
Identify regions in road image mentioned in sentence
Grounding Linguistic Commands to Navigable Regions
arXiv paper abstract https://arxiv.org/abs/2112.13031v1
arXiv PDF paper https://arxiv.org/pdf/2112.13031v1.pdf
Humans have a natural ability to effortlessly comprehend linguistic commands such as “park next to the yellow sedan” and instinctively know which region of the road the vehicle should navigate.
… propose the novel task of Referring Navigable Regions (RNR), i.e., grounding regions of interest for navigation based on the linguistic command.
… introduce a new dataset, Talk2Car-RegSeg, which extends the existing Talk2car dataset with segmentation masks for the regions described by the linguistic commands.
… show superior performance over baselines on multiple evaluation metrics.
A downstream path planner generating trajectories based on RNR outputs confirms the efficacy of the proposed framework.
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b
