Retrieve images having a region similar to what is highlighted in the query with VFS

Retrieve images having a region similar to what is highlighted in the query with VFS

Interactive Visual Feature Search
arXiv paper abstract https://arxiv.org/abs/2211.15060
arXiv PDF paper https://arxiv.org/pdf/2211.15060.pdf
GitHub https://github.com/lookingglasslab/VisualFeatureSearch

… Interactive visualizations can provide more rich insights and allow users to more easily explore a model’s behavior; however, they are typically not easily reusable and are specific to a particular model.

… introduce Visual Feature Search, a novel interactive visualization that is generalizable to any CNN and can easily be incorporated into a researcher’s workflow.

… tool allows a user to highlight an image region and search for images from a given dataset with the most similar CNN features.

It supports searching through large image datasets with an efficient cache-based search implementation.

… tool elucidates different aspects of model behavior by performing experiments on supervised, self-supervised, and human-edited CNNs.

… also release a portable Python library and several IPython notebooks to enable researchers to easily use … tool in their own experiments …

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website

LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b

Photo by Vasilina Sirotina on Unsplash

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
AI News Clips by Morris Lee: News to help your R&D

I apply innovative technologies like machine learning, computer vision, and physics to further an organization's goals. Am recognized innovator with 66 patents.