Image super-resolution by fusing strengths of CNN and transformer with CRAFT

--

Image super-resolution by fusing strengths of CNN and transformer with CRAFT

Feature Modulation Transformer: Cross-Refinement of Global Representation via High-Frequency Prior for Image Super-Resolution
arXiv paper abstract https://arxiv.org/abs/2308.05022
arXiv PDF paper https://arxiv.org/pdf/2308.05022.pdf

Transformer-based methods have … remarkable potential in single image super-resolution (SISR) by effectively extracting long-range dependencies.

… most … research … has prioritized the design of transformer … to capture global information, while overlooking the importance of incorporating high-frequency priors

… found that transformer structures are more adept at capturing low-frequency information, but have limited capacity in constructing high-frequency representations … compared to their convolutional counterparts.

… proposed solution, the cross-refinement adaptive feature modulation transformer (CRAFT), integrates the strengths of both convolutional and transformer structures.

It comprises three key components: the high-frequency enhancement residual block (HFERB) for extracting high-frequency information, the shift rectangle window attention block (SRWAB) for capturing global information, and the hybrid fusion block (HFB) for refining the global representation.

… experiments on multiple datasets demonstrate that CRAFT outperforms state-of-the-art methods … while using fewer parameters …

Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website

LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b

Photo by Maria Carrasco on Unsplash

--

--

AI News Clips by Morris Lee: News to help your R&D
AI News Clips by Morris Lee: News to help your R&D

Written by AI News Clips by Morris Lee: News to help your R&D

A computer vision consultant in artificial intelligence and related hitech technologies 37+ years. Am innovator with 66+ patents and ready to help a firm's R&D.

No responses yet