Survey of transformers for vision, text, and audio
Survey of transformers for vision, text, and audio
A Survey of Transformers
arXiv paper abstract https://arxiv.org/abs/2106.04554
arXiv PDF paper https://arxiv.org/pdf/2106.04554.pdf
Transformers have achieved great success in … natural language processing, computer vision, and audio processing.
… a systematic and comprehensive literature review on these Transformer variants is still missing.
… we provide a comprehensive review of various X-formers.
… introduce the vanilla Transformer and then propose a new taxonomy of X-formers.
Next, we introduce the various X-formers from three perspectives: architectural modification, pre-training, and applications. …
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b
