Skip to content
JenniResearchInteractive previewWrite with Jenni
RESEARCH AUTHOR

Alexey Dosovitskiy

Alexey Dosovitskiy is a credited coauthor of “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale”. Explore the papers, research findings, and collaborators represented in this collection.

Computer vision

Papers & publications

1 in this collection

Read the original papers, explore an overview, and collect ideas for your own research.

EXPLORE THE WORK

Research in focus

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Images are divided into fixed-size patches and encoded as sequences. The model is pretrained on large datasets and fine-tuned on image classification tasks.

  • Image patches can serve as the input tokens of a Transformer.
  • Large-scale pretraining is central to the reported performance.
  • The learned representations transfer to several image recognition benchmarks.

Reading context: The strong results depend on the training-data regime. They should not be read as a universal advantage over convolutional models on small datasets.

Read the original on arXiv ↗