vit-pytorch 1.6.5


Vision Transformer (ViT) - Pytorch

Vision Transformer (ViT) - Pytorch

Stars: 17745, Watchers: 17745, Forks: 2747, Open Issues: 119

The lucidrains/vit-pytorch repo was created 3 years ago and the last code push was 2 weeks ago.
The project is extremely popular with a mindblowing 17745 github stars!

How to Install vit-pytorch

You can install vit-pytorch using pip

pip install vit-pytorch

or add it to a project with poetry

poetry add vit-pytorch

Package Details

Phil Wang
GitHub Repo:


  • Scientific/Engineering/Artificial Intelligence
No  vit-pytorch  pypi packages just yet.


A list of common vit-pytorch errors.

Code Examples

Here are some vit-pytorch code examples and snippets.

GitHub Issues

The vit-pytorch package has 119 open issues on GitHub

  • MAE using pretrained VIT
  • How to get the feature map of the vit encoder
  • Fine-tuning without loading position embedding from pre-trained model
  • Vit MAE reconstruction size mismatch
  • where is the tks
  • Training in cifar100
  • Hot to get the features and positional embeddig information
  • mae output normal size images
  • Any chance to have conda installation?
  • Some questions about decoder position embedding for masked tokens
  • MAE image recon
  • How to save and restore the parameters?

See more issues on GitHub

Related Packages & Articles

kornia 0.7.2

Open Source Differentiable Computer Vision Library for PyTorch

boxdetect 1.0.2

boxdetect is a Python package based on OpenCV which allows you to easily detect rectangular shapes like characters boxes on scanned forms.

pytorch-lightning 2.2.1

PyTorch Lightning is the lightweight PyTorch wrapper for ML researchers. Scale your models. Write less boilerplate.

mediapipe 0.10.11

MediaPipe is the simplest way for researchers and developers to build world-class ML solutions and applications for mobile, edge, cloud and the web.