Pure ImageNet1k pre-trained ViT model

[jasonseu]

Hi, the weights of vision transformer models, like vit_small_patch16_224, vit_base_patch16_224, are all trained on ImageNet21k and then fine-tuned on ImageNet1k. Are weights trained purely on ImageNet1k for these models available?

[rwightman]

#1400