update azure paths of SimMIM ckpts (#334)

This commit is contained in:
Zhenda Xie 2023-08-16 15:52:45 +08:00 коммит произвёл GitHub
Родитель f92123a003
Коммит 2cb103f2de
Не найден ключ, соответствующий данной подписи
Идентификатор ключа GPG: 4AEE18F83AFDEB23
1 изменённых файлов: 63 добавлений и 63 удалений

Просмотреть файл

@ -79,69 +79,69 @@ Note: C24 means each head has 24 channels.
| name | model size | pre-train dataset | pre-train iterations | validation loss | fine-tuned acc@1 | pre-trained model | fine-tuned model |
| :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| SwinV2-Small | 49M | ImageNet-1K 10% | 125k | 0.4820 | 82.69 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper10_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper10_125k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 10% | 250k | 0.4961 | 83.11 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper10_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper10_250k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 10% | 500k | 0.5115 | 83.17 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper10_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper10_500k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 20% | 125k | 0.4751 | 83.05 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper20_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper20_125k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 20% | 250k | 0.4722 | 83.56 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper20_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper20_250k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 20% | 500k | 0.4734 | 83.75 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper20_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper20_500k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 50% | 125k | 0.4732 | 83.04 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper50_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper50_125k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 50% | 250k | 0.4681 | 83.67 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper50_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper50_250k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 50% | 500k | 0.4646 | 83.96 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper50_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper50_500k.pth) |
| SwinV2-Small | 49M | ImageNet-1K | 125k | 0.4728 | 82.92 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1k_125k.pth) |
| SwinV2-Small | 49M | ImageNet-1K | 250k | 0.4674 | 83.66 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1k_250k.pth) |
| SwinV2-Small | 49M | ImageNet-1K | 500k | 0.4641 | 84.08 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1k_500k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 10% | 125k | 0.4822 | 83.33 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper10_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper10_125k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 10% | 250k | 0.4997 | 83.60 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper10_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper10_250k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 10% | 500k | 0.5112 | 83.41 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper10_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper10_500k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 20% | 125k | 0.4703 | 83.86 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper20_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper20_125k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 20% | 250k | 0.4679 | 84.37 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper20_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper20_250k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 20% | 500k | 0.4711 | 84.61 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper20_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper20_500k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 50% | 125k | 0.4683 | 84.04 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper50_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper50_125k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 50% | 250k | 0.4633 | 84.57 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper50_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper50_250k.pth) |
| SwinV2-Base | 87M | ImageNet-1K 50% | 500k | 0.4598 | 84.95 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper50_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper50_500k.pth) |
| SwinV2-Base | 87M | ImageNet-1K | 125k | 0.4680 | 84.13 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1k_125k.pth) |
| SwinV2-Base | 87M | ImageNet-1K | 250k | 0.4626 | 84.65 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1k_250k.pth) |
| SwinV2-Base | 87M | ImageNet-1K | 500k | 0.4588 | 85.04 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1k_500k.pth) |
| SwinV2-Base | 87M | ImageNet-22K | 125k | 0.4695 | 84.11 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_22k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_22k_125k.pth) |
| SwinV2-Base | 87M | ImageNet-22K | 250k | 0.4649 | 84.57 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_22k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_22k_250k.pth) |
| SwinV2-Base | 87M | ImageNet-22K | 500k | 0.4614 | 85.11 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_22k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_22k_500k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 10% | 125k | 0.4995 | 83.69 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper10_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper10_125k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 10% | 250k | 0.5140 | 83.66 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper10_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper10_250k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 10% | 500k | 0.5150 | 83.50 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper10_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper10_500k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 20% | 125k | 0.4675 | 84.38 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper20_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper20_125k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 20% | 250k | 0.4746 | 84.71 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper20_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper20_250k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 20% | 500k | 0.4960 | 84.59 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper20_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper20_500k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 50% | 125k | 0.4622 | 84.78 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper50_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper50_125k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 50% | 250k | 0.4566 | 85.38 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper50_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper50_250k.pth) |
| SwinV2-Large | 195M | ImageNet-1K 50% | 500k | 0.4530 | 85.80 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper50_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper50_500k.pth) |
| SwinV2-Large | 195M | ImageNet-1K | 125k | 0.4611 | 84.98 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1k_125k.pth) |
| SwinV2-Large | 195M | ImageNet-1K | 250k | 0.4552 | 85.45 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1k_250k.pth) |
| SwinV2-Large | 195M | ImageNet-1K | 500k | 0.4507 | 85.91 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1k_500k.pth) |
| SwinV2-Large | 195M | ImageNet-22K | 125k | 0.4649 | 84.61 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_22k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_22k_125k.pth) |
| SwinV2-Large | 195M | ImageNet-22K | 250k | 0.4586 | 85.39 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_22k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_22k_250k.pth) |
| SwinV2-Large | 195M | ImageNet-22K | 500k | 0.4536 | 85.81 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_22k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_22k_500k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K 20% | 125k | 0.4789 | 84.35 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper20_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper20_125k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K 20% | 250k | 0.5038 | 84.16 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper20_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper20_250k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K 20% | 500k | 0.5071 | 83.44 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper20_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper20_500k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K 50% | 125k | 0.4549 | 85.09 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper50_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper50_125k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K 50% | 250k | 0.4511 | 85.64 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper50_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper50_250k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K 50% | 500k | 0.4559 | 85.69 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper50_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper50_500k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K | 125k | 0.4531 | 85.23 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1k_125k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K | 250k | 0.4464 | 85.90 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1k_250k.pth) |
| SwinV2-Huge | 655M | ImageNet-1K | 500k | 0.4416 | 86.34 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1k_500k.pth) |
| SwinV2-Huge | 655M | ImageNet-22K | 125k | 0.4564 | 85.14 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_22k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_22k_125k.pth) |
| SwinV2-Huge | 655M | ImageNet-22K | 250k | 0.4499 | 85.86 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_22k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_22k_250k.pth) |
| SwinV2-Huge | 655M | ImageNet-22K | 500k | 0.4444 | 86.27 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_22k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_22k_500k.pth) |
| SwinV2-giant | 1.06B | ImageNet-1K 50% | 125k | 0.4534 | 85.44 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1kper50_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1kper50_125k.pth) |
| SwinV2-giant | 1.06B | ImageNet-1K 50% | 250k | 0.4515 | 85.76 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1kper50_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1kper50_250k.pth) |
| SwinV2-giant | 1.06B | ImageNet-1K 50% | 500k | 0.4719 | 85.51 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1kper50_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1kper50_500k.pth) |
| SwinV2-giant | 1.06B | ImageNet-1K | 125k | 0.4513 | 85.57 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1k_125k.pth) |
| SwinV2-giant | 1.06B | ImageNet-1K | 250k | 0.4442 | 86.12 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1k_250k.pth) |
| SwinV2-giant | 1.06B | ImageNet-1K | 500k | 0.4395 | 86.46 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1k_500k.pth) |
| SwinV2-giant | 1.06B | ImageNet-22K | 125k | 0.4544 | 85.39 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_22k_125k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_22k_125k.pth) |
| SwinV2-giant | 1.06B | ImageNet-22K | 250k | 0.4475 | 85.96 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_22k_250k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_22k_250k.pth) |
| SwinV2-giant | 1.06B | ImageNet-22K | 500k | 0.4416 | 86.53 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_22k_500k.pth) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_22k_500k.pth) |
| SwinV2-Small | 49M | ImageNet-1K 10% | 125k | 0.4820 | 82.69 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper10_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=rXTxtlE2qpmleaA7aDL1vd08rUS49y%2BWfVRH0QDnGW8%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper10_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=AtTkwfKHMgIoLLR5%2FDOD%2FjisgGdr3mXphzs%2FHl3qIOw%3D) |
| SwinV2-Small | 49M | ImageNet-1K 10% | 250k | 0.4961 | 83.11 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper10_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=E%2FDwNSJY8eBf1MMGefXP4ezxz%2BYY0JamaiM%2Bagn8MjU%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper10_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=TqCXnkPZKkV01RLCWOT4tenitKXc5MZRD2KmBJ%2BOcjg%3D) |
| SwinV2-Small | 49M | ImageNet-1K 10% | 500k | 0.5115 | 83.17 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper10_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=yRPNulr2snWur5LddYDyNGsMwHptERdxqsarPxFmmFw%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper10_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=ofuzvDRgBzPVVUKOhpnk7M8nrv23pbH6fFy84FvonIA%3D) |
| SwinV2-Small | 49M | ImageNet-1K 20% | 125k | 0.4751 | 83.05 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=EKA1FFOpQ3WuUqbYIKByxoxSqN68sWI1rtxzGeaptYQ%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=oLDiI%2FzryhWIgIPFh56LNRmTZXk60tB%2BrqZH%2B46i3bk%3D) |
| SwinV2-Small | 49M | ImageNet-1K 20% | 250k | 0.4722 | 83.56 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=Ke5Gd%2FtUniL65%2B22T5phs%2B1XumLmwpTLKv8Gp7vrL50%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=mgqmeIwSTrh70pYLlJzqXn4frxu2%2Byd4iqhDvp6j28s%3D) |
| SwinV2-Small | 49M | ImageNet-1K 20% | 500k | 0.4734 | 83.75 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=tEYx2OY7NCLZc%2B5XVNvXjtVfO5ewWVz4%2BdGNVSL4kQI%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=HIDIZGlUP33dvqP5ZBeWJUJ%2FRN6fy1C95gFzYm1Fw3Q%3D) |
| SwinV2-Small | 49M | ImageNet-1K 50% | 125k | 0.4732 | 83.04 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=Le3l5pBwtpMziagsSVRLtD8taDYufht%2F64aGwxf2zwk%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=svD6hMSdcNiWhqlbDfJmv0bRkOCSYMTnm9UFl3k93HM%3D) |
| SwinV2-Small | 49M | ImageNet-1K 50% | 250k | 0.4681 | 83.67 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=SJz2RbYqIvLWSlndRkq%2FJN%2Fe%2FAXhQnQGoDYVnsXtSwU%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=JNAQ3OoNVC2gBpY9S7R9M8QNqd91%2B0Upqfc4JYQsfBQ%3D) |
| SwinV2-Small | 49M | ImageNet-1K 50% | 500k | 0.4646 | 83.96 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=gOd9zZV0nTobPQ4IzKNhW1n1kPqP879ohYgq%2FjaZKQ0%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=i6Kdc56%2Bw4drKf9TB%2BtVQNTaV8u6DdtAx5083xKtTXk%3D) |
| SwinV2-Small | 49M | ImageNet-1K | 125k | 0.4728 | 82.92 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=cExP4yaota0uKKJHS9Q2K2clftGSN06Nq%2FZVEFdMTn4%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=2ZMhU9bmjRNZssQvBFirxR5uOpfAt02UcD2laaZzYFM%3D) |
| SwinV2-Small | 49M | ImageNet-1K | 250k | 0.4674 | 83.66 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=Q6FcZwzHmdCA0Nv5a7EwUVpL4q1UInUkcAvgTXzFKBo%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=ipUAmhR1GonbiOQh7ejpa%2FbkyMxBWdejcSGMtxdJFxE%3D) |
| SwinV2-Small | 49M | ImageNet-1K | 500k | 0.4641 | 84.08 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_small_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=5qfMTWvxbFSAJ59aq8mzfoKOukj4AguuVTy7sjzYa8I%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_small_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=nFEi4B3XqEjsyXt9g%2BK2Eo7L8ANbQ1MJrkiJgM8%2B2ug%3D) |
| SwinV2-Base | 87M | ImageNet-1K 10% | 125k | 0.4822 | 83.33 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper10_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=IjKOUE7c29D%2F19ze5UElOyWSXgucBJfzUSWsO5CQX0Y%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper10_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=WCkhC1bgDmiw9TVPolyZi9DgcuF3R%2B%2FcjS5Se2GxA1A%3D) |
| SwinV2-Base | 87M | ImageNet-1K 10% | 250k | 0.4997 | 83.60 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper10_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=8G4nz8M6cw6d79WweJy1369Ss9h2km9fNNvZNfbQzZ0%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper10_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=YBn48mbIzWWhNGGdDnyqLv3%2F75OzjHa%2BipWDgkhqTA0%3D) |
| SwinV2-Base | 87M | ImageNet-1K 10% | 500k | 0.5112 | 83.41 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper10_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=GwVRSyiZAFetcaIgTcsNoGkhDKzIjqqTBW%2FGbXw9nN4%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper10_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=pALE5kiVVVfWGZBGLcfltEYcEIN8W72IwRciXY%2B0qK0%3D) |
| SwinV2-Base | 87M | ImageNet-1K 20% | 125k | 0.4703 | 83.86 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=u3vDfgmJaCJjXBr6bfkaxd8Q1pJ0ZJhzoiOSlLlTwDw%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=WEym8dYJ14dFnWzOLPDAxU2CjtleMhE1GvdYvxog62Y%3D) |
| SwinV2-Base | 87M | ImageNet-1K 20% | 250k | 0.4679 | 84.37 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=xTj%2BXHvOURw7JbhWACuyhlDmqTyLCDX6JxZ2V%2BGbMEA%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=8jaOADypPLzdS5PjLDVD8ObM5x7UbdyfwJaOrh1GZA8%3D) |
| SwinV2-Base | 87M | ImageNet-1K 20% | 500k | 0.4711 | 84.61 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=F%2FyOwNdHLbXxrJiFxrr4syoQwBSoIoNLtJF3g1Qxr5Y%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=pVbTQnKL1Lbiu3%2BAW09MI%2F1JhWni8ygfMziU%2BXs9EQ0%3D) |
| SwinV2-Base | 87M | ImageNet-1K 50% | 125k | 0.4683 | 84.04 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=RvkR35Hx8g8PIfHnZ3Zuu%2BsxNth0YNtLl7pdS7bE0IU%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=lHDX%2BNEchzaGbEVOUNJYJR5ppaI1vQNVjVB%2FHi%2B%2BbQ8%3D) |
| SwinV2-Base | 87M | ImageNet-1K 50% | 250k | 0.4633 | 84.57 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=UxlXT7dYKvHjreVZg4Bnt8HP3B3duJ%2FajQVbINeaMG0%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=bwgykdvMv%2F%2F9E3ReY68kuWvC10mFcorli6hTxJUOu48%3D) |
| SwinV2-Base | 87M | ImageNet-1K 50% | 500k | 0.4598 | 84.95 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=MC6KbiOjluRv8Zuk%2FxSIcJ4WEJRY31exrnTC54%2BS7HM%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=G6QfcT7meHopTbElfhy8Akfx8abVtFut7cT32YtG%2Bl0%3D) |
| SwinV2-Base | 87M | ImageNet-1K | 125k | 0.4680 | 84.13 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=tlZAGihRDHEjqyevi%2Bf4ICZnfFOvq%2BOtU0EAAaJBDDg%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=EAkmPK9jQRw4HpYIgvYoNUoaH7ONvxXPP9Vpp6vN8%2BA%3D) |
| SwinV2-Base | 87M | ImageNet-1K | 250k | 0.4626 | 84.65 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=HE8GqdS6f77UgPAXpDILd2gjvq5ctU7YqTVqmifkiTw%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=6I0SQBOr4QwGMeEE0Y7ArJvkpKlpVZGZOj1G3OwOZdA%3D) |
| SwinV2-Base | 87M | ImageNet-1K | 500k | 0.4588 | 85.04 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=HfaAkOBzD2yun0lAHD4XrOOV3JNXImG28986WvEaMws%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=DDEqtZTT0RYIZMm5rC2XvgSaw6OkdBoBQqGmqWzA5MQ%3D) |
| SwinV2-Base | 87M | ImageNet-22K | 125k | 0.4695 | 84.11 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=841Nnr1IjjVSESTCLmBnNFJ5VcMIiyRsaa6O%2F0ukkh4%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=VZQYKjfLwS6urPZwCLNn9rCkQpc77qrLthJT8CadOy8%3D) |
| SwinV2-Base | 87M | ImageNet-22K | 250k | 0.4649 | 84.57 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=A82jZZ4w29DnfaCJB%2B2zTDkWQWHiVcbCpXBUNzzUddo%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=%2BiDRRXsI6%2BF7nlp6FNhxz3sBbKGCHGSP03tv52hUte4%3D) |
| SwinV2-Base | 87M | ImageNet-22K | 500k | 0.4614 | 85.11 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_base_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=BmJvfC4vGYLTZAy85hI5oNh4GEeQpc2pDaqSLR0VwEE%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_base_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=cq20xc%2FX7QvwR8n9KjrZSDVJN1Vm0BVSjKKgmsqZ7P4%3D) |
| SwinV2-Large | 195M | ImageNet-1K 10% | 125k | 0.4995 | 83.69 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper10_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=mbOve3bxYb2GjsiGT1pC6LbCBJ8M5sSPN611R2XKtSc%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper10_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=H3eL1N4WDfIelKqHajNRuQVHEiZhhxYjjq8hFMuTXCI%3D) |
| SwinV2-Large | 195M | ImageNet-1K 10% | 250k | 0.5140 | 83.66 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper10_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=DFZwaoeJh23YeVMrCN5sKRBunfEiE%2FAClY8m7TXKY7E%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper10_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=kETvJHT3t%2FAEINFuFObUPxtDnXxV9%2BljmLUCX9xVvgk%3D) |
| SwinV2-Large | 195M | ImageNet-1K 10% | 500k | 0.5150 | 83.50 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper10_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=8xDZDu6SNdftyQd2XzpvdJuYuFJD%2BhdzbUaIjrz3C5U%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper10_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=tg0iSiIW03GdvcjLnR4kVjj9F0R%2FPFHQnhAqyks%2FOw8%3D) |
| SwinV2-Large | 195M | ImageNet-1K 20% | 125k | 0.4675 | 84.38 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=oRVvUvKt6quN1heKrnVabnEF9hl4c%2B6Oj4LtvZkHpFU%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=OilkoaLIv4wODhhdqVGCUnYusI8CJcWarF8kfbjvudA%3D) |
| SwinV2-Large | 195M | ImageNet-1K 20% | 250k | 0.4746 | 84.71 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=4%2BM%2FZmIwb64thVBARTMHS4WShGoz7LrKWgfn9BjG5kE%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=jDeD6z%2BPmrNaYjN%2FE1ayXNCx638GgnFjwOKNjooxvrk%3D) |
| SwinV2-Large | 195M | ImageNet-1K 20% | 500k | 0.4960 | 84.59 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=GikkdMGHdmBbojnObcpwwzqgxSdN46WOtWu6n2UCojY%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=2MR8UCb4ItNERmgwuAnujba2dMUJumdkqjP7yUQt88o%3D) |
| SwinV2-Large | 195M | ImageNet-1K 50% | 125k | 0.4622 | 84.78 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=iNUOXxM6uFaIQ8086J847c0Tq5nI8TSGpmMVqSN2KMw%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=%2FcpCcksyLOc2HZ7Uw8jJI8jrUqWemi8h0kGTpQuMsUE%3D) |
| SwinV2-Large | 195M | ImageNet-1K 50% | 250k | 0.4566 | 85.38 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=8u6Cq1VW2QG4znXObl9FLWMJe28uZk9WEBhgidOfIPY%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=KsreP3CFkZZMSS0XBDMIasdHeFhBY2Dh9hVitAI2JRY%3D) |
| SwinV2-Large | 195M | ImageNet-1K 50% | 500k | 0.4530 | 85.80 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=XaaR6cCiVbo0pv%2BBq%2FC%2Bc%2F%2BRyP87I74tZR%2FzswrI3yc%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=44L1vuPjTmJfgctqDUQrbjo1poMn5VHtYykTeFEOYhM%3D) |
| SwinV2-Large | 195M | ImageNet-1K | 125k | 0.4611 | 84.98 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=c5RyWvzQN%2FIeDT%2FG1L6vfsqkZ%2Fzf1MgfFFxRSQyeAds%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=RnxXZ2%2BzqCTXgds3leNl3jU2tA9h%2B4G7wMqyRs1GxcQ%3D) |
| SwinV2-Large | 195M | ImageNet-1K | 250k | 0.4552 | 85.45 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=KlJa%2Fr%2FgYUb5FUVzqrhgLWoVVt8onO7BI9Ix4lPbnXA%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=3lgMe6X6KHSjNObfMDz1JTslJUJ46erlviee7xbG%2BQI%3D) |
| SwinV2-Large | 195M | ImageNet-1K | 500k | 0.4507 | 85.91 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=jso8LU1ydHmReR2uU8N0qJDleioZO%2FxFjXMtECQaubc%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=fAzEtGJeAQD8msQ3fPUywLdx%2F94lmw2%2BeSP0IDwTuds%3D) |
| SwinV2-Large | 195M | ImageNet-22K | 125k | 0.4649 | 84.61 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=ll2efs6IXvMvt1OWCcADoMwHZiNOal5Ks1R6EugxMfg%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=f67qj62n8jxbqEJJvyaw%2BhcBxVFeB3AUmuPz7cQo7nc%3D) |
| SwinV2-Large | 195M | ImageNet-22K | 250k | 0.4586 | 85.39 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=a7n7ltzBiPoyQ1%2BSpDSWPeNrnb52yVreo5fdKHYULOI%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=oprixUAMf31ELcZwpnAhcQ%2BN0G4Y1Rldq%2F9Z9s%2B6QPk%3D) |
| SwinV2-Large | 195M | ImageNet-22K | 500k | 0.4536 | 85.81 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_large_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=x2vW5tECmw1D3zZDZry%2FY9x6IXUAZ8jaw8dvU6O67VE%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_large_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=GVZjtcQsXQc5tfFEtMa%2BmN9B8gz3K4U4mP2b9Y3%2BUzs%3D) |
| SwinV2-Huge | 655M | ImageNet-1K 20% | 125k | 0.4789 | 84.35 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=AfDHNqWd%2FssOxzg4%2F3kn9h96j85JnKKuHBDgQA%2BZ2iE%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper20_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=oaaIMCB14zpufU111Fg6jYiTOMVm8u0WYZwEwWnNSFM%3D) |
| SwinV2-Huge | 655M | ImageNet-1K 20% | 250k | 0.5038 | 84.16 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=orsuGGmPxhvVAU38p8i2MbjFxbvLCGfisSZ9vOo%2FiJM%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper20_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=yIjBMGQ3xGDo3YCBzygEXLTLkQvHhh5Iiq1QRDbQboc%3D) |
| SwinV2-Huge | 655M | ImageNet-1K 20% | 500k | 0.5071 | 83.44 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=rAGive3K49vKWrL6Qan89XPyskP3NkIrxbCDFXj7Ynw%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper20_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=HuyhoflInb9JKhORkL8NHNcTA8fDO%2Bt6sMt6usjZ8jM%3D) |
| SwinV2-Huge | 655M | ImageNet-1K 50% | 125k | 0.4549 | 85.09 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=2HVW%2Bx3CpRMkAdu1Ar74tL%2FuM7h%2F3EztuejQHYPwOls%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=1z%2BJ5IbecVyRLIdwWkF7eKflVPrNCD28nGzKquw8hDc%3D) |
| SwinV2-Huge | 655M | ImageNet-1K 50% | 250k | 0.4511 | 85.64 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=iwF6LIqKHtea%2F66%2Flj8EGu%2FWpt8q9HvSsyFFj6AXfJM%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=oNBnM95X1s4kYCeDe0pyDaglBG7bvpATf7b8b86aozk%3D) |
| SwinV2-Huge | 655M | ImageNet-1K 50% | 500k | 0.4559 | 85.69 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=6T49FsP9%2FbS2tXdCMP%2BmDCtl0i2i2F71xDnT%2Bin%2BINM%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=hC8v6NBVomcYiPHK8XLx9qmlHEdCEaPrllvI%2FuOaYXo%3D) |
| SwinV2-Huge | 655M | ImageNet-1K | 125k | 0.4531 | 85.23 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=pRXCXeQiYvirzGfVv6qJ%2BYW3g%2B74cAUV2dM9jBNIORA%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=RfW6kdN7ed8DZs2DO0vAvgcsE%2Fp6hdIpcu7VtHB%2FwE8%3D) |
| SwinV2-Huge | 655M | ImageNet-1K | 250k | 0.4464 | 85.90 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=KvM%2BlhwvPk6ggyHsejjStF2HcMLtL1rdprv9PSQCaeY%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=ucATpar6jpEKSh5dVC%2FW65m0uA5LumlH5XF15O46IC4%3D) |
| SwinV2-Huge | 655M | ImageNet-1K | 500k | 0.4416 | 86.34 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=E9AjQu%2FXUAAOLYRFhBX09Uk%2BM9Hk8LNqQymS3FuYcXk%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=jM%2BAJMUCj3cS3UKLRWwdR8PrarIVIIbZgH1Qj5RBGCE%3D) |
| SwinV2-Huge | 655M | ImageNet-22K | 125k | 0.4564 | 85.14 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=ZZs3RdN5Z%2Bn4kYRkZC3amWzufTRpN%2BNk1hTJ2JHH0cQ%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=%2Fd3bB6rFx7%2FRBET9b0wbul5YXV560D6ZfZteorrx2CQ%3D) |
| SwinV2-Huge | 655M | ImageNet-22K | 250k | 0.4499 | 85.86 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=%2BJ8qPLngT8YreH6a3nAKvPZ9LiSkYlr7XNJSGBneiMY%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=0DewNn0%2BJNCxEKJkMnRnd02spdn%2BwO57%2F7I2wpVKqyY%3D) |
| SwinV2-Huge | 655M | ImageNet-22K | 500k | 0.4444 | 86.27 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_huge_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=ySrqxO1QzUZBexBQG3KILbg4SsRu4CHWyWiVOyVJfX8%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_huge_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=G2ZBfg6yEbXKz9NcxueeGB6r7QagDS0uNp%2BvHe42GX4%3D) |
| SwinV2-giant | 1.06B | ImageNet-1K 50% | 125k | 0.4534 | 85.44 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=q0B7uKK5yz4NZkoGHU%2F1oGMRT5B6hmMgP1iMq2Nlqsc%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1kper50_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=tBP1adeaSMW%2BdlHNPCSm2qHi08eBReUpof0nM3gs2K8%3D) |
| SwinV2-giant | 1.06B | ImageNet-1K 50% | 250k | 0.4515 | 85.76 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=W5ZXtJD8AQKlh4wiP2aah61WaPc0vGgFD9j4RsJgCmg%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1kper50_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=y885PxNQ87bJ5JOtzkUqUkmXrQzeQMRRSSuabLikn4M%3D) |
| SwinV2-giant | 1.06B | ImageNet-1K 50% | 500k | 0.4719 | 85.51 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=S%2BSnsSe%2Fv8mR2XDOc1Rgs20hzMd02mEWM062udIE5mU%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1kper50_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=xBcoC9EysIscaAMladzGuFzSPiEsrL0KBhIJ3ek26F8%3D) |
| SwinV2-giant | 1.06B | ImageNet-1K | 125k | 0.4513 | 85.57 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=xd5QL%2BxHbV%2BtwcU86Z553cDfxPhtD5uFDsgVb3gB6%2BE%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=ebtaxg451TZMzKQbWpWYX2XXNd9S6desnbCNAsZURA8%3D) |
| SwinV2-giant | 1.06B | ImageNet-1K | 250k | 0.4442 | 86.12 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=zjS81zmCt%2ByIIcC9U7VpGui8%2FXua1gk%2BaRT%2FlOehL0M%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=bS90Og3Q7LodNgh1oBKJZiTS6xV7Feam6h4iiSXmszA%3D) |
| SwinV2-giant | 1.06B | ImageNet-1K | 500k | 0.4395 | 86.46 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=qGvax26EHN5qGDr5doKK7QH6EPBfjZjEiUPyDGBbsaQ%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_1k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=3N3xM2X4g42XVCUbiR9TtMz%2B2qJinB90hkpWZn72ook%3D) |
| SwinV2-giant | 1.06B | ImageNet-22K | 125k | 0.4544 | 85.39 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=Ue1Okf2c0rBTqJhv43qSpsWSAXUKxmoJzI7l25nhlQg%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_22k_125k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=WpTyvxIUFpcZ5OjVZu4z%2FtEX9crvWLLkyLJjhq%2FNM%2Bs%3D) |
| SwinV2-giant | 1.06B | ImageNet-22K | 250k | 0.4475 | 85.96 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=3v6HP6PBip%2BPMjpf%2FEzR7xkWimHLlwX0%2BphiSGCDxNI%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_22k_250k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=8xv7imZrjcQT8o3MoNqGNJZvwy0Wq2itPargu2d4Mz4%3D) |
| SwinV2-giant | 1.06B | ImageNet-22K | 500k | 0.4416 | 86.53 | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/pretrain/swinv2_giant_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=aVSY0TZymdDvMLWm4Os1neOIlKR28Herw6o4hz2TqpI%3D) | [azure](https://msravcghub.blob.core.windows.net/simmim-release/swinv2/finetune/finetune_swinv2_giant_22k_500k.pth?se=2049-12-31&sp=r&sv=2022-11-02&sr=b&sig=uMaRNhj67gFys%2Fu6ZK0he2oL4JwvZWWXxXTHOKsuhfk%3D) |
## Simmim Pretrained Swin-V1 Models