Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
PaddleClas
提交
d7bd2753
P
PaddleClas
项目概览
PaddlePaddle
/
PaddleClas
大约 1 年 前同步成功
通知
115
Star
4999
Fork
1114
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
19
列表
看板
标记
里程碑
合并请求
6
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
PaddleClas
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
19
Issue
19
列表
看板
标记
里程碑
合并请求
6
合并请求
6
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
d7bd2753
编写于
4月 14, 2023
作者:
Z
zh-hike
提交者:
zengshao0622
4月 23, 2023
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
update foundation_vit from EVA_vit_huge to EVA_vit_giant
上级
0af4680f
变更
3
显示空白变更内容
内联
并排
Showing
3 changed file
with
23 addition
and
23 deletion
+23
-23
docs/zh_CN/models/Foundation_models/FoundationViT.md
docs/zh_CN/models/Foundation_models/FoundationViT.md
+19
-19
ppcls/arch/backbone/__init__.py
ppcls/arch/backbone/__init__.py
+1
-1
ppcls/arch/backbone/model_zoo/foundation_vit.py
ppcls/arch/backbone/model_zoo/foundation_vit.py
+3
-3
未找到文件。
docs/zh_CN/models/Foundation_models/FoundationViT.md
浏览文件 @
d7bd2753
...
@@ -13,7 +13,7 @@
...
@@ -13,7 +13,7 @@
## 2. 使用说明
## 2. 使用说明
以模型
`CLIP_vit_base_patch16_224`
为例,使用该模型以及对应的预训练权重进行特征提取的代码如下:
以模型
`CLIP_vit_base_patch16_224`
为例,使用该模型以及对应的预训练权重进行特征提取的代码如下:
```
python
```
python
from
ppcls.utils
import
config
from
ppcls.utils
import
config
...
@@ -32,7 +32,7 @@ output = model(inputs) # the output of model embeding
...
@@ -32,7 +32,7 @@ output = model(inputs) # the output of model embeding
目前支持的视觉大模型以及预训练权重如下:
目前支持的视觉大模型以及预训练权重如下:
| 系列 | 模型 | 模型大小 | embedding_size | 预训练数据集 | 权重下载 |
| 系列 | 模型 | 模型大小 | embedding_size | 预训练数据集 | 权重下载 |
| :----: | :--------------------------------: | :------: | :------------: | :----------------------------------------------: | ------------------------------------------------------------ |
| :----: | :--------------------------------: | :------: | :------------: | :----------------------------------------------: | ------------------------------------------------------------
--------------------------------------------------------------------
|
| CLIP | CLIP_vit_base_patch16_224 | 85M | 768 | WIT |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CLIP_vit_base_patch16_224.pdparams
)
|
| CLIP | CLIP_vit_base_patch16_224 | 85M | 768 | WIT |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CLIP_vit_base_patch16_224.pdparams
)
|
| CLIP | CLIP_vit_base_patch32_224 | 87M | 768 | WIT |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CLIP_vit_base_patch32_224.pdparams
)
|
| CLIP | CLIP_vit_base_patch32_224 | 87M | 768 | WIT |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CLIP_vit_base_patch32_224.pdparams
)
|
| CLIP | CLIP_vit_large_patch14_224 | 302M | 1024 | WIT |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CLIP_vit_large_patch14_224.pdparams
)
|
| CLIP | CLIP_vit_large_patch14_224 | 302M | 1024 | WIT |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CLIP_vit_large_patch14_224.pdparams
)
|
...
@@ -46,7 +46,7 @@ output = model(inputs) # the output of model embeding
...
@@ -46,7 +46,7 @@ output = model(inputs) # the output of model embeding
| MAE | MAE_vit_base_patch16 | 85M | 768 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MAE_vit_base_patch16.pdparams
)
|
| MAE | MAE_vit_base_patch16 | 85M | 768 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MAE_vit_base_patch16.pdparams
)
|
| MAE | MAE_vit_large_patch16 | 303M | 1024 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MAE_vit_large_patch16.pdparams
)
|
| MAE | MAE_vit_large_patch16 | 303M | 1024 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MAE_vit_large_patch16.pdparams
)
|
| MAE | MAE_vit_huge_patch14 | 630M | 1280 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MAE_vit_huge_patch14.pdparams
)
|
| MAE | MAE_vit_huge_patch14 | 630M | 1280 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MAE_vit_huge_patch14.pdparams
)
|
| EVA
| EVA_vit_huge_patch14 | 1010M | 1408 | ImageNet-21k, CC12M, CC2M, Object365,COCO, ADE |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/EVA_vit_huge_patch14.pdparams
)
|
| EVA
| EVA_vit_giant_patch14 | 1010M | 1408 | ImageNet-21k, CC12M, CC2M, Object365,COCO, ADE |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/EVA_vit_giant_patch14.pdparams
)
|
| CAE | CAE_vit_base_patch16_224 | 85M | 768 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CAE_vit_base_patch16_224.pdparams
)
|
| CAE | CAE_vit_base_patch16_224 | 85M | 768 | ImageNet-1k |
[
下载地址
](
https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CAE_vit_base_patch16_224.pdparams
)
|
## 4. 参考文献
## 4. 参考文献
...
...
ppcls/arch/backbone/__init__.py
浏览文件 @
d7bd2753
...
@@ -71,7 +71,7 @@ from .model_zoo.mobilevit import MobileViT_XXS, MobileViT_XS, MobileViT_S
...
@@ -71,7 +71,7 @@ from .model_zoo.mobilevit import MobileViT_XXS, MobileViT_XS, MobileViT_S
from
.model_zoo.repvgg
import
RepVGG_A0
,
RepVGG_A1
,
RepVGG_A2
,
RepVGG_B0
,
RepVGG_B1
,
RepVGG_B2
,
RepVGG_B1g2
,
RepVGG_B1g4
,
RepVGG_B2g4
,
RepVGG_B3
,
RepVGG_B3g4
,
RepVGG_D2se
from
.model_zoo.repvgg
import
RepVGG_A0
,
RepVGG_A1
,
RepVGG_A2
,
RepVGG_B0
,
RepVGG_B1
,
RepVGG_B2
,
RepVGG_B1g2
,
RepVGG_B1g4
,
RepVGG_B2g4
,
RepVGG_B3
,
RepVGG_B3g4
,
RepVGG_D2se
from
.model_zoo.van
import
VAN_B0
,
VAN_B1
,
VAN_B2
,
VAN_B3
from
.model_zoo.van
import
VAN_B0
,
VAN_B1
,
VAN_B2
,
VAN_B3
from
.model_zoo.peleenet
import
PeleeNet
from
.model_zoo.peleenet
import
PeleeNet
from
.model_zoo.foundation_vit
import
CLIP_vit_base_patch32_224
,
CLIP_vit_base_patch16_224
,
CLIP_vit_large_patch14_336
,
CLIP_vit_large_patch14_224
,
BEiTv2_vit_base_patch16_224
,
BEiTv2_vit_large_patch16_224
,
CAE_vit_base_patch16_224
,
EVA_vit_
huge
_patch14
,
MOCOV3_vit_small
,
MOCOV3_vit_base
,
MAE_vit_huge_patch14
,
MAE_vit_large_patch16
,
MAE_vit_base_patch16
from
.model_zoo.foundation_vit
import
CLIP_vit_base_patch32_224
,
CLIP_vit_base_patch16_224
,
CLIP_vit_large_patch14_336
,
CLIP_vit_large_patch14_224
,
BEiTv2_vit_base_patch16_224
,
BEiTv2_vit_large_patch16_224
,
CAE_vit_base_patch16_224
,
EVA_vit_
giant
_patch14
,
MOCOV3_vit_small
,
MOCOV3_vit_base
,
MAE_vit_huge_patch14
,
MAE_vit_large_patch16
,
MAE_vit_base_patch16
from
.model_zoo.convnext
import
ConvNeXt_tiny
,
ConvNeXt_small
,
ConvNeXt_base_224
,
ConvNeXt_base_384
,
ConvNeXt_large_224
,
ConvNeXt_large_384
from
.model_zoo.convnext
import
ConvNeXt_tiny
,
ConvNeXt_small
,
ConvNeXt_base_224
,
ConvNeXt_base_384
,
ConvNeXt_large_224
,
ConvNeXt_large_384
from
.model_zoo.nextvit
import
NextViT_small_224
,
NextViT_base_224
,
NextViT_large_224
,
NextViT_small_384
,
NextViT_base_384
,
NextViT_large_384
from
.model_zoo.nextvit
import
NextViT_small_224
,
NextViT_base_224
,
NextViT_large_224
,
NextViT_small_384
,
NextViT_base_384
,
NextViT_large_384
from
.model_zoo.cae
import
cae_base_patch16_224
,
cae_large_patch16_224
from
.model_zoo.cae
import
cae_base_patch16_224
,
cae_large_patch16_224
...
...
ppcls/arch/backbone/model_zoo/foundation_vit.py
浏览文件 @
d7bd2753
...
@@ -40,8 +40,8 @@ MODEL_URLS = {
...
@@ -40,8 +40,8 @@ MODEL_URLS = {
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/BEiTv2_vit_large_patch16_224.pdparams"
,
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/BEiTv2_vit_large_patch16_224.pdparams"
,
"CAE_vit_base_patch16_224"
:
"CAE_vit_base_patch16_224"
:
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CAE_vit_base_patch16_224.pdparams"
,
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/CAE_vit_base_patch16_224.pdparams"
,
'EVA_vit_
huge
_patch14'
:
'EVA_vit_
giant
_patch14'
:
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/EVA_vit_
huge
_patch14.pdparams"
,
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/EVA_vit_
giant
_patch14.pdparams"
,
"MOCOV3_vit_small"
:
"MOCOV3_vit_small"
:
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MOCOV3_vit_small.pdparams"
,
"https://paddle-imagenet-models-name.bj.bcebos.com/dygraph/foundation_models/MOCOV3_vit_small.pdparams"
,
"MOCOV3_vit_base"
:
"MOCOV3_vit_base"
:
...
@@ -867,7 +867,7 @@ def MAE_vit_huge_patch14(pretrained=False, use_ssld=False, **kwargs):
...
@@ -867,7 +867,7 @@ def MAE_vit_huge_patch14(pretrained=False, use_ssld=False, **kwargs):
return
model
return
model
def
EVA_vit_
huge
_patch14
(
pretrained
=
False
,
use_ssld
=
False
,
**
kwargs
):
def
EVA_vit_
giant
_patch14
(
pretrained
=
False
,
use_ssld
=
False
,
**
kwargs
):
model_name
=
sys
.
_getframe
().
f_code
.
co_name
model_name
=
sys
.
_getframe
().
f_code
.
co_name
model
=
VisionTransformer
(
model
=
VisionTransformer
(
model_name
=
model_name
,
model_name
=
model_name
,
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录