Skip to content

M
mindinsight

MindSpore / mindinsight

通知 7
Star 3
Fork 2
M
mindinsight
提交 f0cbab09 编写于 作者: M mindspore-ci-bot 提交者： Gitee
浏览文件
操作

!558 update shell script templates of mindwizard 

Merge pull request !558 from liangyongxiong/wizard
上级 bd764482 cf9dd0f3
隐藏空白更改
内联 并排
Showing with 64 addition and 30 deletion
mindinsight/wizard/README.md
浏览文件 @ f0cbab09
...@@ -48,6 +48,7 @@ project ...@@ -48,6 +48,7 @@ project
| |- config.py # parameter configuration | |- config.py # parameter configuration
| |- dataset.py # data preprocessing | |- dataset.py # data preprocessing
| |- lenet.py/resent.py/... # network definition | |- lenet.py/resent.py/... # network definition
| |- ...
|- eval.py # evaluate network |- eval.py # evaluate network
|- train.py # train network |- train.py # train network
|- README.md |- README.md
...@@ -78,23 +79,39 @@ $ mindwizard project ...@@ -78,23 +79,39 @@ $ mindwizard project
1: MNIST 1: MNIST
[1]: 1 [1]: 1
lenet is generated in $PWD/project project is generated in $PWD/project
$ cd $PWD/project/scripts $ cd $PWD/project/scripts
``` ```
### Training ### Training
Distributed training
```
# Ascend
Usage: bash run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
# GPU
Usage: bash run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
``` ```
# distributed training
Usage: ./run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
# standalone training Standalone training
Usage: ./run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
```
# Ascend
Usage: bash run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
# GPU
Usage: bash run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
``` ```
### Evaluation ### Evaluation
``` ```
Usage: ./run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH] # Ascend
Usage: bash run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]
# GPU
Usage: bash run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]
``` ```
mindinsight/wizard/README_CN.md
浏览文件 @ f0cbab09
...@@ -48,6 +48,7 @@ project ...@@ -48,6 +48,7 @@ project
| |- config.py # 参数配置 | |- config.py # 参数配置
| |- dataset.py # 数据集处理 | |- dataset.py # 数据集处理
| |- lenet.py/resent.py/... # 网络定义 | |- lenet.py/resent.py/... # 网络定义
| |- ...
|- eval.py # 网络推理 |- eval.py # 网络推理
|- train.py # 网络训练 |- train.py # 网络训练
|- README.md |- README.md
...@@ -78,23 +79,39 @@ $ mindwizard project ...@@ -78,23 +79,39 @@ $ mindwizard project
1: MNIST 1: MNIST
[1]: 1 [1]: 1
lenet is generated in $PWD/project project is generated in $PWD/project
$ cd $PWD/project/scripts $ cd $PWD/project/scripts
``` ```
### 训练 ### 训练
多卡训练
```
# Ascend
Usage: bash run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
# GPU
Usage: bash run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
``` ```
# 多卡训练
Usage: ./run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
# 单卡训练 单卡训练
Usage: ./run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
```
# Ascend
Usage: bash run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
# GPU
Usage: bash run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)
``` ```
### 评估 ### 评估
``` ```
Usage: ./run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH] # Ascend
Usage: bash run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]
# GPU
Usage: bash run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]
``` ```
mindinsight/wizard/conf/templates/network/alexnet/scripts/run_distribute_train.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] && [ $# != 3 ] if [ $# != 2 ] && [ $# != 3 ]
then then
echo "Usage: sh run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/alexnet/scripts/run_distribute_train_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/alexnet/scripts/run_eval.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] if [ $# != 2 ]
then then
echo "Usage: sh run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]" echo "Usage: bash run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/alexnet/scripts/run_eval_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] if [ $# != 2 ]
then then
echo "Usage: sh run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]" echo "Usage: bash run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/alexnet/scripts/run_standalone_train.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/alexnet/scripts/run_standalone_train_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/lenet/scripts/run_distribute_train.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] && [ $# != 3 ] if [ $# != 2 ] && [ $# != 3 ]
then then
echo "Usage: sh run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/lenet/scripts/run_distribute_train_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -15,7 +15,7 @@ ...@@ -15,7 +15,7 @@
# ============================================================================ # ============================================================================
if [ $# != 1 ]&& [ $# != 2 ] if [ $# != 1 ]&& [ $# != 2 ]
then then
echo "Usage: sh run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/lenet/scripts/run_eval.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] if [ $# != 2 ]
then then
echo "Usage: sh run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]" echo "Usage: bash run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/lenet/scripts/run_eval_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] if [ $# != 2 ]
then then
echo "Usage: sh run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]" echo "Usage: bash run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/lenet/scripts/run_standalone_train.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/lenet/scripts/run_standalone_train_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/resnet50/scripts/run_distribute_train.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] && [ $# != 3 ] if [ $# != 2 ] && [ $# != 3 ]
then then
echo "Usage: sh run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_distribute_train.sh [RANK_TABLE_FILE] [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/resnet50/scripts/run_distribute_train_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_distribute_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/resnet50/scripts/run_eval.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] if [ $# != 2 ]
then then
echo "Usage: sh run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]" echo "Usage: bash run_eval.sh [DATASET_PATH] [CHECKPOINT_PATH]"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/resnet50/scripts/run_eval_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 2 ] if [ $# != 2 ]
then then
echo "Usage: sh run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]" echo "Usage: bash run_eval_gpu.sh [DATASET_PATH] [CHECKPOINT_PATH]"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/resnet50/scripts/run_standalone_train.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_standalone_train.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
mindinsight/wizard/conf/templates/network/resnet50/scripts/run_standalone_train_gpu.sh-tpl
浏览文件 @ f0cbab09
...@@ -16,7 +16,7 @@ ...@@ -16,7 +16,7 @@
if [ $# != 1 ] && [ $# != 2 ] if [ $# != 1 ] && [ $# != 2 ]
then then
echo "Usage: sh run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)" echo "Usage: bash run_standalone_train_gpu.sh [DATASET_PATH] [PRETRAINED_CKPT_PATH](optional)"
exit 1 exit 1
fi fi
......
Markdown is supported
0% 或 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑！
想要评论请 注册 或