提交 b73ab101 编写于 作者: W wangyue01

create info for MindInsight Profiler

上级 2795c1e3
......@@ -15,6 +15,8 @@
- [Dataset Graph Visualization](#dataset-graph-visualization)
- [Dataset Lineage Visualization](#dataset-lineage-visualization)
- [Parameter Distribution](#parameter-distribution)
- [Performance Profiler](#performance-profiler)
- [Operator Performance Analysis](#operator-performance-analysis)
- [Specifications](#specifications)
<!-- /TOC -->
......@@ -394,6 +396,31 @@ Figure 16 shows the function area of the parameter distribution histogram, inclu
- Vertical axis: Select any of `Step`, `Relative time`, and `Absolute time` as the data displayed on the vertical axis of the histogram.
- Angle of view: Select either `Front` or `Top`. `Front` view refers to viewing the histogram from the front view. In this case, data between different steps is overlapped. `Top` view refers to viewing the histogram at an angle of 45 degrees. In this case, data between different steps can be presented.
## Performance Profiler
### Operator Performance Analysis
The operator performance analysis component is used to display the execution time of the operators during MindSpore run.
![op_type_statistics.png](./images/op_type_statistics.PNG)
Figure 17: Statistics for Operator Types
Figure 17 displays the statistics for the operator types, including:
- Choose pie or bar graph to show the proportion time occupied by each operator type. The time of one operator type is calculated by accumulating the execution time of operators belong to this type.
- Display top 20 operator types with longest execution time, show the proportion and execution time (ms) of each operator type.
![op_statistics.png](./images/op_statistics.PNG)
Figure 18: Statistics for Operators
Figure 18 displays the statistics table for the operators, including:
- Choose All: Display statistics for the operators, including operator name、type、excution time、full scope time、information etc. The table will be sorted by execution time by default.
- Choose Type: Display statistics for the operator types, including operator type name、execution time、execution frequency and proportion of total time. Users can click on each line, querying for all the operators belong to this type.
- Search: There is a search box on the right, which can support fuzzy search for operators/operator types.
## Specifications
To limit time of listing summaries, MindInsight lists at most 999 summary items.
......@@ -403,3 +430,5 @@ To limit memory usage, MindInsight limits the number of tags and steps:
- There are 1000 steps at most for each scalar tag in each training dashboard. When steps exceed limit, MindInsight will sample steps randomly to meet this limit.
- There are 10 steps at most for each image tag in each training dashboard. When steps exceed limit, MindInsight will sample steps randomly to meet this limit.
- There are 50 steps at most for each parameter distribution(histogram) tag in each training dashboard. When steps exceed limit, MindInsight will sample steps randomly to meet this limit.
To limit the data size generated by the Profiler, MindInsight suggests that for large neural network, the profiled steps should better below 10.
......@@ -20,6 +20,8 @@
- [数据图可视化](#数据图可视化)
- [数据溯源可视化](#数据溯源可视化)
- [参数分布图](#参数分布图)
- [性能调试](#性能调试)
- [算子性能分析](#算子性能分析)
- [规格](#规格)
<!-- /TOC -->
......@@ -400,6 +402,29 @@ gunicorn <PID> <USER> <FD> <TYPE> <DEVICE> <SIZE/OFF> <NODE> <WORKSPACE>
- 纵轴:可以选择`步骤``相对时间``绝对时间`中的任意一项,来作为直方图纵轴显示的数据。
- 视角:可以选择`正视``俯视`中的一种。`正视`是指从正面的角度查看直方图,此时不同步骤之间的数据会覆盖在一起。`俯视`是指偏移以45度角俯视直方图区域,这时可以呈现不同步骤之间数据的差异。
## 性能调试
### 算子性能分析
使用算子性能分析组件可以对MindSpore运行过程中的各个算子的执行时间进行统计展示。
![op_type_statistics.png](./images/op_type_statistics.PNG)
图17: 算子类别统计分析
图17展示了按算子类别进行统计分析的结果,包含以下内容:
- 可以选择饼图/柱状图展示各算子类别的时间占比,每个算子类别的执行时间会统计属于该类别的算子执行时间总和;
- 统计前20个占比时间最长的算子类别,展示其时间所占的百分比以及具体的执行时间(毫秒)。
![op_statistics.png](./images/op_statistics.PNG)
图18: 算子统计分析
图18展示了算子性能统计表,包含以下内容:
- 选择全部:按单个算子的统计结果进行排序展示,展示维度包括算子名称、算子类型、算子执行时间、算子全scope名称、算子信息等;默认按算子执行时间排序;
- 选择分类:按算子类别的统计结果进行排序展示,展示维度包括算子分类名称、算子类别执行时间、执行频次、占总时间的比例等。点击每个算子类别,可以进一步查看该类别下所有单个算子的统计信息;
- 搜索:在右侧搜索框中输入字符串,支持对算子名称/类别进行模糊搜索。
## 规格
为了控制列出summary列表的用时,MindInsight最多支持发现999个summary列表条目。
......@@ -409,3 +434,5 @@ gunicorn <PID> <USER> <FD> <TYPE> <DEVICE> <SIZE/OFF> <NODE> <WORKSPACE>
- 每个训练看板的每个标量标签最多有1000个步骤的数据。当实际步骤的数目超过这一限制时,将对数据进行随机采样,以满足这一限制。
- 每个训练看板的每个图片标签最多有10个步骤的数据。当实际步骤的数目超过这一限制时,将对数据进行随机采样,以满足这一限制。
- 每个训练看板的每个参数分布图(直方图)标签最多有50个步骤的数据。当实际步骤的数目超过这一限制时,将对数据进行随机采样,以满足这一限制。
为了控制性能测试时生成数据的大小,大型网络建议profile的step数目限制在10以内。
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册