From 22ef3f3158d9f7d0936ce4e71b606a497be27746 Mon Sep 17 00:00:00 2001 From: wenkai Date: Fri, 8 May 2020 20:25:52 +0800 Subject: [PATCH] add specifications for mindinsight --- .../source_en/advanced_use/visualization_tutorials.md | 11 +++++++++++ .../advanced_use/visualization_tutorials.md | 11 +++++++++++ 2 files changed, 22 insertions(+) diff --git a/tutorials/source_en/advanced_use/visualization_tutorials.md b/tutorials/source_en/advanced_use/visualization_tutorials.md index 5f2cb682..c06f6602 100644 --- a/tutorials/source_en/advanced_use/visualization_tutorials.md +++ b/tutorials/source_en/advanced_use/visualization_tutorials.md @@ -15,6 +15,7 @@ - [Dataset Graph Visualization](#dataset-graph-visualization) - [Dataset Lineage Visualization](#dataset-lineage-visualization) - [Parameter Distribution](#parameter-distribution) + - [Specifications](#specifications) @@ -391,3 +392,13 @@ Figure 16 shows the function area of the parameter distribution histogram, inclu - Tag selection: Select the required tags to view the corresponding histogram. - Vertical axis: Select any of `Step`, `Relative time`, and `Absolute time` as the data displayed on the vertical axis of the histogram. - Angle of view: Select either `Front` or `Top`. `Front` view refers to viewing the histogram from the front view. In this case, data between different steps is overlapped. `Top` view refers to viewing the histogram at an angle of 45 degrees. In this case, data between different steps can be presented. + +## Specifications + +To limit time of listing summaries, MindInsight lists at most 999 summary items. + +To limit memory usage, MindInsight limits the number of tags and steps: +- There are 300 tags at most in each training dashboard. Total number of scalar tags, image tags, computation graph tags, parameter distribution(histogram) tags can not exceed 300. Specially, there are 10 computation graph tags at most. When tags exceed limit, MindInsight preserves the most recently processed tags. +- There are 1000 steps at most for each scalar tag in each training dashboard. When steps exceed limit, MindInsight will sample steps randomly to meet this limit. +- There are 10 steps at most for each image tag in each training dashboard. When steps exceed limit, MindInsight will sample steps randomly to meet this limit. +- There are 50 steps at most for each parameter distribution(histogram) tag in each training dashboard. When steps exceed limit, MindInsight will sample steps randomly to meet this limit. diff --git a/tutorials/source_zh_cn/advanced_use/visualization_tutorials.md b/tutorials/source_zh_cn/advanced_use/visualization_tutorials.md index 37cbed6a..bcc94099 100644 --- a/tutorials/source_zh_cn/advanced_use/visualization_tutorials.md +++ b/tutorials/source_zh_cn/advanced_use/visualization_tutorials.md @@ -20,6 +20,7 @@ - [数据图可视化](#数据图可视化) - [数据溯源可视化](#数据溯源可视化) - [参数分布图](#参数分布图) + - [规格](#规格) @@ -397,3 +398,13 @@ gunicorn - 标签选择：提供了对所有标签进行多项选择的功能，用户可以通过勾选所需的标签，查看对应的直方图。 - 纵轴：可以选择`步骤`、`相对时间`、`绝对时间`中的任意一项，来作为直方图纵轴显示的数据。 - 视角：可以选择`正视`和`俯视`中的一种。`正视`是指从正面的角度查看直方图，此时不同步骤之间的数据会覆盖在一起。`俯视`是指偏移以45度角俯视直方图区域，这时可以呈现不同步骤之间数据的差异。 + +## 规格 + +为了控制列出summary列表的用时，MindInsight最多支持发现999个summary列表条目。 + +为了控制内存占用，MindInsight对标签（tag）数目和步骤（step）数目进行了限制： +- 每个训练看板的最大标签数量为300个标签。标量标签、图片标签、计算图标签、参数分布图（直方图）标签的数量总和不得超过300个。特别地，每个训练看板最多有10个计算图标签。当实际标签数量超过这一限制时，将依照MindInsight的处理顺序，保留最近处理的300个标签。 +- 每个训练看板的每个标量标签最多有1000个步骤的数据。当实际步骤的数目超过这一限制时，将对数据进行随机采样，以满足这一限制。 +- 每个训练看板的每个图片标签最多有10个步骤的数据。当实际步骤的数目超过这一限制时，将对数据进行随机采样，以满足这一限制。 +- 每个训练看板的每个参数分布图（直方图）标签最多有50个步骤的数据。当实际步骤的数目超过这一限制时，将对数据进行随机采样，以满足这一限制。 -- GitLab