Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
magicwindyyd
mindspore
提交
5b7875ba
M
mindspore
项目概览
magicwindyyd
/
mindspore
与 Fork 源项目一致
Fork自
MindSpore / mindspore
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
M
mindspore
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
5b7875ba
编写于
8月 04, 2020
作者:
M
mindspore-ci-bot
提交者:
Gitee
8月 04, 2020
浏览文件
操作
浏览文件
下载
差异文件
!3883 Fix docs and fix writer pool not exit when max_file_size too small
Merge pull request !3883 from LiHongzhang/fix_writer_pool_m
上级
28af1e50
fd03ed83
变更
3
隐藏空白更改
内联
并排
Showing
3 changed file
with
13 addition
and
5 deletion
+13
-5
mindspore/train/callback/_summary_collector.py
mindspore/train/callback/_summary_collector.py
+11
-3
mindspore/train/summary/_writer_pool.py
mindspore/train/summary/_writer_pool.py
+1
-1
mindspore/train/summary/summary_record.py
mindspore/train/summary/summary_record.py
+1
-1
未找到文件。
mindspore/train/callback/_summary_collector.py
浏览文件 @
5b7875ba
...
@@ -109,10 +109,18 @@ class SummaryCollector(Callback):
...
@@ -109,10 +109,18 @@ class SummaryCollector(Callback):
custom_lineage_data (Union[dict, None]): Allows you to customize the data and present it on the MingInsight
custom_lineage_data (Union[dict, None]): Allows you to customize the data and present it on the MingInsight
lineage page. In the custom data, the key type support str, and the value type support str/int/float.
lineage page. In the custom data, the key type support str, and the value type support str/int/float.
Default: None, it means there is no custom data.
Default: None, it means there is no custom data.
collect_tensor_freq (Optional[int]): Same as the `collect_freq`, but controls TensorSummary specifically.
collect_tensor_freq (Optional[int]): Same semantic as the `collect_freq`, but controls TensorSummary only.
Default: None, which means the frequency is auto-calculated just to collect at most 20 steps TensorSummary.
Because TensorSummary data is too large compared to other summary data, this parameter is used to reduce
its collection. By default, TensorSummary data will be collected at most 21 steps, but not more than how
many steps other summary data will be collected.
Default: None, which means to follow the behavior as described above. For example, given `collect_freq=10`,
when the total steps is 600, TensorSummary will be collected 21 steps, while other summary data 61 steps,
but when the total steps is 20, both TensorSummary and other summary will be collected 3 steps.
Also note that when in parallel mode, the total steps will be splitted evenly, which will
affect how many steps TensorSummary will be collected.
max_file_size (Optional[int]): The maximum size in bytes each file can be written to the disk.
max_file_size (Optional[int]): The maximum size in bytes each file can be written to the disk.
Default: None, which means no limit.
Default: None, which means no limit. For example, to write not larger than 4GB,
specify `max_file_size=4 * 1024**3`.
Raises:
Raises:
ValueError: If the parameter value is not expected.
ValueError: If the parameter value is not expected.
...
...
mindspore/train/summary/_writer_pool.py
浏览文件 @
5b7875ba
...
@@ -66,7 +66,7 @@ class WriterPool(Process):
...
@@ -66,7 +66,7 @@ class WriterPool(Process):
for
plugin
,
data
in
deq
.
popleft
().
get
():
for
plugin
,
data
in
deq
.
popleft
().
get
():
self
.
_write
(
plugin
,
data
)
self
.
_write
(
plugin
,
data
)
if
not
self
.
_queue
.
empty
()
and
self
.
_writers
:
if
not
self
.
_queue
.
empty
():
action
,
data
=
self
.
_queue
.
get
()
action
,
data
=
self
.
_queue
.
get
()
if
action
==
'WRITE'
:
if
action
==
'WRITE'
:
deq
.
append
(
pool
.
apply_async
(
_pack_data
,
(
data
,
time
.
time
())))
deq
.
append
(
pool
.
apply_async
(
_pack_data
,
(
data
,
time
.
time
())))
...
...
mindspore/train/summary/summary_record.py
浏览文件 @
5b7875ba
...
@@ -81,7 +81,7 @@ class SummaryRecord:
...
@@ -81,7 +81,7 @@ class SummaryRecord:
file_suffix (str): The suffix of file. Default: "_MS".
file_suffix (str): The suffix of file. Default: "_MS".
network (Cell): Obtain a pipeline through network for saving graph summary. Default: None.
network (Cell): Obtain a pipeline through network for saving graph summary. Default: None.
max_file_size (Optional[int]): The maximum size in bytes each file can be written to the disk.
\
max_file_size (Optional[int]): The maximum size in bytes each file can be written to the disk.
\
Unlimited by default.
Unlimited by default.
For example, to write not larger than 4GB, specify `max_file_size=4 * 1024**3`.
Raises:
Raises:
TypeError: If `max_file_size`, `queue_max_size` or `flush_time` is not int,
\
TypeError: If `max_file_size`, `queue_max_size` or `flush_time` is not int,
\
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录