Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
magicwindyyd
mindspore
提交
0cbcc720
M
mindspore
项目概览
magicwindyyd
/
mindspore
与 Fork 源项目一致
Fork自
MindSpore / mindspore
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
M
mindspore
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
0cbcc720
编写于
5月 22, 2020
作者:
P
Peilin Wang
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
made shuffle determinisitc for subsequent epochs
上级
61639be1
变更
3
隐藏空白更改
内联
并排
Showing
3 changed file
with
8 addition
and
8 deletion
+8
-8
mindspore/ccsrc/dataset/engine/datasetops/shuffle_op.cc
mindspore/ccsrc/dataset/engine/datasetops/shuffle_op.cc
+6
-6
tests/ut/data/dataset/golden/test_2ops_shuffle_repeat.npz
tests/ut/data/dataset/golden/test_2ops_shuffle_repeat.npz
+0
-0
tests/ut/python/dataset/test_2ops.py
tests/ut/python/dataset/test_2ops.py
+2
-2
未找到文件。
mindspore/ccsrc/dataset/engine/datasetops/shuffle_op.cc
浏览文件 @
0cbcc720
...
...
@@ -83,14 +83,14 @@ ShuffleOp::ShuffleOp(int32_t shuffle_size, uint32_t shuffle_seed, int32_t op_con
// itself rather than waiting for the reset driven from operators above it in the pipeline.
Status
ShuffleOp
::
SelfReset
()
{
MS_LOG
(
DEBUG
)
<<
"Shuffle operator performing a self-reset."
;
// If
ReshuffleEachE
poch is false, then we always use the same seed for every
// If
reshuffle_each_e
poch is false, then we always use the same seed for every
// epoch.
// If
ReshuffleEachE
poch is true, then the first epoch uses the given seed,
// and all subsequent epochs will then
reset the seed based on random device.
if
(
reshuffle_each_epoch_
)
{
shuffle_seed_
=
GetNewSeed
(
);
// If
reshuffle_each_e
poch is true, then the first epoch uses the given seed,
// and all subsequent epochs will then
keep on using the rng_ without resetting it
if
(
!
reshuffle_each_epoch_
)
{
rng_
=
std
::
mt19937_64
(
shuffle_seed_
);
}
rng_
=
std
::
mt19937_64
(
shuffle_seed_
);
shuffle_buffer_
=
std
::
make_unique
<
TensorTable
>
();
buffer_counter_
=
0
;
shuffle_last_row_idx_
=
0
;
...
...
tests/ut/data/dataset/golden/test_2ops_shuffle_repeat.npz
浏览文件 @
0cbcc720
无法预览此类型文件
tests/ut/python/dataset/test_2ops.py
浏览文件 @
0cbcc720
...
...
@@ -47,7 +47,7 @@ def test_2ops_repeat_shuffle():
save_and_check
(
data1
,
parameters
,
filename
,
generate_golden
=
GENERATE_GOLDEN
)
def
skip_
test_2ops_shuffle_repeat
():
def
test_2ops_shuffle_repeat
():
"""
Test Shuffle then Repeat
"""
...
...
@@ -159,7 +159,7 @@ def test_2ops_shuffle_batch():
if
__name__
==
'__main__'
:
test_2ops_repeat_shuffle
()
#
test_2ops_shuffle_repeat()
test_2ops_shuffle_repeat
()
test_2ops_repeat_batch
()
test_2ops_batch_repeat
()
test_2ops_batch_shuffle
()
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录