Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
magicwindyyd
mindspore
提交
d8a2847b
M
mindspore
项目概览
magicwindyyd
/
mindspore
与 Fork 源项目一致
Fork自
MindSpore / mindspore
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
M
mindspore
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
d8a2847b
编写于
5月 06, 2020
作者:
P
panfengfeng
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
after error run the post
上级
feca9940
变更
3
隐藏空白更改
内联
并排
Showing
3 changed file
with
12 addition
and
5 deletion
+12
-5
mindspore/ccsrc/dataset/engine/datasetops/batch_op.cc
mindspore/ccsrc/dataset/engine/datasetops/batch_op.cc
+3
-1
mindspore/ccsrc/dataset/engine/datasetops/filter_op.cc
mindspore/ccsrc/dataset/engine/datasetops/filter_op.cc
+2
-2
mindspore/ccsrc/dataset/engine/datasetops/map_op.cc
mindspore/ccsrc/dataset/engine/datasetops/map_op.cc
+7
-2
未找到文件。
mindspore/ccsrc/dataset/engine/datasetops/batch_op.cc
浏览文件 @
d8a2847b
...
...
@@ -56,8 +56,10 @@ BatchOp::BatchOp(int32_t batch_size, bool drop, int32_t op_queue_size, int32_t n
}
Status
BatchOp
::
operator
()()
{
RETURN_IF_NOT_OK
(
LaunchThreadsAndInitOp
());
Status
rc
=
LaunchThreadsAndInitOp
();
// Synchronize with TaskManager
TaskManager
::
FindMe
()
->
Post
();
RETURN_IF_NOT_OK
(
rc
);
int64_t
epoch_num
=
0
,
batch_num
=
0
,
cnt
=
0
;
TensorRow
new_row
;
std
::
unique_ptr
<
TensorQTable
>
table
=
std
::
make_unique
<
TensorQTable
>
();
...
...
mindspore/ccsrc/dataset/engine/datasetops/filter_op.cc
浏览文件 @
d8a2847b
...
...
@@ -59,10 +59,10 @@ FilterOp::FilterOp(const std::vector<std::string> &in_col_names, int32_t num_wor
:
ParallelOp
(
num_workers
,
op_queue_size
),
predicate_func_
(
std
::
move
(
predicate_func
)),
in_columns_
(
in_col_names
)
{}
Status
FilterOp
::
operator
()()
{
// The operator class just starts off threads by calling the tree_ function.
RETURN_UNEXPECTED_IF_NULL
(
tree_
);
// Synchronize with TaskManager.
TaskManager
::
FindMe
()
->
Post
();
// The operator class just starts off threads by calling the tree_ function.
RETURN_UNEXPECTED_IF_NULL
(
tree_
);
filter_queues_
.
Init
(
num_workers_
,
oc_queue_size_
);
RETURN_IF_NOT_OK
(
filter_queues_
.
Register
(
tree_
->
AllTasks
()));
RETURN_IF_NOT_OK
(
tree_
->
LaunchWorkers
(
num_workers_
,
std
::
bind
(
&
FilterOp
::
WorkerEntry
,
this
,
std
::
placeholders
::
_1
)));
...
...
mindspore/ccsrc/dataset/engine/datasetops/map_op.cc
浏览文件 @
d8a2847b
...
...
@@ -110,13 +110,18 @@ Status MapOp::operator()() {
if
(
perf_mode_
)
{
// Create and register the local queues.
local_queues_
.
Init
(
num_workers_
,
oc_queue_size_
);
RETURN_IF_NOT_OK
(
local_queues_
.
Register
(
tree_
->
AllTasks
()));
Status
rc
=
local_queues_
.
Register
(
tree_
->
AllTasks
());
if
(
rc
.
IsError
())
{
TaskManager
::
FindMe
()
->
Post
();
return
rc
;
}
}
// The operator class just starts off threads by calling the tree_ function
RETURN_IF_NOT_OK
(
tree_
->
LaunchWorkers
(
num_workers_
,
std
::
bind
(
&
MapOp
::
WorkerEntry
,
this
,
std
::
placeholders
::
_1
)
));
Status
rc
=
tree_
->
LaunchWorkers
(
num_workers_
,
std
::
bind
(
&
MapOp
::
WorkerEntry
,
this
,
std
::
placeholders
::
_1
));
// Synchronize with TaskManager
TaskManager
::
FindMe
()
->
Post
();
RETURN_IF_NOT_OK
(
rc
);
if
(
perf_mode_
)
{
int64_t
que_id
=
0
;
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录