Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
magicwindyyd
mindspore
提交
cd90dfa1
M
mindspore
项目概览
magicwindyyd
/
mindspore
与 Fork 源项目一致
Fork自
MindSpore / mindspore
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
M
mindspore
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
cd90dfa1
编写于
6月 04, 2020
作者:
M
mindspore-ci-bot
提交者:
Gitee
6月 04, 2020
浏览文件
操作
浏览文件
下载
差异文件
!1834 sorts column names for tfreader during schema creation
Merge pull request !1834 from Peilin/tf-reader-column-order-fix
上级
18ecafcf
9c8ea3c1
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
11 addition
and
9 deletion
+11
-9
mindspore/ccsrc/dataset/engine/datasetops/source/tf_reader_op.cc
...re/ccsrc/dataset/engine/datasetops/source/tf_reader_op.cc
+10
-8
mindspore/ccsrc/dataset/engine/datasetops/source/tf_reader_op.h
...ore/ccsrc/dataset/engine/datasetops/source/tf_reader_op.h
+1
-1
未找到文件。
mindspore/ccsrc/dataset/engine/datasetops/source/tf_reader_op.cc
浏览文件 @
cd90dfa1
...
...
@@ -15,14 +15,14 @@
*/
#include "dataset/engine/datasetops/source/tf_reader_op.h"
#include <cmath>
#include <condition_variable>
#include <algorithm>
#include <future>
#include <iomanip>
#include <memory>
#include <mutex>
#include <string>
#include <utility>
#include <
unordered_map
>
#include <
vector
>
#include "proto/example.pb.h"
#include "./securec.h"
...
...
@@ -905,7 +905,7 @@ Status TFReaderOp::LoadIntList(const ColDescriptor ¤t_col, const dataengin
return
Status
::
OK
();
}
Status
TFReaderOp
::
CreateSchema
(
const
std
::
string
tf_file
,
const
std
::
vector
<
std
::
string
>
&
columns_to_load
)
{
Status
TFReaderOp
::
CreateSchema
(
const
std
::
string
tf_file
,
std
::
vector
<
std
::
string
>
columns_to_load
)
{
std
::
ifstream
reader
;
reader
.
open
(
tf_file
);
...
...
@@ -926,12 +926,14 @@ Status TFReaderOp::CreateSchema(const std::string tf_file, const std::vector<std
const
dataengine
::
Features
&
example_features
=
example
.
features
();
const
google
::
protobuf
::
Map
<
std
::
string
,
dataengine
::
Feature
>
&
feature_map
=
example_features
.
feature
();
std
::
vector
<
std
::
string
>
columns
=
columns_to_load
;
if
(
columns_to_load
.
empty
())
(
void
)
std
::
transform
(
feature_map
.
begin
(),
feature_map
.
end
(),
std
::
back_inserter
(
columns
),
if
(
columns_to_load
.
empty
())
{
(
void
)
std
::
transform
(
feature_map
.
begin
(),
feature_map
.
end
(),
std
::
back_inserter
(
columns
_to_load
),
[](
const
auto
&
it
)
->
std
::
string
{
return
it
.
first
;
});
for
(
const
auto
&
curr_col_name
:
columns
)
{
std
::
sort
(
columns_to_load
.
begin
(),
columns_to_load
.
end
());
}
for
(
const
auto
&
curr_col_name
:
columns_to_load
)
{
auto
it
=
feature_map
.
find
(
curr_col_name
);
if
(
it
==
feature_map
.
end
())
{
RETURN_STATUS_UNEXPECTED
(
"Failed to find column "
+
curr_col_name
);
...
...
mindspore/ccsrc/dataset/engine/datasetops/source/tf_reader_op.h
浏览文件 @
cd90dfa1
...
...
@@ -335,7 +335,7 @@ class TFReaderOp : public ParallelOp {
// Reads one row of data from a tf file and creates a schema based on that row
// @return Status - the error code returned.
Status
CreateSchema
(
const
std
::
string
tf_file
,
const
std
::
vector
<
std
::
string
>
&
columns_to_load
);
Status
CreateSchema
(
const
std
::
string
tf_file
,
std
::
vector
<
std
::
string
>
columns_to_load
);
// Meant to be called async. Will read files in the range [begin, end) and return the total rows
// @param filenames - a list of tf data filenames.
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录