Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
夏有凉风,冬有雪
Paddle
提交
62b20ca0
P
Paddle
项目概览
夏有凉风,冬有雪
/
Paddle
与 Fork 源项目一致
Fork自
PaddlePaddle / Paddle
通知
1
Star
1
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
1
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
Paddle
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
1
Issue
1
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
62b20ca0
编写于
12月 13, 2016
作者:
W
wangyanfei01
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
refine data_sources.py and PyDataProvider2.py to make more readable
上级
f8e8d1ad
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
13 addition
and
19 deletion
+13
-19
python/paddle/trainer/PyDataProvider2.py
python/paddle/trainer/PyDataProvider2.py
+1
-3
python/paddle/trainer_config_helpers/data_sources.py
python/paddle/trainer_config_helpers/data_sources.py
+12
-16
未找到文件。
python/paddle/trainer/PyDataProvider2.py
浏览文件 @
62b20ca0
...
@@ -106,9 +106,7 @@ def integer_value_sequence(dim):
...
@@ -106,9 +106,7 @@ def integer_value_sequence(dim):
def
integer_value_sub_sequence
(
dim
):
def
integer_value_sub_sequence
(
dim
):
return
integer_value
(
dim
,
seq_type
=
SequenceType
.
SUB_SEQUENCE
)
return
integer_value
(
dim
,
seq_type
=
SequenceType
.
SUB_SEQUENCE
)
integer_sequence
=
integer_value_sequence
def
integer_sequence
(
dim
):
return
index_slot
(
dim
,
seq_type
=
SequenceType
.
SEQUENCE
)
class
SingleSlotWrapper
(
object
):
class
SingleSlotWrapper
(
object
):
...
...
python/paddle/trainer_config_helpers/data_sources.py
浏览文件 @
62b20ca0
...
@@ -78,21 +78,6 @@ def define_py_data_source(file_list,
...
@@ -78,21 +78,6 @@ def define_py_data_source(file_list,
if
not
isinstance
(
args
,
basestring
)
and
args
is
not
None
:
if
not
isinstance
(
args
,
basestring
)
and
args
is
not
None
:
args
=
pickle
.
dumps
(
args
,
0
)
args
=
pickle
.
dumps
(
args
,
0
)
if
data_cls
is
None
:
def
py_data2
(
files
,
load_data_module
,
load_data_object
,
load_data_args
,
**
kwargs
):
data
=
DataBase
()
data
.
type
=
'py2'
data
.
files
=
files
data
.
load_data_module
=
load_data_module
data
.
load_data_object
=
load_data_object
data
.
load_data_args
=
load_data_args
data
.
async_load_data
=
True
return
data
data_cls
=
py_data2
cls
(
cls
(
data_cls
(
data_cls
(
files
=
file_list
,
files
=
file_list
,
...
@@ -207,10 +192,21 @@ def define_py_data_sources2(train_list, test_list, module, obj, args=None):
...
@@ -207,10 +192,21 @@ def define_py_data_sources2(train_list, test_list, module, obj, args=None):
:return: None
:return: None
:rtype: None
:rtype: None
"""
"""
def
py_data2
(
files
,
load_data_module
,
load_data_object
,
load_data_args
,
**
kwargs
):
data
=
DataBase
()
data
.
type
=
'py2'
data
.
files
=
files
data
.
load_data_module
=
load_data_module
data
.
load_data_object
=
load_data_object
data
.
load_data_args
=
load_data_args
data
.
async_load_data
=
True
return
data
define_py_data_sources
(
define_py_data_sources
(
train_list
=
train_list
,
train_list
=
train_list
,
test_list
=
test_list
,
test_list
=
test_list
,
module
=
module
,
module
=
module
,
obj
=
obj
,
obj
=
obj
,
args
=
args
,
args
=
args
,
data_cls
=
None
)
data_cls
=
py_data2
)
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录