Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
PaddleHub
提交
2773c85b
P
PaddleHub
项目概览
PaddlePaddle
/
PaddleHub
大约 1 年 前同步成功
通知
282
Star
12117
Fork
2091
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
200
列表
看板
标记
里程碑
合并请求
4
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
PaddleHub
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
200
Issue
200
列表
看板
标记
里程碑
合并请求
4
合并请求
4
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
2773c85b
编写于
4月 19, 2019
作者:
Z
Zeyu Chen
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
update config and demo
上级
1510df97
变更
3
隐藏空白更改
内联
并排
Showing
3 changed file
with
13 addition
and
33 deletion
+13
-33
demo/text-classification/simple_demo.py
demo/text-classification/simple_demo.py
+9
-29
paddlehub/finetune/config.py
paddlehub/finetune/config.py
+3
-3
paddlehub/module/module.py
paddlehub/module/module.py
+1
-1
未找到文件。
demo/text-classification/simple_demo.py
浏览文件 @
2773c85b
import
paddle.fluid
as
fluid
import
paddle.fluid
as
fluid
import
paddlehub
as
hub
import
paddlehub
as
hub
# Step1: Select pre-trained model
module
=
hub
.
Module
(
name
=
"ernie"
)
module
=
hub
.
Module
(
name
=
"ernie"
)
inputs
,
outputs
,
program
=
module
.
context
(
trainable
=
True
,
max_seq_len
=
128
)
inputs
,
outputs
,
program
=
module
.
context
(
trainable
=
True
)
reader
=
hub
.
reader
.
ClassifyReader
(
hub
.
dataset
.
ChnSentiCorp
(),
# Step2: Prepare Dataset and DataReader
module
.
get_vocab_path
())
dataset
=
hub
.
dataset
.
ChnSentiCorp
()
task
=
hub
.
create_text_cls_task
(
feature
=
outputs
[
"pooled_output"
],
num_classes
=
2
)
reader
=
hub
.
reader
.
ClassifyReader
(
strategy
=
hub
.
AdamWeightDecayStrategy
(
learning_rate
=
5e-5
)
dataset
=
dataset
,
vocab_path
=
module
.
get_vocab_path
(),
max_seq_len
=
128
)
config
=
hub
.
RunConfig
(
use_cuda
=
True
,
num_epoch
=
3
,
strategy
=
strategy
)
# Step3: Construct transfer learning task
with
fluid
.
program_guard
(
program
):
label
=
fluid
.
layers
.
data
(
name
=
"label"
,
shape
=
[
1
],
dtype
=
'int64'
)
pooled_output
=
outputs
[
"pooled_output"
]
cls_task
=
hub
.
create_text_cls_task
(
feature
=
pooled_output
,
label
=
label
,
num_classes
=
dataset
.
num_labels
)
# Step4: Setup config then start finetune
strategy
=
hub
.
AdamWeightDecayStrategy
(
learning_rate
=
5e-5
,
weight_decay
=
0.01
)
config
=
hub
.
RunConfig
(
use_cuda
=
True
,
checkpoint_dir
=
"./ckpt"
,
num_epoch
=
3
,
batch_size
=
32
,
strategy
=
strategy
)
feed_list
=
[
feed_list
=
[
inputs
[
"input_ids"
].
name
,
inputs
[
"position_ids"
].
name
,
inputs
[
"input_ids"
].
name
,
inputs
[
"position_ids"
].
name
,
inputs
[
"segment_ids"
].
name
,
inputs
[
"input_mask"
].
name
,
label
.
name
inputs
[
"segment_ids"
].
name
,
inputs
[
"input_mask"
].
name
,
task
.
variable
(
"label"
).
name
]
]
hub
.
finetune_and_eval
(
task
,
reader
,
feed_list
,
config
)
hub
.
finetune_and_eval
(
task
=
cls_task
,
data_reader
=
reader
,
feed_list
=
feed_list
,
config
=
config
)
paddlehub/finetune/config.py
浏览文件 @
2773c85b
...
@@ -30,10 +30,10 @@ class RunConfig(object):
...
@@ -30,10 +30,10 @@ class RunConfig(object):
log_interval
=
10
,
log_interval
=
10
,
eval_interval
=
100
,
eval_interval
=
100
,
save_ckpt_interval
=
None
,
save_ckpt_interval
=
None
,
use_cuda
=
Fals
e
,
use_cuda
=
Tru
e
,
checkpoint_dir
=
None
,
checkpoint_dir
=
None
,
num_epoch
=
1
0
,
num_epoch
=
1
,
batch_size
=
None
,
batch_size
=
32
,
enable_memory_optim
=
True
,
enable_memory_optim
=
True
,
strategy
=
None
):
strategy
=
None
):
""" Construct finetune Config """
""" Construct finetune Config """
...
...
paddlehub/module/module.py
浏览文件 @
2773c85b
...
@@ -469,7 +469,7 @@ class Module(object):
...
@@ -469,7 +469,7 @@ class Module(object):
def
context
(
self
,
def
context
(
self
,
sign_name
=
None
,
sign_name
=
None
,
for_test
=
False
,
for_test
=
False
,
trainable
=
Fals
e
,
trainable
=
Tru
e
,
regularizer
=
None
,
regularizer
=
None
,
max_seq_len
=
128
,
max_seq_len
=
128
,
learning_rate
=
1e-3
):
learning_rate
=
1e-3
):
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录