Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
PaddlePaddle
PaddleRec
提交
8ef34ea6
P
PaddleRec
项目概览
PaddlePaddle
/
PaddleRec
通知
68
Star
12
Fork
5
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
27
列表
看板
标记
里程碑
合并请求
10
Wiki
1
Wiki
分析
仓库
DevOps
项目成员
Pages
P
PaddleRec
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
27
Issue
27
列表
看板
标记
里程碑
合并请求
10
合并请求
10
Pages
分析
分析
仓库分析
DevOps
Wiki
1
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
8ef34ea6
编写于
8月 13, 2020
作者:
M
malin10
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
update w2v
上级
c5908fe6
变更
3
显示空白变更内容
内联
并排
Showing
3 changed file
with
20 addition
and
14 deletion
+20
-14
doc/imgs/w2v_train.png
doc/imgs/w2v_train.png
+0
-0
models/recall/word2vec/README.md
models/recall/word2vec/README.md
+7
-3
models/recall/word2vec/config.yaml
models/recall/word2vec/config.yaml
+13
-11
未找到文件。
doc/imgs/w2v_train.png
0 → 100644
浏览文件 @
8ef34ea6
223.3 KB
models/recall/word2vec/README.md
浏览文件 @
8ef34ea6
...
@@ -38,11 +38,15 @@
...
@@ -38,11 +38,15 @@
-
[
FAQ
](
#FAQ
)
-
[
FAQ
](
#FAQ
)
## 模型简介
## 模型简介
本例实现了skip-gram模式的word2vector模型,如下图中的skip-gram部分:
本例实现了skip-gram模式的word2vector模型,如下图所示:
![](
https://ai-studio-static-online.cdn.bcebos.com/bf0217bcb42e455284290a100670072989d432939b7e43e38b78eea6b60732c0
)
<p
align=
"center"
>
<img
align=
"center"
src=
"../../../doc/imgs/word2vec.png"
>
<p>
以每一个词为中心词X,然后在窗口内和临近的词Y组成样本对(X,Y)用于网络训练。在实际训练过程中还会根据自定义的负采样率生成负样本来加强训练的效果
以每一个词为中心词X,然后在窗口内和临近的词Y组成样本对(X,Y)用于网络训练。在实际训练过程中还会根据自定义的负采样率生成负样本来加强训练的效果
具体的训练思路如下:
具体的训练思路如下:
![](
https://ai-studio-static-online.cdn.bcebos.com/ad45d6dfff2f4fa69c639a6b5d2bbe46c79ac67658464aa0a069a04eb2800cb6
)
<p
align=
"center"
>
<img
align=
"center"
src=
"../../../doc/imgs/w2v_train.png"
>
<p>
推荐用户参考
[
IPython Notebook demo
](
https://aistudio.baidu.com/aistudio/projectDetail/124377
)
教程获取更详细的信息。
推荐用户参考
[
IPython Notebook demo
](
https://aistudio.baidu.com/aistudio/projectDetail/124377
)
教程获取更详细的信息。
...
...
models/recall/word2vec/config.yaml
浏览文件 @
8ef34ea6
...
@@ -42,38 +42,40 @@ hyper_parameters:
...
@@ -42,38 +42,40 @@ hyper_parameters:
window_size
:
5
window_size
:
5
# select runner by name
# select runner by name
mode
:
train_runner
mode
:
[
single_cpu_train
,
single_cpu_infer
]
# config of each runner.
# config of each runner.
# runner is a kind of paddle training class, which wraps the train/infer process.
# runner is a kind of paddle training class, which wraps the train/infer process.
runner
:
runner
:
-
name
:
train_runner
-
name
:
single_cpu_train
class
:
train
class
:
train
# num of epochs
# num of epochs
epochs
:
2
epochs
:
5
# device to run training or infer
# device to run training or infer
device
:
cpu
device
:
cpu
save_checkpoint_interval
:
1
# save model interval of epochs
save_checkpoint_interval
:
1
# save model interval of epochs
save_inference_interval
:
1
# save inference
save_inference_interval
:
1
# save inference
save_checkpoint_path
:
"
increment"
# save checkpoint path
save_checkpoint_path
:
"
increment
_w2v
"
# save checkpoint path
save_inference_path
:
"
inference"
# save inference path
save_inference_path
:
"
inference
_w2v
"
# save inference path
save_inference_feed_varnames
:
[]
# feed vars of save inference
save_inference_feed_varnames
:
[]
# feed vars of save inference
save_inference_fetch_varnames
:
[]
# fetch vars of save inference
save_inference_fetch_varnames
:
[]
# fetch vars of save inference
init_model_path
:
"
"
# load model path
init_model_path
:
"
"
# load model path
print_interval
:
1
print_interval
:
1
-
name
:
infer_runner
phases
:
[
phase1
]
-
name
:
single_cpu_infer
class
:
infer
class
:
infer
# device to run training or infer
# device to run training or infer
device
:
cpu
device
:
cpu
init_model_path
:
"
increment
/0
"
# load model path
init_model_path
:
"
increment
_w2v
"
# load model path
print_interval
:
1
print_interval
:
1
phases
:
[
phase2
]
# runner will run all the phase in each epoch
# runner will run all the phase in each epoch
phase
:
phase
:
-
name
:
phase1
-
name
:
phase1
model
:
"
{workspace}/model.py"
# user-defined model
model
:
"
{workspace}/model.py"
# user-defined model
dataset_name
:
dataset_train
# select dataset by name
dataset_name
:
dataset_train
# select dataset by name
thread_num
:
5
-
name
:
phase2
model
:
"
{workspace}/model.py"
# user-defined model
dataset_name
:
dataset_infer
# select dataset by name
thread_num
:
1
thread_num
:
1
# - name: phase2
# model: "{workspace}/model.py" # user-defined model
# dataset_name: dataset_infer # select dataset by name
# thread_num: 1
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录