From 3e096aa089384d15ce9b207a8f6af9001bea84e9 Mon Sep 17 00:00:00 2001
From: Travis CI
所以,减小这个内存池即可减小内存占用,同时也可以加速开始训练前数据载入的过程。但是,这 个内存池实际上决定了shuffle的粒度。所以,如果将这个内存池减小,又要保证数据是随机的, 那么最好将数据文件在每次读取之前做一次shuffle。可能的代码为
-# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserve.
+# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
@@ -307,7 +307,7 @@ PaddlePaddle的内存占用主要分为如下几个方面:
减少数据载入的耗时¶
使用pydataprovider
时,可以减少缓存池的大小,同时设置内存缓存功能,即可以极大的加速数据载入流程。
DataProvider
缓存池的减小,和之前减小通过减小缓存池来减小内存占用的原理一致。
-# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserve.
+# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
@@ -337,7 +337,7 @@ PaddlePaddle的内存占用主要分为如下几个方面:
PaddlePaddle支持Sparse的训练,sparse训练需要训练特征是 sparse_binary_vector
、 sparse_vector
、或者 integer_value
的任一一种。同时,与这个训练数据交互的Layer,需要将其Parameter设置成 sparse 更新模式,即设置 sparse_update=True
这里使用简单的 word2vec
训练语言模型距离,具体使用方法为:
使用一个词前两个词和后两个词,来预测这个中间的词。这个任务的DataProvider为:
-# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserve.
+# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
@@ -364,7 +364,7 @@ PaddlePaddle的内存占用主要分为如下几个方面:
这个任务的配置为:
-# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserve.
+# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
diff --git a/develop/doc_cn/getstarted/concepts/use_concepts_cn.html b/develop/doc_cn/getstarted/concepts/use_concepts_cn.html
index c1d8fb399c..fd0f25d123 100644
--- a/develop/doc_cn/getstarted/concepts/use_concepts_cn.html
+++ b/develop/doc_cn/getstarted/concepts/use_concepts_cn.html
@@ -411,7 +411,7 @@ trainer.train(
68
69
70
-71
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserve.
+71
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
@@ -516,7 +516,7 @@ trainer.train(
29
30
31
-32
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserve.
+32
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
--
GitLab