Skip to content

P
Paddle

机器未来 / Paddle
与 Fork 源项目一致

Fork自 PaddlePaddle / Paddle

通知 1
Star 1
Fork 0
P
Paddle
“b16e832d4d412c5d4e724b3a1d5bff060c9885b4”上不存在“...fluid/platform/git@gitcode.net:paddlepaddle/Paddle.git”
提交 aa789fc3 编写于 作者: T Travis CI
浏览文件
操作

Deploy to GitHub Pages: e2afab47

上级 3f83d0d5
显示空白变更内容
内联 并排
Showing with 1072 addition and 2 deletion
develop/doc/_sources/design/multi_language_interface/why_plain_c.md.txt 0 → 100644
浏览文件 @ aa789fc3
# Paddle多语言接口实现
## 背景
Paddle需要一个多语言接口，这个接口需要做到:
* 有标准的，良好的文档
* 例如Python可以使用[Sphinx](http://www.sphinx-doc.org/en/stable/)生成API文档，golang可以使用[GoDoc](https://godoc.org/golang.org/x/tools/cmd/godoc)生成文档。这都需要这个接口按照约定俗成的规则来注释完备。
* 不同语言的接口适应不同语言的特性
* 例如Java与Python的错误处理是直接扔出来Exception，而对于golang错误处理应该使用返回值。
## 基本要求
Paddle的多语言接口实现包括一下几个方面:
* 我们使用动态库来分发Paddle。在这个动态库中不嵌入任何其他语言的解释器，也不使用其他动态库。
* 这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号。
* 不导出Paddle内部的结构体、类，仅仅使用`void*`指针作为类型的句柄(handler)。
* 不使用SWIG这种代码生成器，而是手写多语言绑定。
## 原因
### 使用动态库来分发Paddle
* Paddle的链接方式比较复杂
* 如果用户要把Paddle的静态库（libpaddle.a）链接到自己的程序里，得使用 `--whole-archive` (for GCC) 或者 `--force_load` (for Clang) 参数，来确保把 libpaddle.a 里所有的符号都写入自己的程序的二进制文件里。这是因为 Paddle 的源码里使用了[object factory design pattern](http://stackoverflow.com/a/1310326/724872)。
* 编译型语言，例如C/C++使用静态库和动态库难度差不多。但是解释性语言，例如[Python](http://stackoverflow.com/questions/19560594/how-to-import-static-library-in-python)或者[Java](http://stackoverflow.com/questions/24493337/linking-static-library-with-jni)，只能调用Paddle的动态库，否则得把Paddle静态库链接到解释器里。
* 解释性语言实际运行的二进制是解释器本身，如果调用静态库只能将静态库与解释器链接。例如对于Java来说，便是将静态库加入JVM中。这对于通常的Java的开发者来说，是不常见的做法。
### 动态库中不嵌入任何其他语言的解释器
* 目前Paddle的进程模型是C++内部驱动Python解释器进行模型配置解析和数据读取
* 我们最终的动态库中不嵌入Python或者其他任何语言的解释器。模型配置解析，数据读取均交由其他语言完成
现阶段Paddle有一个问题是，Paddle内嵌的Python解释器和外部使用的Python如果版本不同，会直接报错退出。
### Paddle动态库中，不引用其他动态库
* 即这个动态库是不依赖于其他任何文件的，可以在任何机器上执行的。
### 这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号
* 由于C++编译器没有[名字修饰](https://en.wikipedia.org/wiki/Name_mangling#C.2B.2B)的规范，不同版本的编译器之间，对于同一段C++代码生成的符号可能不一致。而多语言接口需要直接读取生成的二进制(动态库)，需要有稳定的导出符号。
* C语言是有导出符号的标准的，并且在常见的平台上，都是ABI调用标准的。
* 大多数语言都支持使用C语言API
* 使用C99而不使用C89，是因为C99支持[Fixed-width integer types](https://en.wikipedia.org/wiki/C_data_types#Fixed-width_integer_types)和[Boolean type](https://en.wikipedia.org/wiki/C_data_types#Boolean_type)。
* 使用C99而不使用C11的原因是，[C11](https://en.wikipedia.org/wiki/C11_(C_standard_revision))并没有Paddle特别需要的特性，且C99相对于C11使用更加广泛。
### 不导出Paddle内部的结构体、类，仅仅使用`void*`指针作为类型的句柄(handler)
* Paddle内部的类为C++书写，直接导出到C的接口比较困难。
* 在C-API中使用`void*`来表示Paddle内部类。再在每一个API中自己检查类型。
在C的头文件 `paddle_matrix.h` 中:
```C
typedef void* paddle_matrix;
typedef int paddle_error;
extern "C"
paddle_error paddle_matrix_shape(paddle_matrix matrix,
uint64_t* width,
uint64_t* height);
```
而在CPP里面实现这个C的接口，文件 `paddle_matrix.cpp`
```cpp
#include "paddle/math/matrix.hpp"
extern "C"
paddle_error paddle_matrix_shape(paddle_matrix matrix,
uint64_t *width,
uint64_t *height) {
auto m = (paddle::math::matrix*)(matrix);
*width = m->width();
*height = m->height();
}
```
其中`paddle/math/matrix.hpp`文件内容为:
```cpp
namespace paddle {
namespace math {
class Matrix {
//...
};
} // namespace math
} // namespace paddle
```
### 不使用SWIG这种代码生成器，而是手写多语言绑定
* [SWIG](http://www.swig.org/)是一个多语言接口的代码生成器。他的目标是使用C/C++写代码，SWIG直接读取C/C++的头文件，生成各种语言的绑定代码。
* 对于多语言接口，SWIG需要写一个interface文件。这个文件具有独特的语法，学习成本高。且增加一个第三方语言，就需要对这个第三方语言增加一些定义。有的时候，interface文件的写法非常[tricky](https://github.com/PaddlePaddle/Paddle/blob/develop/paddle/api/Paddle.swig#L36)。社区贡献代码学习成本高。
* SWIG暴露的接口保留了C++的接口样式，很难保证多语言代码风格的一致性。(函数命名，错误处理)
* 因为SWIG在第三方语言中暴露的函数名，类名和C++中完全一致。C++的命名风格并不能适应其他第三方语言。如果使用SWIG我们需要将在interface文件里，将大量的`SomeCppClass`重命名成`some_python_class`，或者`SomeGoTypes`。
* 对于不同语言，错误处理的方式也不尽相同。例如对于Java或者Python，最常见的错误处理方式是Exception，而对于Golang，错误处理方式是返回值。而SWIG只能简单的暴露C++接口，无法做到对于各种语言错误处理方式的适配。
* 对于大多数语言，直接使用C语言的.h并不困难。例如Python的[cffi](https://cffi.readthedocs.io/en/latest/overview.html#simple-example-abi-level-in-line)或者[Cython](http://cython.org/), golang的[cgo](https://golang.org/cmd/cgo/)。
* SWIG支持的语言或者解释器有局限。例如对于Python，使用SWIG只支持CPython解释器，而不支持PyPy解释器。
## 原因列表
| 结论 | 对比 | 原因 |
|---| --- | --- |
| 使用动态库 | 不使用静态库 | 解释型语言只能调用动态库，Paddle静态库链接复杂 |
| 不嵌入其他语言解释器 | 不嵌入Python解释器 | Paddle C++目前嵌入Python解释器，会导致不同版本Python在一个进程里的bug |
| 不引用其他动态库 | | Paddle一个动态库可以在任何Linux系统上运行 |
| 使用C99做接口 | 不使用C++做接口 | C有标准的ABI，C99是目前C最广泛的使用标准，且C99支持bool类型和定长整数(uint64_t等)类型 |
| 使用void*作为类句柄 | 不显示的写每个类具体包含什么| 实现简单，并且让接口脱离实现细节 |
| 手写多语言绑定 | 不使用SWIG | 使用SWIG需要多语言绑定的开发人员熟练掌握SWIG配置，社区参与困难。SWIG生成的代码不能保证多语言代码风格的一致性 |
## 简单实现
TBD
develop/doc/design/multi_language_interface/why_plain_c.html 0 → 100644
浏览文件 @ aa789fc3
<!DOCTYPE html>
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Paddle多语言接口实现 &mdash; PaddlePaddle documentation</title>
<link rel="stylesheet" href="../../_static/css/theme.css" type="text/css" />
<link rel="index" title="Index"
href="../../genindex.html"/>
<link rel="search" title="Search" href="../../search.html"/>
<link rel="top" title="PaddlePaddle documentation" href="../../index.html"/>
<link rel="stylesheet" href="https://cdn.jsdelivr.net/perfect-scrollbar/0.6.14/css/perfect-scrollbar.min.css" type="text/css" />
<link rel="stylesheet" href="../../_static/css/override.css" type="text/css" />
<script>
var _hmt = _hmt || [];
(function() {
var hm = document.createElement("script");
hm.src = "//hm.baidu.com/hm.js?b9a314ab40d04d805655aab1deee08ba";
var s = document.getElementsByTagName("script")[0];
s.parentNode.insertBefore(hm, s);
})();
</script>
<script src="../../_static/js/modernizr.min.js"></script>
</head>
<body class="wy-body-for-nav" role="document">
<header class="site-header">
<div class="site-logo">
<a href="/"><img src="../../_static/images/PP_w.png"></a>
</div>
<div class="site-nav-links">
<div class="site-menu">
<a class="fork-on-github" href="https://github.com/PaddlePaddle/Paddle" target="_blank"><i class="fa fa-github"></i>Folk me on Github</a>
<div class="language-switcher dropdown">
<a type="button" data-toggle="dropdown">
<span>English</span>
<i class="fa fa-angle-up"></i>
<i class="fa fa-angle-down"></i>
</a>
<ul class="dropdown-menu">
<li><a href="/doc_cn">中文</a></li>
<li><a href="/doc">English</a></li>
</ul>
</div>
<ul class="site-page-links">
<li><a>Home</a></li>
<li><a>Get Started</a></li>
<li class="active"><a>Documentation</a></li>
<li><a>About Us</a></li>
</ul>
</div>
<div class="doc-module">
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../getstarted/index_en.html">GET STARTED</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../tutorials/index_en.html">TUTORIALS</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../howto/index_en.html">HOW TO</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../api/index_en.html">API</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../about/index_en.html">ABOUT</a></li>
</ul>
<div role="search">
<form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
<input type="text" name="q" placeholder="Search docs" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
</div>
</div>
</div>
</header>
<div class="main-content-wrap">
<nav class="doc-menu-vertical" role="navigation">
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../getstarted/index_en.html">GET STARTED</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../getstarted/build_and_install/index_en.html">Install and Build</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../getstarted/build_and_install/docker_install_en.html">PaddlePaddle in Docker Containers</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../getstarted/build_and_install/ubuntu_install_en.html">Debian Package installation guide</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../getstarted/build_and_install/build_from_source_en.html">Installing from Sources</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../getstarted/basic_usage/index_en.html">Simple Linear Regression</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../tutorials/index_en.html">TUTORIALS</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/quick_start/index_en.html">Quick Start</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/rec/ml_regression_en.html">MovieLens Regression</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/image_classification/index_en.html">Image Classification</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/sentiment_analysis/index_en.html">Sentiment Analysis</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/semantic_role_labeling/index_en.html">Semantic Role Labeling</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/text_generation/index_en.html">Text Generation</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/gan/index_en.html">Image Auto-Generation</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/imagenet_model/resnet_model_en.html">ImageNet: ResNet</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/embedding_model/index_en.html">Embedding: Chinese Word</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../howto/index_en.html">HOW TO</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/cmd_parameter/index_en.html">Set Command-line Parameters</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../howto/usage/cmd_parameter/use_case_en.html">Use Case</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../howto/usage/cmd_parameter/arguments_en.html">Argument Outline</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../howto/usage/cmd_parameter/detail_introduction_en.html">Detail Description</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/cluster/cluster_train_en.html">Run Distributed Training</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_en.html">Paddle On Kubernetes</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_aws_en.html">Distributed PaddlePaddle Training on AWS with Kubernetes</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/dev/new_layer_en.html">Write New Layers</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/dev/contribute_to_paddle_en.html">Contribute Code</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/deep_model/rnn/index_en.html">RNN Models</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../howto/deep_model/rnn/rnn_config_en.html">RNN Configuration</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/optimization/gpu_profiling_en.html">Tune GPU Performance</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../api/index_en.html">API</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../api/v2/model_configs.html">Model Configuration</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/activation.html">Activation</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/layer.html">Layers</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/optimizer.html">Optimizer</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/pooling.html">Pooling</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/networks.html">Networks</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/attr.html">Parameter Attribute</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../api/v2/data.html">Datasets</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../api/v2/run_logic.html">Training and Inference</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../about/index_en.html">ABOUT</a></li>
</ul>
</nav>
<nav class="local-toc"><ul>
<li><a class="reference internal" href="#">Paddle多语言接口实现</a><ul>
<li><a class="reference internal" href="#">背景</a></li>
<li><a class="reference internal" href="#">基本要求</a></li>
<li><a class="reference internal" href="#">原因</a><ul>
<li><a class="reference internal" href="#paddle">使用动态库来分发Paddle</a></li>
<li><a class="reference internal" href="#">动态库中不嵌入任何其他语言的解释器</a></li>
<li><a class="reference internal" href="#paddle">Paddle动态库中，不引用其他动态库</a></li>
<li><a class="reference internal" href="#c99-c">这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号</a></li>
<li><a class="reference internal" href="#paddle-void-handler">不导出Paddle内部的结构体、类，仅仅使用<code class="docutils literal"><span class="pre">void*</span></code>指针作为类型的句柄(handler)</a></li>
<li><a class="reference internal" href="#swig">不使用SWIG这种代码生成器，而是手写多语言绑定</a></li>
</ul>
</li>
<li><a class="reference internal" href="#">原因列表</a></li>
<li><a class="reference internal" href="#">简单实现</a></li>
</ul>
</li>
</ul>
</nav>
<section class="doc-content-wrap">
<div role="navigation" aria-label="breadcrumbs navigation">
<ul class="wy-breadcrumbs">
<li>Paddle多语言接口实现</li>
</ul>
</div>
<div class="wy-nav-content" id="doc-content">
<div class="rst-content">
<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
<div itemprop="articleBody">
<div class="section" id="paddle">
<span id="paddle"></span><h1>Paddle多语言接口实现<a class="headerlink" href="#paddle" title="Permalink to this headline"></a></h1>
<div class="section" id="">
<span id="id1"></span><h2>背景<a class="headerlink" href="#" title="Permalink to this headline"></a></h2>
<p>Paddle需要一个多语言接口，这个接口需要做到:</p>
<ul class="simple">
<li>有标准的，良好的文档<ul>
<li>例如Python可以使用<a class="reference external" href="http://www.sphinx-doc.org/en/stable/">Sphinx</a>生成API文档，golang可以使用<a class="reference external" href="https://godoc.org/golang.org/x/tools/cmd/godoc">GoDoc</a>生成文档。这都需要这个接口按照约定俗成的规则来注释完备。</li>
</ul>
</li>
<li>不同语言的接口适应不同语言的特性<ul>
<li>例如Java与Python的错误处理是直接扔出来Exception，而对于golang错误处理应该使用返回值。</li>
</ul>
</li>
</ul>
</div>
<div class="section" id="">
<span id="id2"></span><h2>基本要求<a class="headerlink" href="#" title="Permalink to this headline"></a></h2>
<p>Paddle的多语言接口实现包括一下几个方面:</p>
<ul class="simple">
<li>我们使用动态库来分发Paddle。在这个动态库中不嵌入任何其他语言的解释器，也不使用其他动态库。</li>
<li>这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号。</li>
<li>不导出Paddle内部的结构体、类，仅仅使用<code class="docutils literal"><span class="pre">void*</span></code>指针作为类型的句柄(handler)。</li>
<li>不使用SWIG这种代码生成器，而是手写多语言绑定。</li>
</ul>
</div>
<div class="section" id="">
<span id="id3"></span><h2>原因<a class="headerlink" href="#" title="Permalink to this headline"></a></h2>
<div class="section" id="paddle">
<span id="id4"></span><h3>使用动态库来分发Paddle<a class="headerlink" href="#paddle" title="Permalink to this headline"></a></h3>
<ul class="simple">
<li>Paddle的链接方式比较复杂<ul>
<li>如果用户要把Paddle的静态库（libpaddle.a）链接到自己的程序里，得使用 <code class="docutils literal"><span class="pre">--whole-archive</span></code> (for GCC) 或者 <code class="docutils literal"><span class="pre">--force_load</span></code> (for Clang) 参数，来确保把 libpaddle.a 里所有的符号都写入自己的程序的二进制文件里。这是因为 Paddle 的源码里使用了<a class="reference external" href="http://stackoverflow.com/a/1310326/724872">object factory design pattern</a>。</li>
</ul>
</li>
<li>编译型语言，例如C/C++使用静态库和动态库难度差不多。但是解释性语言，例如<a class="reference external" href="http://stackoverflow.com/questions/19560594/how-to-import-static-library-in-python">Python</a>或者<a class="reference external" href="http://stackoverflow.com/questions/24493337/linking-static-library-with-jni">Java</a>，只能调用Paddle的动态库，否则得把Paddle静态库链接到解释器里。<ul>
<li>解释性语言实际运行的二进制是解释器本身，如果调用静态库只能将静态库与解释器链接。例如对于Java来说，便是将静态库加入JVM中。这对于通常的Java的开发者来说，是不常见的做法。</li>
</ul>
</li>
</ul>
</div>
<div class="section" id="">
<span id="id5"></span><h3>动态库中不嵌入任何其他语言的解释器<a class="headerlink" href="#" title="Permalink to this headline"></a></h3>
<ul class="simple">
<li>目前Paddle的进程模型是C++内部驱动Python解释器进行模型配置解析和数据读取</li>
<li>我们最终的动态库中不嵌入Python或者其他任何语言的解释器。模型配置解析，数据读取均交由其他语言完成</li>
</ul>
<p>现阶段Paddle有一个问题是，Paddle内嵌的Python解释器和外部使用的Python如果版本不同，会直接报错退出。</p>
</div>
<div class="section" id="paddle">
<span id="id6"></span><h3>Paddle动态库中，不引用其他动态库<a class="headerlink" href="#paddle" title="Permalink to this headline"></a></h3>
<ul class="simple">
<li>即这个动态库是不依赖于其他任何文件的，可以在任何机器上执行的。</li>
</ul>
</div>
<div class="section" id="c99-c">
<span id="c99-c"></span><h3>这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号<a class="headerlink" href="#c99-c" title="Permalink to this headline"></a></h3>
<ul class="simple">
<li>由于C++编译器没有<a class="reference external" href="https://en.wikipedia.org/wiki/Name_mangling#C.2B.2B">名字修饰</a>的规范，不同版本的编译器之间，对于同一段C++代码生成的符号可能不一致。而多语言接口需要直接读取生成的二进制(动态库)，需要有稳定的导出符号。</li>
<li>C语言是有导出符号的标准的，并且在常见的平台上，都是ABI调用标准的。</li>
<li>大多数语言都支持使用C语言API</li>
<li>使用C99而不使用C89，是因为C99支持<a class="reference external" href="https://en.wikipedia.org/wiki/C_data_types#Fixed-width_integer_types">Fixed-width integer types</a>和<a class="reference external" href="https://en.wikipedia.org/wiki/C_data_types#Boolean_type">Boolean type</a>。</li>
<li>使用C99而不使用C11的原因是，<a class="reference external" href="https://en.wikipedia.org/wiki/C11_(C_standard_revision)">C11</a>并没有Paddle特别需要的特性，且C99相对于C11使用更加广泛。</li>
</ul>
</div>
<div class="section" id="paddle-void-handler">
<span id="paddle-void-handler"></span><h3>不导出Paddle内部的结构体、类，仅仅使用<code class="docutils literal"><span class="pre">void*</span></code>指针作为类型的句柄(handler)<a class="headerlink" href="#paddle-void-handler" title="Permalink to this headline"></a></h3>
<ul class="simple">
<li>Paddle内部的类为C++书写，直接导出到C的接口比较困难。</li>
<li>在C-API中使用<code class="docutils literal"><span class="pre">void*</span></code>来表示Paddle内部类。再在每一个API中自己检查类型。</li>
</ul>
<p>在C的头文件 <code class="docutils literal"><span class="pre">paddle_matrix.h</span></code> 中:</p>
<div class="highlight-C"><div class="highlight"><pre><span></span><span class="k">typedef</span> <span class="kt">void</span><span class="o">*</span> <span class="n">paddle_matrix</span><span class="p">;</span>
<span class="k">typedef</span> <span class="kt">int</span> <span class="n">paddle_error</span><span class="p">;</span>
<span class="k">extern</span> <span class="s">&quot;C&quot;</span>
<span class="n">paddle_error</span> <span class="n">paddle_matrix_shape</span><span class="p">(</span><span class="n">paddle_matrix</span> <span class="n">matrix</span><span class="p">,</span>
<span class="kt">uint64_t</span><span class="o">*</span> <span class="n">width</span><span class="p">,</span>
<span class="kt">uint64_t</span><span class="o">*</span> <span class="n">height</span><span class="p">);</span>
</pre></div>
</div>
<p>而在CPP里面实现这个C的接口，文件 <code class="docutils literal"><span class="pre">paddle_matrix.cpp</span></code></p>
<div class="highlight-cpp"><div class="highlight"><pre><span></span><span class="cp">#include</span> <span class="cpf">&quot;paddle/math/matrix.hpp&quot;</span><span class="cp"></span>
<span class="k">extern</span> <span class="s">&quot;C&quot;</span>
<span class="n">paddle_error</span> <span class="n">paddle_matrix_shape</span><span class="p">(</span><span class="n">paddle_matrix</span> <span class="n">matrix</span><span class="p">,</span>
<span class="kt">uint64_t</span> <span class="o">*</span><span class="n">width</span><span class="p">,</span>
<span class="kt">uint64_t</span> <span class="o">*</span><span class="n">height</span><span class="p">)</span> <span class="p">{</span>
<span class="k">auto</span> <span class="n">m</span> <span class="o">=</span> <span class="p">(</span><span class="n">paddle</span><span class="o">::</span><span class="n">math</span><span class="o">::</span><span class="n">matrix</span><span class="o">*</span><span class="p">)(</span><span class="n">matrix</span><span class="p">);</span>
<span class="o">*</span><span class="n">width</span> <span class="o">=</span> <span class="n">m</span><span class="o">-&gt;</span><span class="n">width</span><span class="p">();</span>
<span class="o">*</span><span class="n">height</span> <span class="o">=</span> <span class="n">m</span><span class="o">-&gt;</span><span class="n">height</span><span class="p">();</span>
<span class="p">}</span>
</pre></div>
</div>
<p>其中<code class="docutils literal"><span class="pre">paddle/math/matrix.hpp</span></code>文件内容为:</p>
<div class="highlight-cpp"><div class="highlight"><pre><span></span><span class="k">namespace</span> <span class="n">paddle</span> <span class="p">{</span>
<span class="k">namespace</span> <span class="n">math</span> <span class="p">{</span>
<span class="k">class</span> <span class="nc">Matrix</span> <span class="p">{</span>
<span class="c1">//...</span>
<span class="p">};</span>
<span class="p">}</span> <span class="c1">// namespace math</span>
<span class="p">}</span> <span class="c1">// namespace paddle</span>
</pre></div>
</div>
</div>
<div class="section" id="swig">
<span id="swig"></span><h3>不使用SWIG这种代码生成器，而是手写多语言绑定<a class="headerlink" href="#swig" title="Permalink to this headline"></a></h3>
<ul class="simple">
<li><a class="reference external" href="http://www.swig.org/">SWIG</a>是一个多语言接口的代码生成器。他的目标是使用C/C++写代码，SWIG直接读取C/C++的头文件，生成各种语言的绑定代码。<ul>
<li>对于多语言接口，SWIG需要写一个interface文件。这个文件具有独特的语法，学习成本高。且增加一个第三方语言，就需要对这个第三方语言增加一些定义。有的时候，interface文件的写法非常<a class="reference external" href="https://github.com/PaddlePaddle/Paddle/blob/develop/paddle/api/Paddle.swig#L36">tricky</a>。社区贡献代码学习成本高。</li>
<li>SWIG暴露的接口保留了C++的接口样式，很难保证多语言代码风格的一致性。(函数命名，错误处理)<ul>
<li>因为SWIG在第三方语言中暴露的函数名，类名和C++中完全一致。C++的命名风格并不能适应其他第三方语言。如果使用SWIG我们需要将在interface文件里，将大量的<code class="docutils literal"><span class="pre">SomeCppClass</span></code>重命名成<code class="docutils literal"><span class="pre">some_python_class</span></code>，或者<code class="docutils literal"><span class="pre">SomeGoTypes</span></code>。</li>
<li>对于不同语言，错误处理的方式也不尽相同。例如对于Java或者Python，最常见的错误处理方式是Exception，而对于Golang，错误处理方式是返回值。而SWIG只能简单的暴露C++接口，无法做到对于各种语言错误处理方式的适配。</li>
</ul>
</li>
<li>对于大多数语言，直接使用C语言的.h并不困难。例如Python的<a class="reference external" href="https://cffi.readthedocs.io/en/latest/overview.html#simple-example-abi-level-in-line">cffi</a>或者<a class="reference external" href="http://cython.org/">Cython</a>, golang的<a class="reference external" href="https://golang.org/cmd/cgo/">cgo</a>。</li>
<li>SWIG支持的语言或者解释器有局限。例如对于Python，使用SWIG只支持CPython解释器，而不支持PyPy解释器。</li>
</ul>
</li>
</ul>
</div>
</div>
<div class="section" id="">
<span id="id7"></span><h2>原因列表<a class="headerlink" href="#" title="Permalink to this headline"></a></h2>
<p>| 结论 | 对比 | 原因 |
|&#8212;| &#8212; | &#8212; |
| 使用动态库 | 不使用静态库 | 解释型语言只能调用动态库，Paddle静态库链接复杂 |
| 不嵌入其他语言解释器 | 不嵌入Python解释器 | Paddle C++目前嵌入Python解释器，会导致不同版本Python在一个进程里的bug |
| 不引用其他动态库 | | Paddle一个动态库可以在任何Linux系统上运行 |
| 使用C99做接口 | 不使用C++做接口 | C有标准的ABI，C99是目前C最广泛的使用标准，且C99支持bool类型和定长整数(uint64_t等)类型 |
| 使用void*作为类句柄 | 不显示的写每个类具体包含什么| 实现简单，并且让接口脱离实现细节 |
| 手写多语言绑定 | 不使用SWIG | 使用SWIG需要多语言绑定的开发人员熟练掌握SWIG配置，社区参与困难。SWIG生成的代码不能保证多语言代码风格的一致性 |</p>
</div>
<div class="section" id="">
<span id="id8"></span><h2>简单实现<a class="headerlink" href="#" title="Permalink to this headline"></a></h2>
<p>TBD</p>
</div>
</div>
</div>
</div>
<footer>
<hr/>
<div role="contentinfo">
<p>
&copy; Copyright 2016, PaddlePaddle developers.
</p>
</div>
Built with <a href="http://sphinx-doc.org/">Sphinx</a> using a <a href="https://github.com/snide/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>.
</footer>
</div>
</div>
</section>
</div>
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT:'../../',
VERSION:'',
COLLAPSE_INDEX:false,
FILE_SUFFIX:'.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="../../_static/jquery.js"></script>
<script type="text/javascript" src="../../_static/underscore.js"></script>
<script type="text/javascript" src="../../_static/doctools.js"></script>
<script type="text/javascript" src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/javascript" src="../../_static/js/theme.js"></script>
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js" integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script>
<script src="https://cdn.jsdelivr.net/perfect-scrollbar/0.6.14/js/perfect-scrollbar.jquery.min.js"></script>
<script src="../../_static/js/paddle_doc_init.js"></script>
</body>
</html>
\ No newline at end of file
develop/doc/searchindex.js
浏览文件 @ aa789fc3
Search.setIndex({docnames:["about/index_en","api/index_en","api/v1/data_provider/dataprovider_en","api/v1/data_provider/pydataprovider2_en","api/v1/index_en","api/v1/predict/swig_py_paddle_en","api/v1/trainer_config_helpers/activations","api/v1/trainer_config_helpers/attrs","api/v1/trainer_config_helpers/data_sources","api/v1/trainer_config_helpers/evaluators","api/v1/trainer_config_helpers/layers","api/v1/trainer_config_helpers/networks","api/v1/trainer_config_helpers/optimizers","api/v1/trainer_config_helpers/poolings","api/v2/config/activation","api/v2/config/attr","api/v2/config/layer","api/v2/config/networks","api/v2/config/optimizer","api/v2/config/pooling","api/v2/data","api/v2/model_configs","api/v2/run_logic","design/api","design/reader/README","getstarted/basic_usage/index_en","getstarted/build_and_install/build_from_source_en","getstarted/build_and_install/docker_install_en","getstarted/build_and_install/index_en","getstarted/build_and_install/ubuntu_install_en","getstarted/index_en","howto/deep_model/rnn/index_en","howto/deep_model/rnn/rnn_config_en","howto/dev/contribute_to_paddle_en","howto/dev/new_layer_en","howto/index_en","howto/optimization/gpu_profiling_en","howto/usage/cluster/cluster_train_en","howto/usage/cmd_parameter/arguments_en","howto/usage/cmd_parameter/detail_introduction_en","howto/usage/cmd_parameter/index_en","howto/usage/cmd_parameter/use_case_en","howto/usage/k8s/k8s_aws_en","howto/usage/k8s/k8s_en","howto/usage/k8s/src/k8s_data/README","howto/usage/k8s/src/k8s_train/README","index_en","tutorials/embedding_model/index_en","tutorials/gan/index_en","tutorials/image_classification/index_en","tutorials/imagenet_model/resnet_model_en","tutorials/index_en","tutorials/quick_start/index_en","tutorials/rec/ml_dataset_en","tutorials/rec/ml_regression_en","tutorials/semantic_role_labeling/index_en","tutorials/sentiment_analysis/index_en","tutorials/text_generation/index_en"],envversion:50,filenames:["about/index_en.rst","api/index_en.rst","api/v1/data_provider/dataprovider_en.rst","api/v1/data_provider/pydataprovider2_en.rst","api/v1/index_en.rst","api/v1/predict/swig_py_paddle_en.rst","api/v1/trainer_config_helpers/activations.rst","api/v1/trainer_config_helpers/attrs.rst","api/v1/trainer_config_helpers/data_sources.rst","api/v1/trainer_config_helpers/evaluators.rst","api/v1/trainer_config_helpers/layers.rst","api/v1/trainer_config_helpers/networks.rst","api/v1/trainer_config_helpers/optimizers.rst","api/v1/trainer_config_helpers/poolings.rst","api/v2/config/activation.rst","api/v2/config/attr.rst","api/v2/config/layer.rst","api/v2/config/networks.rst","api/v2/config/optimizer.rst","api/v2/config/pooling.rst","api/v2/data.rst","api/v2/model_configs.rst","api/v2/run_logic.rst","design/api.md","design/reader/README.md","getstarted/basic_usage/index_en.rst","getstarted/build_and_install/build_from_source_en.md","getstarted/build_and_install/docker_install_en.rst","getstarted/build_and_install/index_en.rst","getstarted/build_and_install/ubuntu_install_en.rst","getstarted/index_en.rst","howto/deep_model/rnn/index_en.rst","howto/deep_model/rnn/rnn_config_en.rst","howto/dev/contribute_to_paddle_en.md","howto/dev/new_layer_en.rst","howto/index_en.rst","howto/optimization/gpu_profiling_en.rst","howto/usage/cluster/cluster_train_en.md","howto/usage/cmd_parameter/arguments_en.md","howto/usage/cmd_parameter/detail_introduction_en.md","howto/usage/cmd_parameter/index_en.rst","howto/usage/cmd_parameter/use_case_en.md","howto/usage/k8s/k8s_aws_en.md","howto/usage/k8s/k8s_en.md","howto/usage/k8s/src/k8s_data/README.md","howto/usage/k8s/src/k8s_train/README.md","index_en.rst","tutorials/embedding_model/index_en.md","tutorials/gan/index_en.md","tutorials/image_classification/index_en.md","tutorials/imagenet_model/resnet_model_en.md","tutorials/index_en.md","tutorials/quick_start/index_en.md","tutorials/rec/ml_dataset_en.md","tutorials/rec/ml_regression_en.rst","tutorials/semantic_role_labeling/index_en.md","tutorials/sentiment_analysis/index_en.md","tutorials/text_generation/index_en.md"],objects:{"paddle.trainer.PyDataProvider2":{provider:[3,0,1,""]},"paddle.trainer_config_helpers":{attrs:[7,1,0,"-"],data_sources:[8,1,0,"-"]},"paddle.trainer_config_helpers.attrs":{ExtraAttr:[7,2,1,""],ExtraLayerAttribute:[7,3,1,""],ParamAttr:[7,2,1,""],ParameterAttribute:[7,3,1,""]},"paddle.trainer_config_helpers.attrs.ParameterAttribute":{set_default_parameter_name:[7,4,1,""]},"paddle.trainer_config_helpers.data_sources":{define_py_data_sources2:[8,0,1,""]}},objnames:{"0":["py","function","Python function"],"1":["py","module","Python module"],"2":["py","attribute","Python attribute"],"3":["py","class","Python class"],"4":["py","method","Python method"]},objtypes:{"0":"py:function","1":"py:module","2":"py:attribute","3":"py:class","4":"py:method"},terms:{"0000x":52,"00186201e":5,"00m":36,"02595v1":[10,16],"03m":36,"0424m":36,"0473v3":[11,17],"055ee37d":42,"05d":49,"0630u":36,"06u":36,"0810u":36,"08823112e":5,"0957m":36,"0ab":[10,16],"0rc1":27,"0th":57,"10007_10":56,"10014_7":56,"100gb":36,"100gi":42,"10m":36,"1150u":36,"11e6":43,"12194102e":5,"124n":36,"13m":43,"1490u":36,"15501715e":5,"1550u":36,"15mb":52,"1636k":57,"16mb":52,"16u":36,"173m":50,"173n":36,"1770u":36,"18ad":42,"18e457ce3d362ff5f3febf8e7f85ffec852f70f3b629add10aed84f930a68750":43,"197u":36,"1gb":36,"1st":[47,50,56,57],"202mb":57,"210u":36,"211839e770f7b538e2d8":[11,17],"215n":36,"228u":36,"234m":50,"2520u":36,"252kb":52,"25639710e":5,"25k":52,"2680u":36,"27787406e":5,"279n":36,"27m":36,"285m":36,"2863m":36,"28m":36,"28x28":3,"2977m":36,"2cbf7385":42,"2nd":[10,16,56,57],"302n":36,"30u":36,"32777140e":5,"328n":36,"32u":36,"32x32":49,"331n":36,"3320u":36,"36540484e":5,"365e":42,"36u":36,"3710m":36,"3768m":36,"387u":36,"38u":36,"3920u":36,"39u":36,"3rd":[54,56,57],"4035m":36,"4090u":36,"4096mb":39,"4279m":36,"43630644e":5,"43u":36,"448a5b355b84":43,"4560u":36,"4563m":36,"45u":36,"4650u":36,"4726m":36,"473m":43,"48565123e":5,"48684503e":5,"49316648e":5,"4gb":39,"50bd":42,"50gi":42,"51111044e":5,"514u":36,"525n":36,"526u":36,"53018653e":5,"536u":36,"5460u":36,"5470u":36,"54u":36,"55g":57,"5690m":36,"573u":36,"578n":36,"5798m":36,"586u":36,"58s":43,"5969m":36,"6080u":36,"6082v4":[10,16],"6140u":36,"6305m":36,"639u":36,"655u":36,"6780u":36,"6810u":36,"682u":36,"6970u":36,"6ce9":42,"6node":37,"6th":57,"704u":36,"70634608e":5,"7090u":36,"72296313e":5,"72u":36,"73u":36,"75u":36,"760u":36,"767u":36,"783n":36,"784u":36,"78m":36,"7eamaa":20,"7kb":43,"8250u":36,"8300u":36,"830n":36,"849m":36,"85625684e":5,"861u":36,"864k":57,"8661m":36,"892m":36,"901n":36,"90u":36,"918u":36,"9247m":36,"924n":36,"9261m":36,"93137714e":5,"9330m":36,"94u":36,"9530m":36,"96644767e":5,"983m":36,"988u":36,"997u":36,"99982715e":5,"99m":50,"99u":36,"9f18":43,"\u7ea2\u697c\u68a6":47,"\ufb01xed":57,"abstract":[34,39],"break":52,"case":[10,16,24,25,32,33,34,36,40,42,48,52],"char":54,"class":[5,7,10,12,14,15,16,17,19,20,23,38,49,56],"const":34,"default":[3,7,9,10,11,12,15,16,17,19,20,22,23,27,37,39,41,42,43,52,54,56,57],"export":[26,27,49],"final":[11,17,25,26,34,54,56],"float":[3,7,9,10,12,15,16,20,25,34,36,41,47,50,54],"function":[3,5,8,10,11,12,16,17,20,23,24,25,32,34,36,37,39,48,49,52,55,56,57],"import":[3,5,9,10,16,23,25,27,32,36,42,47,48,49,50,52,54,56,57],"int":[3,7,9,10,11,12,15,16,17,20,24,34,41,52,54,55],"long":[2,10,11,16,17,20,27,36,55,56],"new":[3,10,16,20,24,33,35,42,43,48,52,55,56],"null":[10,34,39,54],"public":[34,37,42,43,56],"return":[3,8,9,10,11,16,17,19,20,22,23,25,32,34,42,48,50,52,53,54,57],"short":[10,11,16,17,25,54,55,56],"static":[10,42],"super":34,"switch":[42,56],"throw":42,"true":[3,7,9,10,11,12,15,16,17,19,20,23,24,25,32,34,39,41,42,50,54,55,56,57],"try":[12,24,36,48,54],"void":34,"while":[2,3,7,9,15,20,24,32,39,48,52,56,57],AGE:[42,43],AND:54,ARE:54,AWS:[35,44,45],Abs:6,Age:53,And:[3,9,10,12,16,24,27,29,33,41,42,43,47,50,54,56,57],But:[3,10,11,16,17],EOS:[10,16],For:[2,3,8,9,10,12,16,20,23,24,25,26,27,32,34,36,37,38,39,41,47,49,50,52,56,57],Going:56,Has:3,IDs:52,Ids:52,Into:42,Its:[3,32,42,54],Not:[23,37],ONE:3,One:[9,10,11,17,32,34,39,48,52,56,57],QoS:43,THE:3,TLS:[23,42],That:[10,16,20,24,27,39,41],The:[2,3,5,7,8,9,10,11,12,14,15,16,17,20,22,23,24,25,26,27,28,29,32,33,34,36,37,39,41,42,43,47,48,49,50,52,53,54,55,56,57],Their:[3,10,16],Then:[5,10,26,27,32,33,34,36,42,43,47,49,54,55,56],There:[9,10,16,22,23,25,29,36,42,48,49,50,51,52,54,57],These:[37,41,49,55],USE:54,USING:54,Use:[3,23,24,34,36,39,40,42,54],Used:[11,17],Useful:3,Using:[43,56],VPS:42,WITH:33,Will:20,With:[3,10,11,16,17,25,48,55],Yes:27,___fc_layer_0__:42,__init__:34,__list_to_map__:54,__main__:50,__meta__:54,__name__:50,__rnn_step__:32,_error:48,_link:[11,17],_proj:[10,16],_res2_1_branch1_bn:50,_source_language_embed:[32,47],_target_language_embed:[32,47],aaaaaaaaaaaaa:42,abc:[10,16],abl:[10,16,23,48,56],about:[5,10,11,16,17,25,27,36,38,39,42,46,55,56,57],abov:[3,5,10,16,23,25,27,36,42,43,48,50,52,55],abs:[11,17,48],absolut:[2,37],academ:53,acceler:41,accept:[3,5,20,23,24,52,55],acceptor:55,access:[2,10,11,17,23,32,57],accessmod:42,accident:53,accord:[2,3,9,10,16,32,33,37,38,39,41],accordingli:[5,34],accordingto:55,accrod:[11,17],accuraci:[9,34,52,53,56],achiev:[36,49],ack:39,acl:56,aclimdb:56,aclimdb_v1:20,across:[10,16],act:[10,11,16,17,25,32,52],act_typ:52,action:[42,53],activ:[0,4,5,10,11,16,17,21,25,26,34,39,52,56],activi:[11,17],actual:[3,10,16,25,27],adadelta:[12,52],adagrad:[12,52],adam:[12,23,52,56,57],adamax:[12,52],adamoptim:[47,52,56,57],adapt:[9,12,25,56,57],add:[3,10,11,16,17,20,25,26,33,34,36,41,52,54],add_input:34,add_test:34,add_to:[10,16],add_unittest_without_exec:34,addbia:34,added:[3,9,34],adding:50,addit:[10,11,16,17,27,52],address:[27,36,39],addrow:34,addtion:37,addto:10,addtolay:[10,16],adject:56,adjust:25,admin:53,adopt:55,advanc:[32,36,39],advantag:[27,56],adventur:53,adverb:56,adversari:24,advic:36,affect:[10,16],afi:3,aforement:37,after:[10,16,26,29,32,34,37,39,41,42,43,48,49,50,52,54,55,56,57],again:[23,36],against:42,age:54,agg_level:[10,16],aggreg:42,aggregatelevel:[10,16],aid:36,aim:[56,57],aircraft:57,airplan:49,aistat:[10,16],alex:[10,16,56],alexnet_pass1:41,alexnet_pass2:41,algorithm:[10,12,16,25,32,47,49,56,57],alia:[6,7,13,14,15],align:[10,11,16,17,20,57],all:[0,3,7,9,10,12,15,16,22,23,25,27,32,33,34,36,37,38,39,41,42,43,47,48,50,52,53,54,55,56,57],alloc:[7,15,34,41],allow:[23,27,33,34,36,39,42,52],allow_only_one_model_on_one_gpu:[38,39,41],almost:[11,17,25,37,47],along:56,alreadi:[27,36,37,39,42,43,56],alreali:[38,57],also:[2,3,9,10,11,16,17,23,24,26,27,32,34,36,37,43,48,49,50,52,55,56],although:25,alwai:[5,10,11,16,17,24,25,39,42,57],amaz:49,amazon:[42,43,52,56],amazonaw:42,amazonec2fullaccess:42,amazonelasticfilesystemfullaccess:42,amazonroute53domainsfullaccess:42,amazonroute53fullaccess:42,amazons3fullaccess:42,amazonvpcfullaccess:42,ambigu:[24,55],amd64:42,amend:33,american:49,among:[42,56],amount:[36,56],analysi:[25,36,51,55],analyz:[52,56],andd:42,ani:[2,3,10,11,16,17,20,23,24,32,33,36,42,52,54,57],anim:53,annot:55,annual:55,anoth:[3,10,16,23,27,39,42,55,56],ans:42,answer:[25,42,55],anyth:[20,24,33,42,55],api:[16,20,23,26,34,36,42,46,48,52,54,56],apiserv:42,apivers:[42,43],apo:57,appar:57,appear:55,append:[3,24,32,34,37,54],appleclang:26,appleyard:36,appli:[0,10,11,16,17,32,34,49,52],applic:[27,36,42,43,56],appreci:[33,56],approach:[10,16],apt:[26,29,49],arbitrari:10,architectur:[47,55,56,57],architecur:56,arg:[3,8,9,10,11,12,16,17,20,25,27,38,48,49,50,52,54,55,56],arg_nam:[10,16],argu:55,argument:[3,5,8,10,16,20,32,34,39,40,47,48,49,50,54,55,56,57],argv:50,arn:42,around:[3,10,16,42],arrai:[5,10,16,20,22,24,25,50],art:[25,55],articl:[37,43],artifact:42,artifici:48,artist:53,arxiv:[10,11,16,17,48,56],aspect:56,assign:[10,39,42],associ:[55,56,57],assum:[10,16,32,41,47],assur:2,astyp:[24,48],async:[12,38],async_count:39,async_lagged_grad_discard_ratio:39,async_lagged_ratio_default:[38,39],async_lagged_ratio_min:[38,39],asynchron:39,atla:26,atlas_root:26,attenion:[11,17],attent:[10,11,17,57],attitud:56,attr:[7,11,15,16,17],attribut:[3,4,10,11,16,17,21,34,47,55],auc:[9,38],aucvalidationlay:39,authent:42,author:[42,50],authorized_kei:37,autmot:33,auto:[34,36,51,54],autom:[42,57],automak:26,automat:[10,16,23,26,27,32,34,37,38,39,42,54,55,57],automaticli:[10,16],automobil:49,avail:[26,42],availabel:26,averag:[9,10,12,16,19,39,50,52,54,55,56,57],average_test_period:[38,39,55],average_window:56,averagepool:[10,16],avg:[13,36,52],avgcost:[9,52,54,56,57],avgpool:[10,16,52],avoid:36,avx:[26,29],await:43,awar:[23,27,42],aws_account_id:42,awsaccountid:42,awskeymanagementservicepowerus:42,b2t:47,b363:43,b8561f5c79193550d64fa47418a9e67ebdd71546186e840f88de5026b8097465:43,ba5f:42,back:[3,27],background:30,backward:[10,11,14,16,17,32,34,39,41],backward_first:32,backwardactiv:34,bag:[52,56],baidu:[0,10,16,25,29,33,43,47],baik:47,balanc:[39,42,48],balasubramanyan:56,bank:55,bardward:[11,17],bare:43,barrier:39,barrierstatset:36,base:[6,12,16,17,19,20,23,25,29,32,33,34,36,37,39,42,47,48,52,54,56,57],baseactiv:[10,11],basematrix:34,basenam:9,basepool:13,basepoolingtyp:[10,11,16,17],baseregular:12,basestr:[7,8,9,10,11,15,16,17,19,54],bash:[27,42,43],bashrc:26,basic:[3,10,33,34,52,53,56],batch:[3,9,10,11,12,16,17,20,22,23,34,37,39,42,43,48,49,50,52,54,55,56,57],batch_0:50,batch_norm:[10,17],batch_norm_lay:11,batch_norm_typ:[10,16],batch_read:24,batch_siz:[3,12,20,22,25,37,47,48,49,52,54,56,57],batchsiz:[10,16,34],bcd:[10,16],beam:[10,32,39,55,57],beam_gen:[10,32],beam_search:32,beam_siz:[10,32,38,39,41],beamsiz:57,becaus:[5,10,16,23,24,32,33,34,41,42,49,52,55],becom:[33,36],been:[3,26,33,49,52,55,56,57],befor:[5,10,11,16,17,24,27,33,37,42,49,54,56,57],begin:[5,9,10,34],beginiter:[22,23],beginn:32,beginpass:[22,23],begintrain:23,behavior:36,being:[24,48],belong:[10,16,57],below:[3,10,16,24,32,34,36,37,42,48,49,52,54],benefit:[11,17],bengio:[10,16],bertolami:56,besid:[2,10,16,57],best:[8,10,16,26,27,39,52,54,56,57],best_model_path:55,besteffort:43,beta1:12,beta2:12,beta:50,better:[10,11,16,17,25,37,42,48,54],between:[10,12,16,25,33,42,48,52,53,56,57],bgr:50,bi_lstm:[11,17],bia:[10,11,12,16,17,32,34,50],bias:[10,16,34],bias_attr:[10,11,16,17,25,32],bias_param_attr:[11,17],biases_:34,biasparameter_:34,biassiz:34,bidi:43,bidirect:[11,17,32,55,57],bidirectional_lstm_net:56,big:36,biggest:56,bilinear:[10,16],bilinear_interpol:[10,16],bilinearfwdbwd:36,bin:[26,27,37,42,43,54],binari:[3,9,10,16,20,36,42,47,52,56],bird:49,bison:26,bit:52,bitext:57,bla:26,blank:[10,16,42],block:[10,16,25,34,36,39,50,56],block_expand:10,block_i:[10,16],block_x:[10,16],blog:56,bn_attr:17,bn_bias_attr:[11,17],bn_layer_attr:11,bn_param_attr:[11,17],bollen:56,bool:[3,7,9,10,11,12,15,16,17,19,20,34,39,41,52,54,56],boot:[10,32],boot_bia:10,boot_bias_active_typ:10,boot_lay:[10,32],boot_with_const_id:10,bootstrap:26,bos_id:[10,32],both:[0,7,10,11,14,15,16,17,23,27,32,34,36,42,48,50,52],bottleneck:[36,50],bottom:56,bow:[52,56],box:36,branch:[10,16,23,33],breadth:[39,57],brelu:6,brendan:56,brew:26,briefli:36,brows:27,browser:[27,42],bryan:56,bucket_nam:42,buf_siz:20,buffer:[3,20,24,39],buffered_read:24,bug:42,bui:56,build:[0,25,27,30,39,42,44,45,47,49,50,52,54,56,57],build_and_instal:27,built:[0,26,48,55],bunch:[36,52],bunk:56,button:[33,42],c99e:42,cach:[52,54,55],cache_pass_in_mem:[3,52,54,55],cachetyp:[3,52,54,55],calc_batch_s:[3,55],calcul:[3,9,10,11,12,16,17,32,34,36,39,41,48,54],call:[3,10,11,16,17,23,25,32,34,36,39,42,49,50,52,56,57],callabl:[3,10,20],callback:34,caller:42,caltech:49,can:[2,3,5,7,8,9,10,11,15,16,17,20,23,24,25,26,27,29,32,33,34,36,37,38,39,41,42,43,47,48,49,50,52,54,55,56,57],can_over_batch_s:[3,55],candid:[10,16],cannot:34,caoi:57,capabl:[26,56],capac:42,caption:[25,57],captur:[25,37],card:37,care:[11,17,24,38,39,53],carefulli:[37,39,50],cat:[27,49,50,56],categor:55,categori:[10,16,52,56],categoryfil:43,caution:[42,43],ccb2_pc30:57,cde:[10,16],ceil:[10,16],ceil_mod:[10,16],cell:[10,11,16,17,56],center:3,ceph:43,certain:[2,38,55],certif:[23,42],cfg:43,chain:[20,34],chanc:[23,34,52],chang:[10,24,25,27,32,33,34,36,39,42,52,56],channel:[10,16,36,37,50],channl:[37,50],char_bas:54,charact:[52,54],character:25,characterist:[41,49],check:[3,20,25,26,27,33,39,41,42,53],check_align:20,check_eq:34,check_fail_continu:3,check_l:34,check_sparse_distribution_batch:[38,39],check_sparse_distribution_in_pserv:[38,39],check_sparse_distribution_ratio:[38,39],check_sparse_distribution_unbalance_degre:[38,39],checkgrad:39,checkgrad_ep:39,checkout:33,children:53,chines:51,chmod:[26,42],choic:[27,53],choos:[39,52,54],chosen:[2,53,57],chunk:[9,48,55],chunk_schem:9,chunktyp:9,cifar:[48,49],cifar_vgg_model:49,claim:42,claimnam:42,clang:[26,33],class1:56,class2:56,class_dim:56,classfic:[50,56],classfiic:49,classic:[10,16,25],classif:[3,5,10,16,41,50,51,52,56,57],classifc:56,classifi:[9,48,49,50,52,56],classification_cost:[49,52],classification_error_evalu:[48,52,56,57],classification_threshold:9,claster:42,clean:[5,54],cleric:53,cli:42,click:[33,36,42],client:33,clip:[7,12,15,39,52,56],clock:[10,16],clone:[26,27],close:[3,24],closer:25,cls:52,cludform:42,cluster:[23,38,39,43,52,57],cluster_train:37,cm469:42,cmake3:26,cmake:[26,34,36],cmakelist:34,cmd:43,cna:[10,16],cname:42,cnn:[43,50,52],code:[0,3,5,16,20,23,24,25,26,27,28,32,34,35,36,37,42,43,48,52,53],coeff:[10,16],coeffici:[10,16],collect:[10,16,22,25,53],collectbia:34,colleg:53,color:[49,50],column:[9,10,16,24,34,47,57],colunm:57,com:[10,11,16,17,20,26,27,29,33,42,43,50],combin:[10,11,16,17,20,48,54,56],come:56,comedi:53,comma:[39,47],command:[2,5,25,26,27,29,33,34,35,36,37,42,43,44,45,47,48,49,50,54,55,56],commandlin:[36,56],commenc:52,comment:[11,17,20,33,52,56],commnun:37,common:[32,34,38],common_util:[37,54],commonli:[32,36,41],commun:[0,34,37,42],compani:56,compar:[34,48,52],compat:3,compet:56,competit:48,compil:[26,33,34],complet:[0,5,10,11,16,17,20,22,34,42,43,52],complex:[2,3,11,17,24,32,36,52],complic:[10,16],compon:34,compos:[20,23,48,55],composenotalign:20,comput:[10,11,16,17,23,25,26,27,32,34,36,41,42,52,54,55,56],computation:32,conat:16,conat_lay:10,concat:[10,57],concat_lay:32,concaten:[11,17],concept:[3,23,32],concern:23,concurrentremoteparameterupdat:39,condit:[10,16,32,37,43,57],conduct:36,conf:[5,10,16,37,47,48,50,57],conf_paddle_gradient_num:42,conf_paddle_n:42,conf_paddle_port:42,conf_paddle_ports_num:42,conf_paddle_ports_num_spars:42,confid:56,config:[3,7,10,11,15,16,17,25,34,37,38,39,42,43,47,48,49,50,52,56,57],config_:39,config_arg:[38,39,41,50,52,55,56],config_bas:[16,17,22],config_fil:55,config_gener:[37,54],config_lay:34,config_pars:[5,34],configur:[1,2,3,5,8,10,16,25,27,31,33,34,36,39,47,49,50,56,57],conflict:33,confront:57,congest:39,conll05st:55,conll:55,connect:[2,11,17,25,27,34,42,43,48,49,50,52,54,56],connectionist:[10,16,56],connor:56,consequ:[10,11,16,17],consid:[9,10,12,16,26,36,41,49],consider:[3,11,17],consist:[10,16,24,27,49,50,52,55,57],consol:[36,42],constant:34,construct:[3,5,23,32,54],construct_featur:54,constructor:34,consum:56,contain:[3,8,9,10,11,16,17,19,20,23,28,29,32,33,37,42,49,50,52,53,56,57],containerport:42,contemporan:56,content:[43,55,56],context:[10,11,16,17,32,47,52,54,55,56,57],context_attr:[11,17],context_len:[10,11,16,17,52,54],context_proj_layer_nam:11,context_proj_nam:17,context_proj_param_attr:[11,17],context_project:[11,17,54],context_start:[10,11,16,17,52],contibut:33,contin:42,continu:[3,29,39],contrast:[10,16,57],contribut:[0,28,35,56],contributor:0,control:[7,15,39,42,43,57],conv:[11,17],conv_act:[11,17],conv_attr:17,conv_batchnorm_drop_r:[11,17],conv_bias_attr:[11,17],conv_filter_s:[11,17],conv_layer_attr:11,conv_num_filt:[11,17],conv_op:[10,16],conv_pad:[11,17],conv_param_attr:[11,17],conv_shift:10,conv_strid:[11,17],conv_with_batchnorm:[11,17],conveni:[23,37],converg:[37,48,56],convert:[3,5,20,24,32,47,49,50,52,54],convlay:[10,16],convolut:[10,11,16,17,48,50,54],convoper:[10,16],convtranslay:[10,16],cool:[3,33],copi:[23,42,48,54],copy_shared_paramet:48,copytonumpymat:48,core:[3,7,15,39,57],coreo:42,corespond:55,corpora:57,corpu:55,correct:[3,9,10,16,34,42],correctli:[9,20,34,48],correl:[25,49,56],correspoind:23,correspond:[3,5,23,25,32,34,49,53,55,56,57],corss_entropi:23,cos:[10,16],cos_sim:54,cosin:[10,16,54],cost:[5,12,23,25,39,48,52,54,56,57],cost_id:10,could:[3,5,9,10,16,20,22,23,24,36,37,42,52,54],count:[24,36,39,41,43,47,54,55,56,57],coupl:25,coverag:26,coveral:26,coveralls_uploadpackag:26,cpickl:[50,54],cpp:[33,34,36,52,54,57],cpu:[2,3,7,10,15,16,26,29,36,39,43,48,55,56,57],cpuinfo:27,craftsman:53,crash:[36,37,39],crazi:37,creat:[5,7,10,15,16,20,23,25,26,27,34,37,39,47,48,49,57],create_bias_paramet:34,create_input_paramet:34,createargu:48,createfromconfigproto:[5,48],createstack:42,creation:42,creationd:42,creator:20,credit:48,cretor:20,crf:[10,55],crf_decod:10,crime:53,critic:56,crop:50,crop_siz:50,cross:[10,16,52,55],cross_entropi:[16,23,48],cross_entropy_with_selfnorm:16,csc:34,cslm:57,csr:34,csv:53,ctc:10,ctc_layer:9,ctest:27,ctrl:[37,54],ctx:55,ctx_0:55,ctx_0_slot:55,ctx_n1:55,ctx_n1_slot:55,ctx_n2:55,ctx_n2_slot:55,ctx_p1:55,ctx_p1_slot:55,ctx_p2:55,ctx_p2_slot:55,cub:49,cuda:[26,27,29,36,37,39],cuda_dir:[38,39],cuda_so:27,cudaconfigurecal:36,cudadevicegetattribut:36,cudaeventcr:36,cudaeventcreatewithflag:36,cudafre:36,cudagetdevic:36,cudagetdevicecount:36,cudagetdeviceproperti:36,cudagetlasterror:36,cudahostalloc:36,cudalaunch:36,cudamalloc:36,cudamemcpi:36,cudaprofilerstart:36,cudaprofilerstop:36,cudaruntimegetvers:36,cudasetdevic:36,cudasetupargu:36,cudastreamcr:36,cudastreamcreatewithflag:36,cudastreamsynchron:36,cudeviceget:36,cudevicegetattribut:36,cudevicegetcount:36,cudevicegetnam:36,cudevicetotalmem:36,cudnn:[10,16,19,26,29,39],cudnn_batch_norm:[10,16],cudnn_conv:[10,16],cudnn_conv_workspace_limit_in_mb:[38,39],cudnn_dir:[38,39],cudrivergetvers:36,cuinit:36,cumul:[10,16],curl:[26,42],current:[3,10,12,16,25,27,32,33,34,37,39,42,52,56,57],current_word:32,currentcost:[9,52,54,56,57],currentev:[9,52,54,56,57],curv:[23,49,55],custom:[2,3,23,34,42,53,56],custom_batch_read:24,cyclic:[10,16],d3e0:42,daemon:27,dai:57,daili:56,dalla:3,dan:55,danger:3,darwin:42,dat:[20,37,54],data:[2,3,5,8,11,12,17,22,23,26,30,34,36,37,38,39,41,44,50,53],data_batch_gen:48,data_dir:[47,49,56,57],data_feed:20,data_fil:25,data_initialz:52,data_lay:[3,9,25,32,48,49,52,54,55],data_nam:20,data_provid:8,data_read:[20,24],data_reader_creator_random_imag:24,data_sourc:[8,48],data_typ:[16,20],databas:56,datadim:[10,16],datalay:[10,16],dataprovid:[2,8,25,32,37,54,55],dataprovider_bow:52,dataprovider_emb:52,dataproviderconvert:5,datasci:[10,16],dataset:[1,3,24,25,39,47,49,50,52,55,56],datasourc:[4,54],date:55,db_lstm:55,dcgan:48,dcmake_install_prefix:26,deal:[33,48],deb:[28,29],debian:28,debug:3,decai:[12,49],decid:[23,24],declar:[10,11,16,54],decod:[10,11,16,17,32,55,57],decoder_boot:32,decoder_group_nam:32,decoder_input:32,decoder_mem:32,decoder_prev:[11,17],decoder_s:32,decoder_st:[11,17,32],deconv:[10,16],deconvolut:[10,16],decor:[3,20,34],decreas:25,decrypt:42,deep:[0,10,16,25,27,36,48,49,50,52,55],deeper:[25,27,50],deer:49,def:[3,10,16,20,23,24,25,32,34,48,50,52,54,55],defalut:[10,16,39,41],default_devic:41,default_valu:41,defferenct:3,defin:[2,3,8,9,10,11,16,17,20,23,24,25,32,34,37,39,47,48,49,54,55],define_py_data_sources2:[3,8,25,49,50,52,54],defini:57,definit:[3,20,25,27,47,52,56],degre:[10,16],del:54,delai:39,delar:52,deletestack:42,delimit:[9,53,54],demo:[10,32,37,43,44,47,48,49,50,51,52,53,54,55,56,57],demograph:53,demolish:43,demonstr:[25,32,48,54],denot:[41,52,53,55],dens:[3,10,16,20,34,42,52,54],dense_vector:[3,5,16,20,25,54],dense_vector_sequ:20,depend:[25,29,37,41,49,53],deploi:[37,41],deploy:[37,42],deriv:[14,23],descent:[10,12,16],describ:[23,25,34,42,43,48,52,55],describestack:42,describestackev:42,describestackresourc:42,descript:[5,26,32,40,42,49,54],design:[3,10,16,20,56],desir:[42,43,47],destructor:34,detail:[3,5,7,10,11,12,15,16,17,32,33,34,36,37,40,41,42,43,47,48,50,52,54,56,57],detect:9,determin:[3,10,16,20,34,48],dev:[26,27,49,54,57],devel:26,develop:[0,26,33,38,39,57],deverlop:39,deviat:[7,15],devic:[7,15,27,39,57],deviceid:41,devid:[10,16,39],dez:56,dfs:11,diagnos:37,diagram:50,dict:[3,8,52,54,56,57],dict_dim:56,dict_fil:[9,32,52,55],dict_nam:8,dictionai:52,dictionari:[3,8,9,10,20,22,23,32,41,50,52,54,55,56,57],dictsiz:57,did:3,differ:[3,8,9,10,16,25,27,32,33,34,37,39,42,43,47,49,50,52,56,57],difficult:25,dig:[27,36,42],digit:[3,10,16],dim:[20,34,47,50,52,56],dimens:[10,14,16,19,20,34,41,47,52,54,56],dimension:[3,25,32,34,48,52],dimenst:47,dimes:[10,16],din:54,dir:[37,50,52,54,55,56,57],direct:[10,11,16,17,27,50,55],directli:[2,3,11,17,25,37,43,56],directori:[2,26,33,36,37,39,43,49,50,52,54,55,56,57],diretcoti:50,dis_conf:48,dis_train:48,dis_training_machin:48,disabl:3,discard:[20,39],discount:[10,16],discov:55,discoveri:42,discrep:36,discrimin:48,discriminator_train:48,discuss:23,disk:43,dispatch:[37,39],disput:57,dist_train:23,distanc:9,distibut:47,distinguish:[37,48,57],distribut:[10,16,26,35,43,44,45,48,52,55],distribute_test:[38,39],distributedli:34,disucss:23,divid:[12,38,49,57],diy_beam_search_prob_so:[38,39],dmkl_root:26,dns:42,do_forward_backward:24,doc:[5,11,17,20,26,27,37],docker:[28,42,44,45],docker_build:23,docker_push:23,dockerfil:27,dockerhub:27,doctor:53,document:[3,5,11,17,26,33,41,49,52,54,55,56],documentari:[3,53],doe:[3,5,11,17,24,25,29,32,34,36,52,54,55],doesn:[7,10,15,20,23,24,27,33,36,43,57],dog:[49,50],doing:36,domain:42,don:[11,17,23,24,25,27,42,56],done:[10,11,16,17,32,36,42,48,56],dopenblas_root:26,dot:[39,50,57],dot_period:[39,41,48,49,54,56,57],dotmuloper:[10,16],dotmulproject:[10,16],doubl:[3,26,39],down:[36,52],download:[20,29,48,49,52,55,56],download_cifar:49,downsampl:49,doxygen:[26,33],dpkg:29,drama:53,driver:27,drop:3,drop_rat:[7,15],dropout:[7,10,15,16,34,52],dropout_lay:10,dropout_r:[11,17],drwxr:43,dtoh:36,dtype:[5,25,50],dubai:57,due:[53,54],duplic:53,durat:36,dure:[2,3,10,16,25,33,34,38,39,42,52,54,55,57],durn:3,dwith_doc:26,dwith_profil:36,dwith_tim:36,dynam:[2,3,24,26,36,39],dynamic_cast:34,each:[2,3,5,9,10,16,19,20,22,24,25,27,32,33,34,37,39,41,42,47,49,50,52,53,54,55,56,57],each_feature_vector:14,each_meta:54,each_pixel_str:3,each_sequ:[10,16],each_time_step_output:14,each_timestep:[10,16],each_word:3,eaqual:[10,16],eas:[20,24,50],easi:[0,24,27,34,37,52],easier:[23,24,34],easili:[23,24,25],echo:[27,54,56],edit:[9,42],editor:33,edu:[20,42,43,49],educ:53,eeoi3ezpr86c:42,effect:[3,39,42],effici:[0,2,3,32,34],efg:[10,16],efs:42,efs_dns_nam:42,efsvol:42,eight:55,either:[10,16,20,22,23,36,52,54],elb:42,elbapis:42,elec:52,electron:[43,52],elem_dim:[10,16],element:[3,5,9,10,11,16,17,20,22,24,52,56,57],elif:[23,54],elimin:55,els:[10,23,27,34,50,52,54],emac:33,emb:[43,52],embed:[10,23,32,51,54,56],embedd:55,embedding_lay:[32,52,54],embedding_nam:32,embedding_s:32,emphas:36,empir:[10,16],emplace_back:34,emploi:[32,53],empti:[9,20,25],emul:57,enabl:[3,7,15,36,37,39,42],enable_grad_shar:[38,39],enable_parallel_vector:39,enc_proj:[11,17,32],enc_seq:[11,17],enc_vec:32,encod:[11,17,32,57],encoded_proj:[11,17,32],encoded_sequ:[11,17,32],encoded_vector:32,encoder_last:10,encoder_proj:32,encoder_s:32,encrypt:42,encrypt_decrypt:42,end:[3,9,10,16,24,25,32,39,47,55,56,57],end_pass:23,enditer:[22,23],endpass:[22,23],endpoint:42,endtrain:23,engin:[0,36,53],english:[3,10,16,57],enjoi:27,enough:25,ensembl:[11,17],ensur:[3,34],enter:53,entir:[10,11,16,17,56],entri:[20,27,34,42,53],entropi:[10,16,52,55],enumer:[10,14,52,54],env:[33,42],environ:[23,26,27,29,36,37,38,39,42,43,48,49,54],eol:33,eos:10,eos_id:[10,16,32],epel:26,epoch:53,epsilon:12,equal:[10,11,12,16,17,39],equat:[10,11,12,16,17,27],equilibrium:48,equip:[26,32],equival:[10,16,23],error:[7,9,10,12,15,16,23,25,29,34,37,39,42,49,50,52,53,54,56,57],error_clipping_threshold:[7,15],errorr:9,especi:[3,11,17,55],essenc:23,essenti:[10,23,26,55,57],estat:25,estim:[10,16,23],eta:43,etc:[12,20,24,37,38,41,42,56,57],eth0:[37,42],ethternet:37,eval:[9,52,54,56,57],eval_bleu:57,evalu:[2,4,10,16,30,36,37,52,56,57],evaluate_pass:56,evaluator_bas:9,evalut:[25,57],even:[23,24,36,39,56],evenli:42,event:43,event_handl:23,everi:[2,3,9,10,11,17,20,23,32,33,34,39,52,55,56,57],everyth:[25,27,33],exactli:[3,9,10,11,16,17,42,55],exampl:[2,3,8,9,10,11,12,16,17,20,22,24,25,26,27,32,34,36,37,38,39,41,42,43,49,50,51,52,56,57],exceed:10,except:[3,41,47,54,56],excluded_chunk_typ:9,exconv:[10,16],exconvt:[10,16],exdb:20,exec:39,execut:[34,36,42,53,55,56],exist:[23,24,34,39,42,53,56],exit:[39,43],exp:6,expand:[10,34,55,56,57],expand_a:[10,16],expand_level:[10,16],expandconvlay:[10,16],expandlevel:[10,16],expect:[10,16,36,56],expens:57,experi:41,explain:[3,9,37,48,56],explan:[10,16,52,57],explanatori:[25,27],explicit:34,explicitli:[3,23],exploit:49,explor:10,exponenti:14,expos:[27,42],express:[23,42,56],extend:[0,54],extens:[12,53,54,57],extern:3,extra:[10,11,15,16,17,25],extraattr:[7,15,41],extraattribut:[16,17],extraattributenon:16,extract:[10,16,42,49,55,56],extract_fea_c:50,extract_fea_pi:50,extract_para:47,extralayerattribut:[7,10,11,15],extralayeroutput:11,extrapaddl:17,extrem:[10,36],extremli:2,f120da72:43,f7e3:42,fa0wx:43,fabric:37,facotr:[10,16],fact:50,factor:[7,10,12,15,16],fail:[3,39,41,43,49],fake:48,fake_imag:24,fals:[3,7,9,10,11,12,15,16,17,20,24,25,32,34,39,41,43,47,52,54,55,56,57],false_label:24,false_read:24,famili:57,familiar:[3,25],fanscin:3,fantasi:53,fantast:52,far:0,farmer:53,fascinatingli:2,fast:[10,16,33,36],faster:[10,11,16,17,32,36,56],favorit:33,fbd1f2bb71f4:43,fc1:[34,41],fc2:41,fc3:41,fc4:41,fc8a365:42,fc8a:42,fc_act:[11,17],fc_attr:[11,17],fc_bias_attr:[11,17],fc_layer:[25,34,41,52,54],fc_layer_nam:11,fc_name:17,fc_param_attr:[11,17],fclayer:34,fdata:55,fea:50,fea_output:50,feat:56,featur:[3,10,14,16,20,33,39,49,52,56,57],feature_map:54,feed:[11,17,20,22,23,25,56],feedback:0,feeder:20,feedforward:49,femal:53,fernan:56,festiv:3,fetch:[20,32,34],few:[3,24],fewer:10,fg0:[10,16],field:[10,16,22,36,42],figur:[23,32,34,36,47,48,49,50,55,56,57],file1:57,file2:57,file:[2,3,5,9,10,16,20,23,24,25,26,32,33,34,37,39,47,49,50,55,56,57],file_list:3,file_nam:[3,25,50,52,55],filenam:[3,54],filer:[10,16],filesystem:42,fill:[10,16,42,52],film:53,filter:[10,16,50],filter_s:[10,11,16,17],filter_size_i:[10,16],finali:37,find:[10,12,36,49,56,57],fine:[7,15,54],fingerprint:42,finish:[3,37,42,43,49],finit:34,first:[3,10,16,20,23,25,29,32,33,34,36,39,41,42,47,48,49,50,52,54,55,56,57],first_seq:32,firstn:20,firstseen:43,fit:[2,20,33],five:[36,52],fix:[3,7,15,57],flag:[39,48,49,55],flexiabl:24,flexibl:[0,2,10,11,17,23,32],flight:57,float32:[5,20,24,25,48,50],floor:[10,16],flow:33,fly:[25,52],fnt03:42,focu:[3,36],folder:[26,42,49,56,57],follow:[2,3,9,10,11,12,16,17,20,23,24,26,27,29,32,33,34,36,37,41,42,43,44,45,47,48,49,50,52,53,54,55,56,57],fool:48,forbid:23,forecast:56,forget:[12,23,27,56],form:[2,3,11,12,17,36,55],format:[2,3,9,25,33,34,39,42,47,49,53,54,56],former:[23,57],formula:[10,11,16,17],formular:[10,16],forward:[11,14,17,32,33,34,41,48,55,56],forwardactiv:34,forwardtest:5,found:[3,5,10,16,26,32,48,49,52,56],four:[3,29,47,50,52,54,55,56],frame:9,framework:[23,34,50,52,56],free:57,french:57,frequenc:[20,36,47,52,56],frequent:[24,37,57],frog:49,from:[0,3,5,10,11,16,17,20,22,24,25,27,30,32,33,34,36,37,39,41,42,43,47,48,49,50,52,53,54,55,56,57],from_timestep:[10,16],fromfil:[24,25,50],fulfil:36,full:[10,16,27,32,34],full_matrix_project:[11,17,32],fulli:[25,33,34,36,48,49,50,52,54,56],fullmatrixproject:[10,16],fully_matrix_project:[11,17],fullyconnect:47,fullyconnectedlay:34,func:20,fundament:25,further:10,fusion:54,gain:[10,16],game:48,gamma:50,gan:23,gan_train:48,gap:39,gate:[10,11,16,17,56],gate_act:[10,11,16,17],gate_recurr:[10,16],gather:[10,34,54],gauss:[7,15],gaussian:48,gcc:26,gdebi:29,gen:[10,57],gen_conf:[48,57],gen_data:57,gen_result:57,gen_train:48,gen_training_machin:48,gen_trans_fil:32,gender:[53,54],gener:[2,3,5,9,10,11,16,17,20,22,23,24,25,26,27,36,37,39,41,42,47,50,51,52,54,56],generatedinput:32,generator_conf:48,generator_machin:48,generator_train:48,genert:3,genr:[53,54],gereat:9,get:[3,10,11,16,17,25,26,29,32,34,36,37,42,46,49,50,52,54,55,56],get_batch_s:55,get_best_pass:56,get_config_arg:[41,52,54,56],get_data:[43,52,55],get_imdb:56,get_input_lay:34,get_mnist_data:48,get_model:50,get_nois:48,get_output_attr:17,get_output_layer_attr:11,get_training_loss:48,get_word_dict:20,getbatchs:34,getenv:23,getinput:34,getinputgrad:34,getinputvalu:34,getoutputgrad:34,getoutputvalu:34,getparameterptr:34,getsiz:34,getslotvalu:48,gettempl:42,gettranspos:34,getw:34,getweight:34,getwgrad:34,gfortran:26,gildea:55,gist:[11,17],git:[26,27,33],github:[10,11,16,17,26,27,29,50],give:[3,25,27,34,36,42,52],given:[3,20,22,24,34,39,48,52,55,56,57],global:[3,7,12,15,23,36,39,42,54,56],global_learning_r:[7,15],globalstat:36,globalstatinfo:36,globe:3,goal:[36,55],goe:[10,11,16,17,25],going:[52,56],good:[10,16,24,36,56,57],goodfellow13:[10,16],googl:23,googleapi:42,got:27,gpg2:42,gpg:42,gpu:[2,3,7,10,12,15,16,19,26,29,35,37,48,49,50,54,55,56,57],gpu_id:[39,41,48],gpugpu_id:38,grab:56,grad:[39,53],grad_share_block_num:[38,39],gradient:[7,9,10,12,15,16,39,52,56],gradient_clipping_threshold:[7,12,15,52,56],gradientmachin:[5,48,54,57],gradual:[25,36],grai:49,gram:[47,56],grant:42,graph:[10,47],graphviz:50,grave:56,grayscal:3,greater:[10,16],grep:[27,56],groudtruth:32,ground:[9,10,16,52,57],group:[11,17,56],group_id:54,group_input:32,grouplen:53,gru:[10,16,32,52,57],gru_attr:17,gru_bias_attr:[11,17],gru_decod:32,gru_decoder_with_attent:32,gru_encoder_decod:[47,57],gru_layer_attr:11,gru_memori:[11,17],gru_siz:52,gru_step:[17,32],gru_step_lay:[11,32],grumemori:[11,17,32],gserver:[10,34],gsizex:36,guarante:34,guess:[25,56],gui:36,guid:[28,32,33,34,36,42,43,47,49,56,57],guidenc:25,gur_group:[11,17],gzip:43,hack:[28,37],hadoop:23,half:42,hand:[53,54,56],handl:[23,24,37,54,56],handwrit:[3,56],hard:[42,52],hardwar:[27,36],has:[3,5,10,11,12,16,17,23,32,34,36,42,43,47,49,52,53,54,55,56,57],have:[2,3,5,9,10,11,16,17,20,23,24,25,26,32,33,34,36,37,39,41,42,47,49,52,53,54,56,57],hdf:2,head:[33,47,56],header:[25,34,47,50,54],health:53,heavi:37,height:[10,16,20,24,34,49],hello:23,help:[3,5,33,37],helper:[8,10,11,16,17,34],here:[3,5,7,10,11,15,16,17,20,23,24,25,26,32,37,38,41,42,43,47,49,50,51,52,53,54,55,56,57],heurist:[10,39,57],hidden:[10,11,16,17,32,42,52,54,56],hidden_s:[11,17,54],hierarch:[10,16,32],high:[7,15,34,48],higher:2,highest:[20,57],highli:[2,3,32,41,54,56],him:23,hint:25,histor:56,hl_get_sync_flag:34,hold:[23,42],home:[37,42,43],homemak:53,hook:[3,54,55],hope:0,horizont:[10,16,50],horror:53,hors:49,horst:56,host:[26,37,42,43],hostnam:[37,42],hostpath:43,hostport:42,hot:54,hour:57,hous:[3,20,25,47],how:[2,3,7,10,15,16,23,25,32,37,39,42,43,46,49,50,52,54],howev:[3,11,17,24,25,32,33,38,39,42,56,57],html:[20,27,49],htod:36,http:[10,11,16,17,20,26,27,29,33,42,43,48,49,50,57],huber:[10,16],huge:[10,16,33],huina:56,human:57,hyper:[10,16,34],hyperplan:20,i0601:54,i0706:57,i0719:57,i1117:36,iamfullaccess:42,iamusersshkei:42,ib0:37,icwsm:56,id_input:[9,32],idea:[10,16,24],ident:[25,42,53],identifi:[32,34],identityoffsetproject:[10,16],identityproject:[10,16],ids:[9,10,16,22,34,52,54],idx:34,ieee:56,ignor:[3,9,39],ijcnlp:56,illustr:[3,32,34,36,52],ilsvrc:50,imag:[3,19,20,23,24,25,28,41,42,44,45,48,50,51,57],image_a:24,image_b:24,image_classif:49,image_fil:24,image_lay:24,image_list_provid:50,image_nam:23,image_path:24,image_provid:49,image_reader_cr:24,image_s:50,imagenet:51,imagepullpolici:42,imageri:[10,16],images_reader_cr:24,imdb:53,imdber:56,img:[3,10,16,49],img_conv:17,img_conv_lay:11,img_featur:3,img_norm_typ:10,img_pool:17,img_pool_lay:11,img_siz:49,imgsiz:36,imgsizei:36,imgsizex:36,immedi:42,immutable_paramet:23,implement:[3,10,11,12,16,17,20,32,52,55],importerror:54,improv:[0,36,42,56,57],inbound:42,includ:[2,3,10,11,16,17,23,26,27,32,34,36,39,42,43,47,52,53,55,57],inconsist:53,incorrect:[10,16],increas:[39,57],increment:39,incupd:34,inde:[20,24],independ:[10,16,52],index:[3,9,10,16,19,20,32,37,42,54],indexslot:[10,55],indic:[3,9,10,16,25,37,42,55],individu:[25,42],infer:[1,23,26],infiniband:37,info:[9,10,16,34,37],infom:33,inform:[5,9,34,36,39,42,53,54,55,56,57],infrastructur:[42,48],ingor:39,ininst:23,init:[7,15,34,41,42,48,52,54,55],init_hook:[52,54,55],init_hook_wrapp:8,init_model_path:[38,39,41,47,52,55],initi:[3,5,7,10,15,16,32,34,39,47,48,52,55],initial_max:[7,15],initial_mean:[7,10,15,16],initial_min:[7,15],initial_std:[7,10,15,16],initpaddl:[5,48],inlcud:[11,17],inlin:42,inner:34,inner_param_attr:[11,17],input1:[10,11,16,17],input2:[10,16],input:[3,5,9,10,11,14,16,17,19,20,22,24,25,32,34,41,47,48,49,50,52,54,55,56,57],input_data:34,input_data_target:34,input_featur:14,input_fil:[25,55],input_hassub_sequence_data:34,input_id:[10,16],input_imag:[11,17,49],input_index:34,input_label:34,input_lay:[10,34],input_nam:23,input_sequence_data:34,input_sequence_label:34,input_sparse_float_value_data:34,input_sparse_non_value_data:34,input_t:34,input_typ:[25,32,52,54],inputdef:34,inputlayers_:34,inputtyp:[3,20],insid:[9,10,16,24,27,42],inspir:47,instal:[27,30,33,37,43,49,50,54,55,56],instanc:[10,12,16,32,34,36,39,55],instance_ip:42,instead:[10,16,19,24,33,37,52,57],instruct:[27,29,36,52],int32:39,integ:[3,9,10,16,20,32,34,52,56],integer_valu:[3,20,52],integer_value_sequ:[3,20,32,52,55],integr:[26,55],intend:0,inter:[10,16,37],interact:[27,42],intercept:[10,16],interest:[36,56],interfac:[5,7,10,11,15,16,17,37,42,49,54,56],interg:52,intergr:[10,16],intermedi:55,intern:[10,11,17,20,42],internet:56,interpol:10,interpret:[3,9,26,27,36],interv:56,intrins:26,introduc:[3,43,54,56],introduct:[4,48],invalid:24,invari:49,invok:[3,10,36,42,54],involv:48,iob:9,ioe:9,ips:42,ipt:[10,16,32],ipython:23,is_async:12,is_discriminator_train:48,is_gener:[10,47,48,57],is_generator_train:48,is_kei:54,is_layer_typ:10,is_predict:[52,54,56],is_seq:[10,32,54],is_sequ:54,is_stat:[7,15],is_test:[50,55,56],is_train:3,isn:36,isspars:34,issu:[26,27,36],item:[10,16,20,24],iter:[10,11,12,17,20,22,23,24,49,55,56],its:[3,9,10,11,16,17,23,34,36,39,42,47,48,49,52,56,57],itself:[11,17],jeremi:36,jie:[55,56],jmlr:[10,16],job:[5,9,38,39,41,50,52,54,55,56,57],job_dispatch_packag:37,job_mod:47,job_nam:42,job_namespac:42,job_path:42,job_workspac:37,jobpath:42,jobport0:42,jobport1:42,jobport2:42,jobport3:42,johan:56,joint:[47,57],jointli:[11,17,57],journal:[55,56],journei:27,jpeg:49,jpg:50,json:[37,42,43,54],jth:[11,17],judg:57,jupyt:27,just:[3,9,10,11,14,16,17,25,27,33,37,41,42,49,54,55,56],jx4xr:42,jypyt:23,k8s_data:42,k8s_job:23,k8s_token:23,k8s_train:42,k8s_user:23,kaim:[10,16],kaimingh:50,kebilinearinterpbw:36,kebilinearinterpfw:36,keep:[3,10,16],kei:[3,36,37,54,56],kernel:[10,16,36,52],key1:39,key2:39,key_pair_nam:42,keyid:42,keymetadata:42,keypair:42,keyserv:42,keystat:42,keyusag:42,keyword:3,kill:42,kind:[2,3,23,25,42,43,48,52,54],kingsburi:55,kms:42,know:[3,11,17,23,25,27,34,36,42,54],knowledg:56,known:[48,56,57],kriz:[20,49],ksimonyan:[11,17],kube_cluster_tl:23,kube_ctrl_start_job:23,kube_list_containers_in_job_and_return_current_containers_rank:23,kubeconfig:42,kubectl:43,kuberent:42,kubernet:[23,35,37,44,45],kubernetes_service_host:23,kwarg:[3,9,10,11,12,16,17,20,52,54,55],l1_rate:[7,15],l2_rate:[7,15],l2regular:[49,52,56],label:[3,5,9,10,12,16,20,22,24,25,32,43,48,49,50,51,52,54,56],label_dict:55,label_dim:[10,16,52],label_fil:[24,55],label_lay:[10,24],label_list:55,label_path:24,label_slot:55,labeledbow:56,labl:56,lag:39,lake:3,lambdacost:[10,16],lambdarank:[10,16],languag:[10,16,41,47,55,56,57],laptop:27,larg:[19,55,56,57],larger:[3,7,9,10,12,15,16,37],last:[9,10,11,16,17,25,32,37,39,52,56,57],last_time_step_output:10,lastseen:43,late:56,latenc:[37,42],later:[26,33,42,52],latest:[10,16,27,33,43,56],latter:57,launch:[39,42,56],launcher:23,lawyer:53,layer1:[10,11,16,17],layer2:[10,16],layer3:[10,16],layer:[4,5,7,9,11,15,17,19,20,21,22,24,25,32,35,38,39,47,48,49,50,52,54,55,56],layer_0:34,layer_attr:[10,16,32,41],layer_num:[41,50],layer_s:[10,16],layer_typ:[10,16],layerbas:34,layerconfig:34,layergradutil:34,layermap:34,layeroutput:[9,11,54],lbl:[9,49],ld_library_path:[26,29,37],lead:36,learn:[0,7,9,10,11,12,15,16,17,23,24,25,27,32,34,36,49,50,52,55,56,57],learnabl:[10,16],learning_method:[12,25,47,49,52,54,56,57],learning_r:[7,12,15,25,47,49,52,54,56,57],least:[9,10,16,26,53],leav:[3,42],lecun:20,left:[10,16,25,50],leman:57,len:[3,10,16,32,34,52,54,55],length:[10,11,16,17,20,32,39,43,56,57],less:[10,16,23,37,57],less_than:23,let02:43,let:[5,10,16,23,25,27,42,54],level:[7,10,15,16,37,39,48,54,56,57],lib64:[26,27,37,39],libcuda:27,libcudnn:26,libjpeg:49,libnvidia:27,libpython:26,librari:[10,16,26,37,39,54],licens:55,like:[3,9,10,16,24,25,26,32,36,37,38,41,42,47,50,52,54,56,57],limit:[10,20,36,39],line:[2,3,5,9,20,25,33,35,36,37,41,42,47,49,50,54,55,56,57],linear:[6,10,16,30],linear_comb:10,linearactiv:[10,25],linguist:55,link:[10,11,16,17,26,42,52,56],linux:[26,27,29,42,57],lipeng:47,lipton:56,list:[2,3,8,9,10,11,16,20,23,25,32,34,37,39,41,42,49,50,52,54,55,56,57],listen:[27,39],literatur:56,littl:[2,3,39,52,56],lium:57,live:27,liwicki:56,load:[2,3,5,10,16,23,25,39,42,50,54,55,56,57],load_featur:50,load_feature_c:50,load_feature_pi:50,load_missing_parameter_strategi:[38,39,41,47,55],load_uniform_data:48,loadparamet:5,loadsave_parameters_in_pserv:[38,39],local:[7,15,26,27,33,37,38,39,43,49,56],localhost:27,locat:[32,34,52,55],log:[3,6,27,33,34,37,39,42,43,49,54,55,56,57],log_barrier_abstract:39,log_barrier_lowest_nod:[38,39],log_barrier_show_log:[38,39],log_clip:[38,39],log_error_clip:[38,39],log_period:[39,41,43,48,49,52,54,55,56,57],log_period_serv:[38,39],logarithm:14,logger:3,logic:[3,37],longer:57,look:[3,9,25,37,38,42,43,48,52],lookup:52,loop:24,loss:[10,16,34,48,52,56,57],lot:38,low:[10,16],lower:37,lowest:39,lst:54,lstm:[10,16,32,43,52],lstm_attr:17,lstm_bias_attr:[11,17],lstm_cell_attr:[11,17],lstm_group:[11,17],lstm_layer_attr:11,lstm_size:52,lstm_step:[11,17],lstmemori:[11,17,32],lstmemory_group:10,ltr:[10,16],lucki:25,mac:[26,27],machan:[11,17],machin:[10,11,12,16,17,25,33,34,38,39,41,42,43,52,54,56,57],made:[3,25,32,53],mai:[3,8,9,10,16,24,33,36,42,53],main:[3,5,33,42,49,55,56],mainli:39,maintain:[10,42],major:[27,33,48,50,56,57],make:[3,10,16,23,24,26,27,33,34,36,37,42,49,52,54,56],male:53,malloc:34,manag:[33,37],manageri:53,mandarin:[10,16],mani:[0,10,11,16,17,25,39,52,53,54,56],mannal:37,manual:[27,33],manufactur:57,mao:56,map:[3,10,16,23,39,49,50,54],map_read:20,mapreduc:23,marcu:56,mark:[3,32,55],mark_slot:55,market:[25,53,56],martha:55,mask:[7,10,15,16],master:[23,33,39,56],mat_param_attr:[11,17],match:36,math:[11,17,34,36],matirx:[10,16],matplotlib:49,matric:[5,32,34],matrix:[9,10,11,16,17,20,32,34,38,41,50,55],matrixptr:34,matter:3,max:[3,7,10,13,15,16,20,36,39,41,49,52,54],max_id:52,max_length:[10,32],max_sort_s:[10,16],maxid:[9,10,52],maxid_lay:[9,52],maxim:[10,57],maximum:[9,32,36,39,52,55,56],maxinum:19,maxout:10,maxpool:[10,16],mayb:[10,11,16,17,49],mean:[3,7,9,10,11,12,15,16,17,19,20,22,24,25,32,36,37,39,41,42,47,48,49,50,52,54,55,56,57],mean_img_s:49,mean_meta:50,mean_meta_224:50,mean_valu:50,measur:[25,36],mechan:[10,11,17,32,42,56],media:56,meet:55,member:23,memcpi:36,memor:56,memori:[2,3,11,17,32,34,36,39,41,43,52,55,56,57],memory_threshold_on_load_data:39,mere:[11,17],merg:[33,39,47,57],mergedict:[47,57],messag:[25,39,43,54,56,57],meta:[37,49,50,52],meta_config:[37,54],meta_fil:54,meta_gener:[37,54],meta_path:49,meta_to_head:54,metadata:[42,43],metaplotlib:23,method:[3,8,10,11,12,16,22,27,34,36,39,41,52,54,56,57],might:[10,16,34,42],mileag:36,million:[41,53],min:[7,15,36,41,42,54],min_pool_s:3,mind:37,mini:[3,10,16,20],mini_batch:24,minibatch:[10,16],minibatch_data:20,minim:[3,12,25,39],minimum:[10,16],minimun:39,minst:3,minut:[42,57],miss:[39,47,55],mit:42,mix:[11,17,32,55],mixed_attr:17,mixed_bias_attr:[11,17],mixed_lay:[11,32,55],mixed_layer_attr:11,mixedlayertyp:10,mkdir:[26,42],mkl:26,mkl_path:26,mkl_root:26,ml_data:[37,54],mnist:[3,5,24],mnist_provid:3,mnist_random_image_batch_read:24,mnist_train:[3,24],mnist_train_batch_read:24,mod:55,modal:55,mode:[10,16,39,48,49,50,54,56,57],model:[1,2,5,8,10,11,12,16,17,30,33,34,35,39,42,54,55,56],model_averag:12,model_config:[5,48],model_list:[39,41,55,56],model_output:56,model_path:41,model_zoo:[47,50],modelaverag:12,modifi:[5,32,33,34,37,42],modul:[2,3,5,8,11,17,20,25,26,49,50,52,54,55],modulo:[10,16],momentum:[7,12,15,25,52],momentumoptim:[25,49],mon:43,monitor:[52,56],mono:[10,16],month:[52,57],mood:56,more:[2,3,5,9,10,11,16,17,20,23,24,25,27,32,34,36,37,41,43,49,52,55,56,57],morin:[10,16],mose:[56,57],moses_bleu:57,mosesdecod:56,most:[3,5,10,20,23,24,25,32,34,36,38,54,55,56,57],mostli:[49,53],mount:[27,42,43],mountpath:[42,43],move:[10,16,36,42,54,56],movement:[36,56],movi:[3,56],movie_featur:54,movie_head:54,movie_id:54,movie_meta:54,movie_nam:54,movie_review:20,movieid:53,movielen:51,moving_average_fract:[10,16],mpi:37,mse:10,mse_cost:[25,54],much:[10,16,24,36],mul:34,mulit:37,multi:[10,16,34,38,39,50,57],multi_binary_label_cross_entropi:16,multi_crop:50,multinomi:[10,16],multipl:[9,10,11,16,17,20,23,32,34,39,41,42,48,52,54,56],multipli:[9,10,16,34,49],multithread:3,music:53,must:[3,9,10,11,14,16,17,24,26,32,33,34,37,39,41,42,57],my_cluster_nam:42,my_cool_stuff_branch:33,my_external_dns_nam:42,mypaddl:43,mysteri:53,name:[3,7,8,9,10,11,15,16,17,19,20,23,25,27,32,34,36,37,39,41,43,44,45,47,48,49,50,52,54,56,57],namespac:[34,43],nano:33,nativ:[10,16],natur:[41,55,56],nchw:[10,16],ndarrai:22,ndcg:[10,16],ndcg_num:[10,16],nearest:52,necessari:[3,10,16,26,34,37,52,56],necessarili:34,need:[3,10,11,16,17,20,23,25,26,27,29,32,33,34,37,38,39,41,42,43,48,49,50,52,54,55,56,57],neg:[3,9,10,16,52,55,56],neg_distribut:[10,16],negat:55,neighbor:52,nest:[3,20],net:[10,11,16,17],net_conf:56,net_diagram:50,network:[2,3,4,5,7,9,10,12,15,16,20,21,22,23,24,25,34,36,37,39,47,56,57],network_config:41,networkadministr:42,neural:[3,5,10,11,12,16,17,20,22,23,25,36,39,47,48,50,56,57],neuralnetwork:[10,16,30],neuron:[5,34,52,56],never:[20,24,42,43],newest:33,newtork:56,next:[10,32,34,36,39,42,43,55,56,57],nfs4:42,nfs:42,nfsver:42,nginx:27,nic:[37,38,39],nine:55,nlp:[3,10],nltk:20,nmt:57,nnz:34,no_cach:3,no_sequ:[3,54],noah:56,noavx:[27,29],node:[10,16,34,37,39,42,43,56,57],node_0:42,node_1:42,node_2:42,nodefil:37,noir:53,nois:[10,16,48],noise_dim:48,non:[10,16,34,39,42],none:[2,3,5,7,8,9,10,11,12,15,16,17,19,20,22,23,25,32,50,52],nonlinear:34,norm:48,norm_by_tim:[10,16],normal:[3,5,10,11,16,17,29,32,34,37,39,43,47,48,50],normzal:50,north:49,notat:[10,16],note:[3,5,7,10,11,12,15,16,17,19,23,24,26,27,36,39,41,42,47,49,54,56],notebook:27,noth:[14,39],notic:[32,34],novel:56,now:[0,3,10,16,25,27,33,39,42,48,54,55],np_arrai:20,nproc:26,ntst1213:57,ntst14:57,nullptr:34,num:[10,16,37,39,52,55,56,57],num_channel:[10,11,16,17,49],num_chunk_typ:9,num_class:[10,11,16,17,49],num_filt:[10,11,16,17],num_gradient_serv:[38,39],num_group:[10,16],num_neg_sampl:[10,16],num_parameter_serv:23,num_pass:[25,38,39,41,43,52,54,55,56,57],num_repeat:[10,16],num_result:9,num_results_per_sampl:10,number:[3,9,10,16,20,24,25,34,37,39,42,47,49,50,52,55,56,57],numchunktyp:9,numdevices_:41,numlogicaldevices_:41,numofallsampl:9,numofwrongpredict:9,numpi:[20,22,24,25,26,48,50],numsampl:36,numtagtyp:9,nvidia:[26,27,36,39],obj:[3,8,25,49,50,52,54],object:[3,5,7,8,9,10,11,12,15,16,17,20,22,23,36,48,49,50,52,55],observ:[12,25,34,36,57],obtain:[52,55,56],occup:[53,54],occur:[20,33],oct:43,odd:[10,16],off:27,offer:[5,55],offici:[27,42,49],offset:[10,16,54],often:[9,37,52,57],ograd:34,old:[27,33,39],omit:52,on_coverallscompil:26,on_init:3,on_travisexclud:26,onc:[3,10,27,33,34,42,52],one:[3,8,9,10,11,12,14,16,17,19,20,23,24,25,27,33,34,37,39,41,42,43,47,48,49,50,52,54,55,56,57],one_host_dens:54,one_hot_dens:54,onli:[2,3,5,9,10,11,16,17,19,20,23,25,26,32,33,34,36,38,39,41,42,43,47,50,52,53,56,57],onlin:[12,24],onto:42,open:[0,3,10,16,23,24,25,27,42,50,52,54,55],openbla:26,openblas_path:26,openblas_root:26,oper:[10,11,12,16,17,27,32,34,36,39,42,47,49,54],opinion:56,opt:[23,26],optim:[3,4,7,15,21,25,34,36,56],option:[3,9,10,16,23,25,33,34,37,41],order:[3,10,11,16,17,20,24,34,39,42,43,48,50,52,56,57],ordinari:56,oregon:42,org:[10,11,16,17,26,48],organ:[10,16,49,56,57],origin:[0,2,3,10,16,20,33,48,55,57],other:[3,9,10,11,12,16,17,20,26,29,32,33,41,42,43,47,48,49,50,52,53,54,55,56,57],otherchunktyp:9,otherwis:[2,8,10,16,20,23,24,32,37,41,54,57],our:[23,27,32,34,42,43,47,49,52,55,56,57],out:[10,16,23,25,32,36,39,42,43,49,56],out_dir:42,out_left:[10,16],out_mem:32,out_right:[10,16],out_size_i:[10,16],out_size_x:[10,16],outlin:40,outperform:55,output:[5,7,9,10,14,15,16,17,19,20,22,23,24,25,32,34,36,39,41,43,47,48,49,50,52,54,55,56,57],output_:[10,16,34],output_dir:50,output_fil:55,output_id:[10,16],output_lay:[22,50],output_max_index:19,output_mem:[10,16,32],outputh:[10,16],outputw:[10,16],outsid:[3,10,11,16,17],outter_kwarg:3,outv:34,over:[2,10,11,16,17,23,33,34,36,52,55,56],overcom:56,overhead:36,overlap:34,overrid:34,owe:0,own:[33,37,42],pacakg:29,packag:[3,16,20,28,42],pad:[10,32,52],pad_c:[10,16],pad_h:[10,16],pad_w:[10,16],paddepaddl:2,padding_attr:[10,16],padding_i:[10,16],padding_x:[10,16],paddl:[3,5,6,7,8,9,10,11,12,13,14,15,16,17,19,20,22,23,25,26,27,28,29,33,34,35,36,37,39,41,42,48,49,52,54,55,56,57],paddle_n:37,paddle_output:43,paddle_port:37,paddle_ports_num:37,paddle_ports_num_for_spars:37,paddle_pserver2:37,paddle_root:47,paddle_source_root:47,paddle_train:37,paddledev:[27,42,43],paddlepaddl:[0,2,3,5,10,11,12,16,17,20,24,25,26,29,30,32,33,34,35,36,37,44,45,50,52,54,55,56],paddlepadl:3,paddlpaddl:0,paddpepaddl:3,page:[33,42,54],pair:[9,55],palmer:55,paper:[10,16,47,48,50,55,56,57],paraconvert:47,paragraph:56,parallel:[36,39,41,42,43,57],parallel_nn:[7,15,38,39],param:[7,10,15,16,54],param_attr:[10,11,16,17,25,32],paramattr:[7,10,15,16,25,32],paramet:[2,3,4,5,8,9,10,11,12,16,17,19,20,21,24,25,34,35,41,48,49,52,54,55,56,57],parameter_attribut:[10,16],parameter_block_s:[38,39],parameter_block_size_for_spars:[38,39],parameter_learning_r:[7,15],parameter_nam:23,parameter_serv:23,parameterattribut:[7,10,11,15,16,17],parametermap:34,parameters_:34,parameterset:23,parametris:12,paramt:[42,47],paramutil:54,paraphras:57,paraphrase_data:47,paraphrase_model:47,paraspars:34,parent:[10,34],pars:[5,20,41,42,48,54,55],parse_config:[5,48],parser:54,part:[3,16,25,32,33,34,36,48,52,54,55,56,57],parti:[36,54],partial:[10,16,48],participl:47,particular:36,partit:42,pass:[3,8,10,16,22,24,25,33,34,36,37,39,42,43,48,49,52,54,55,56,57],pass_idx:24,pass_test:48,passtyp:34,password:[27,37],past:[23,27,42],path:[2,3,9,20,24,25,26,32,37,39,41,42,43,47,49,50,52,55,56,57],pattern:[25,42,54,56],paul:55,pave:57,pdf:[10,11,16,17],pem:[23,42],penn:55,per:[10,24,39,49,52],perfom:[39,41],perform:[2,10,11,16,17,25,32,33,34,35,37,38,48,49,52,56,57],period:[2,39,52,54,55,56,57],perl:[56,57],permiss:42,peroid:[10,16],persist:42,persistentvolum:42,persistentvolumeclaim:42,person:23,perspect:36,perturb:34,pgp:42,phase:25,photo:49,pick:[3,42],pickl:54,picklabl:8,pictur:52,piec:[10,11,16,17,25],pillow:49,pip:[26,33,37,49,54],pipe:53,pipelin:55,pixel:[3,10,16,20],pixels_float:3,pixels_str:3,place:[2,3,34,36,37,50,57],placehold:25,plai:[55,56],plain:[2,9,10,16],plan:34,platform:[0,25,27,42],pleas:[3,5,7,10,11,12,15,16,17,23,24,26,27,28,32,33,34,42,47,49,52,54,55],plot:[23,49],plotcurv:49,png:[49,50],pnpairvalidationlay:39,pnpairvalidationpredict_fil:38,pod:[42,43],pod_nam:42,point:[25,27,36],polar:56,polici:42,polit:56,poll:56,poo:49,pool3:34,pool:[3,4,11,17,21,49,52,54],pool_attr:[11,17],pool_bias_attr:[11,17],pool_layer_attr:11,pool_pad:[11,17],pool_siz:[3,10,11,16,17],pool_size_i:[10,16],pool_strid:[11,17],pool_typ:[10,11,16,17],pooling_lay:[11,52,54],pooling_typ:[10,16,52],poolingtyp:19,popular:[25,50],port:[27,37,38,39,42,43],port_num:38,ports_num:39,ports_num_for_spars:[38,39,41],pos:[54,56],posit:[3,9,10,16,20,52,55,56,57],positive_label:9,possibl:[23,33,36,48],post1:26,potenti:36,power:[10,52,57],practic:[8,10,16,25,32,34],pre:[3,10,11,17,23,42,43,47,49,55,56,57],pre_dictandmodel:47,precis:[9,26],pred:[52,55],predefin:56,predetermin:[10,39,57],predic:55,predicate_dict:55,predicate_dict_fil:55,predicate_slot:55,predict:[3,4,9,10,12,16,22,25,32,37,39,47,52,57],predict_fil:39,predict_output_dir:[38,39,52],predict_sampl:5,predicted_label_id:52,predictor:54,predin:49,prefer:56,prefetch:34,prefix:42,pregrad:34,preinstal:26,premodel:47,prepar:[5,30,44,52],preprcess:56,preprocess:[20,32,37,43,56],prerequisit:26,present:[23,50,55,57],pretti:25,prev_batch_st:[38,39],prevent:[2,12,23],previou:[10,11,16,17,34,39,42,55,57],previous:[43,50],price:25,primari:16,primarili:56,principl:23,print:[7,15,22,23,25,32,39,47,52,54,55,56,57],printallstatu:36,printer:9,printstatu:36,prite:9,privileg:42,prob:[9,48],probabilist:[10,16,47],probability_of_label_0:52,probability_of_label_1:52,probabl:[9,10,16,22,32,33,50,52,55],problem:[5,10,12,16,23,30,52,55,56],proc:27,proc_from_raw_data:52,proce:[20,24,42],procedur:[47,55,57],proceed:[10,16,55],process:[2,3,5,7,8,10,11,12,15,16,17,23,25,32,37,39,41,42,43,47,49,50,52,54,55,56,57],process_pr:52,process_test:8,process_train:8,processdata:[49,50],processor:36,produc:[11,17,20,24,27,50,52],product:[0,34,42,52,56],productgraph:43,profil:26,proflier:36,program:[2,20,23,24,36,37,39],programm:53,progress:39,proivid:3,proj:[10,16],project:[10,11,16,17,26,32,34,54],promis:[10,11,17],prompt:33,prone:23,prop:55,propag:[12,39,41],properli:52,properti:[3,39],propos:57,proposit:55,protect:34,proto:19,protobuf:26,protocol:39,prove:52,proven:57,provid:[0,8,10,16,20,23,25,32,36,37,42,47,48,49,50,53,56],providermemory_threshold_on_load_data:38,provis:42,provod:3,prune:10,pserver:[37,38,39,42],pserver_num_thread:[38,39],pserverstart_pserv:38,pseudo:23,psize:34,pull:[47,57],punctuat:56,purchas:52,purpos:[0,36],push_back:34,put:[34,37,43,52],pvc:42,pwd:27,py_paddl:[5,20,48],pydataprovid:[2,3,52],pydataprovider2:[4,5,25,32,52,54,56],pydataproviderwrapp:8,pyramid:[10,16],pyramid_height:[10,16],python:[2,3,4,8,16,22,23,25,26,27,33,37,47,48,49,55,56,57],pythonpath:49,pzo:56,qualifi:26,qualiti:52,queri:[10,16,42,57],question:[10,16,23,42,55],quick:[39,43,51,57],quick_start:[42,43,44,52],quick_start_data:43,quickli:25,quickstart:43,quit:36,quot:53,rac:10,rais:20,ramnath:56,ran:36,rand:[36,39,41,48,55],random:[3,7,10,15,16,20,24,25,39,48,49,55],randomli:56,randomnumberse:38,rang:[3,10,16,20,24,39,41,49,53,55],rank:[10,16,23,42,50,52],rare:3,rate:[7,9,12,15,34,37,49,52,54,56,57],rather:[5,42,56],ratio:39,raw:[10,16,25,52,56],raw_meta:54,rdma:[26,39],rdma_tcp:[38,39],reach:[36,55],read:[2,3,20,23,24,25,32,37,42,50,52,54],read_from_realistic_imag:23,read_from_rng:23,read_mnist_imag:23,read_ranking_model_data:23,reader:[22,57],reader_creator_bool:24,reader_creator_random_imag:[20,24],reader_creator_random_image_and_label:[20,24],reader_dict:20,readi:[25,42,43,49],readm:[53,54,56],readonesamplefromfil:3,readwritemani:42,real:[3,24,25,48],realist:23,reason:[10,11,17,23,27,43],rebas:33,recal:9,receiv:8,recent:57,reciev:39,recogn:49,recognit:[3,10,16,50,56],recommand:3,recommend:[2,11,17,23,32,34,37,39,54],recommonmark:26,recompil:36,record:[42,54,55],recordio:23,recov:[25,48],rectangular:[10,16],recurr:[55,56],recurrent_group:[11,17,32],recurrent_lay:11,recurrentgroup:9,recurrentlay:39,recurs:27,recv:42,reduc:[12,37,39,41],refer:[2,5,7,8,10,11,12,15,16,17,32,34,37,43,47,49,52,54,57],referenc:10,regard:55,regardless:57,regex:54,region:[36,55],regist:[34,36],register_gpu_profil:36,register_lay:34,register_timer_info:36,registri:43,regress:[9,30,51],regular:[7,12,15,34,42,49,52,56],rel:[2,11,17,37],relat:[3,8,29,43,54,56],relationship:[25,48],releas:[26,27,29,42,53,55],relev:[55,57],reli:26,relu:[6,10,16,34],reluactiv:10,remain:52,remot:[7,15,27,33,34,37,39,41,42],remoteparameterupdat:39,remov:[20,37,39,56],renam:57,reorgan:[10,16],repeat:10,replac:56,repo:33,report:[36,37],repositori:33,repres:[3,5,10,12,16,32,34,42,49,52,53],represent:[52,56],reproduc:57,request:[42,43,47,57],requir:[2,9,10,16,23,34,37,42,43,48,49,52,54],requrest:33,res5_3_branch2c_bn:50,res5_3_branch2c_conv:50,res:55,research:[10,16,49,53,56],resembl:56,reserv:3,reserveoutput:34,reset:[10,16],reshap:24,reshape_s:[10,16],residu:50,resnet:51,resnet_101:50,resnet_152:50,resnet_50:50,resolv:[33,43],resourc:[27,42],respect:[3,25,32,34,39,49,50,55,57],respons:[10,16,42,43],rest:[3,10,16,25],restart:[42,43],restartpolici:[42,43],restrict:39,resu:24,result:[5,9,10,14,16,22,32,36,39,42,49,50,52,54,55,56],result_fil:[9,32],ret_val:54,retir:53,retran:42,retriev:[34,43],return_seq:[11,17],reus:[24,34],reveal:23,revers:[10,11,16,17,32,55,56],review:[33,43,52,56],reviews_electronics_5:43,revis:52,rewrit:57,rgb:[10,16],rgen:56,rho:12,rich:25,right:[3,10,16,50],rmsprop:[12,52],rmspropoptim:54,rnn:[10,11,17,35,38,52,56],rnn_bias_attr:32,rnn_layer_attr:32,rnn_out:32,rnn_step:10,rnn_use_batch:[38,39],rnnlm:20,robot:49,role:[23,32,42,51,56],roman:56,romanc:53,root:[12,19,27,37,42,43],root_dir:37,rot:[10,16],rotat:10,roughli:[3,48],routin:54,routledg:56,row:[5,9,10,16,20,34,50],row_id:[10,16],rsize:42,rtype:[10,54],rule:[34,42],run:[23,27,33,34,35,36,39,42,44,45,47,49,50,52,54,56,57],runinitfunct:36,runtim:[2,3,26,37],s_fusion:54,s_id:54,s_param:48,s_recurrent_group:32,sacrif:2,sai:[25,39,41],sake:34,sale:53,same:[3,5,8,9,10,11,16,17,23,32,37,41,42,47,52,54,55,56,57],samping_id:[10,16],sampl:[3,5,9,20,37,39,41,47,48,50,52,54,55,56,57],sample_dim:48,sample_id:9,sample_num:9,santiago:56,satisfi:[37,42,52],save:[3,10,16,20,25,39,41,42,43,49,50,52,54,55,56,57],save_dir:[25,39,41,43,48,49,52,54,55,56,57],save_only_on:[38,39],saving_period:[38,39],saving_period_by_batch:[38,39,41,52],saw:3,scalabl:0,scalar:[3,10,16],scale:[0,10,14,50,53,54],scalingproject:[10,16],scatter:10,scenario:[25,38],scene:38,schdule:42,schedul:[42,48],scheduler_factor:[7,15],schema:47,scheme:[9,12,55],schmidhub:56,schwenk:57,sci:53,scienc:56,scientist:[0,53],score:[9,10,16,54,56,57],screen:54,scrip:52,script:[5,20,27,37,42,49,50,52,55,56,57],seaplane_s_000978:49,search:[10,26,32,39,55,57],seat:57,second:[3,10,16,20,23,24,25,33,37,47,50,52,53,54,56],secret:42,section:[3,32,34,37,42,52],sed:56,see:[3,5,10,11,16,17,23,25,33,36,42,47,48,50,52,54,56,57],seed:[36,39],segment:9,segmentor:47,sel_fc:[10,16],select:[10,16,33,42,53,57],selectiv:[10,16],selector:43,self:[25,34,53,56],selfnorm:[10,16],semant:[23,32,51,56],semat:23,sen_len:55,send:[39,42],sens:10,sent:[23,43],sent_id:32,sentenc:[3,10,32,52,55,56,57],sentiment:[3,25,51,52,55],sentiment_data:56,sentiment_net:56,sentimental_provid:3,separ:[3,9,39,47,52,53,54,55,57],seq:[10,16,54],seq_pool:[10,16],seq_text_print:9,seq_to_seq_data:[47,57],seq_typ:[3,20,54],seqtext_printer_evalu:32,seqtoseq:[10,32,47,57],seqtoseq_net:[10,32,47,57],sequel:3,sequenc:[3,9,10,11,14,16,17,19,20,34,47,52,54,55,56,57],sequence_conv_pool:52,sequence_layer_group:10,sequence_nest_layer_group:10,sequencesoftmax:6,sequencestartposit:[10,16],sequencetextprint:9,sequencetyp:3,sequenti:[8,10,16,32,52,55],seri:[11,17,56],serial:3,serv:[27,36,42,48],server:[23,27,34,37,38],servic:53,session:36,set:[2,3,5,7,9,10,11,15,16,17,20,23,25,26,27,29,32,34,35,36,37,38,39,41,42,43,47,49,50,52,53,54,55,56,57],set_active_typ:34,set_default_parameter_nam:[7,15],set_drop_r:34,set_siz:34,set_typ:34,setp:42,settup:34,setup:[3,34,52],sever:[3,10,16,37,41,42,51,52,54,55,56,57],sgd:[12,23,37,48,56,57],sgdasync_count:38,shallow:55,shape:[10,16,50],shard:42,share:[10,16,26,27,36,39,43,55],shared_bia:[11,17],shared_bias:[10,16],shell:[42,50],shift:50,ship:49,shold:56,shop:56,shorter:50,should:[3,5,9,10,12,16,20,22,23,24,25,29,32,33,37,42,49,52,54,55,56,57],should_be_fals:23,should_be_tru:23,should_shuffl:[3,55],shouldn:33,show:[5,12,16,25,33,39,42,43,47,50,52,54,55,56,57],show_check_sparse_distribution_log:[38,39],show_layer_stat:[38,39],show_parameter_stats_period:[38,39,41,43,52,55,56,57],shown:[3,9,10,16,23,32,34,36,42,48,49,50,52,54,56,57],shrink:34,shuf:54,shuffl:[3,20,54,56],sid:42,side:[10,16,50],sig:42,sigint:37,sigmoid:[6,10,16,17,34],sigmoidactiv:[10,11],sign:42,signal:37,signatur:42,signific:36,similar:[10,16,24,42,52,54],similarli:[10,16,55],simpl:[2,3,9,10,11,14,16,17,20,26,30,33,36,39,52,54,55,56],simple_attent:32,simple_gru:52,simple_lstm:[10,16,52],simple_rnn:[10,32],simplest:42,simpli:[2,10,16,23,26,27,32,33,36,47,50,54,56,57],simplifi:[23,34,43],simultan:42,sinc:[10,16,24,25,36,42,48,52,53,57],sincer:[33,56],singl:[3,9,11,12,17,20,27,34,37,43,50,52,55,57],site:42,six:[47,55,57],size:[3,9,10,11,12,16,17,20,24,25,32,34,37,39,48,49,50,52,53,54,55,56,57],size_a:[10,16],size_b:[10,16],size_t:34,sizeof:47,skill:57,skip:[24,25,37,42,50],slide:12,slightli:49,slope:[10,16],slot:[54,55],slot_dim:54,slot_nam:54,slottyp:54,slow:[3,36],small:[3,34,37,39,49,57],small_messag:[38,39],small_vgg:49,smaller:[10,16],smith:56,snap:43,snapshot:42,snippet:[32,34,36,42,52],social:56,sock_recv_buf_s:[38,39],sock_send_buf_s:[38,39],socket:39,softmax:[6,10,11,16,17,23,32,34,47,52,55,56],softmax_param_attr:[11,17],softmax_selfnorm_alpha:[10,16],softmaxactiv:[32,52],softrelu:6,softwar:36,solv:[23,55],solver:57,some:[3,7,10,12,15,16,20,23,25,26,33,34,36,38,39,41,42,48,52,53,54,55,56,57],somedata:22,someth:[3,10,16],sometim:[12,24,36,56],sophist:[25,34,37],sort:[10,16,20,39,42,54,56,57],sourc:[0,8,10,16,24,25,27,30,32,33,42,43,47,52,54,57],source_dict_dim:32,source_language_word:32,space:[9,32,36],space_seperated_tokens_from_dictionary_according_to_seq:9,space_seperated_tokens_from_dictionary_according_to_sub_seq:9,spars:[3,7,10,12,15,16,20,34,37,39,42,52],sparse_binary_vector:[3,20,52],sparse_binary_vector_sequ:20,sparse_float_vector:3,sparse_non_value_slot:20,sparse_upd:[7,15],sparse_value_slot:20,sparse_vector:20,sparse_vector_sequ:20,sparseparam:34,sparseprefetchrowcpumatrix:34,spatial:[10,16,49],speak:[32,57],spec:[42,43],specfii:39,speci:49,special:[10,26,47,52,57],specif:[2,41,49,52,54],specifi:[2,3,9,10,16,20,23,25,26,32,34,39,42,48,49,50,52,53,54,56,57],speech:[10,16],speed:[11,17],spefici:50,sphinx:26,sphinx_rtd_them:26,split:[3,10,16,37,41,42,47,50,52,55],split_count:42,spp:10,sql:2,squar:[6,10,12,16,19,25],squarerootn:13,squarerootnpool:[10,16],squash:57,srand:39,src:57,src_backward:32,src_dict:32,src_embed:32,src_forward:32,src_id:32,src_root:5,src_word_id:32,srl:55,ssh:[27,37,42,43],sshd:27,ssl:26,sstabl:23,stabl:42,stack:[25,42,52,55],stacked_lstm_net:56,stacked_num:56,stackexchang:[10,16],stage:37,stake:57,stale:33,stamp:36,standard:[7,15,47,49,55,56,57],stanford:[20,43],stanh:6,star:53,start:[10,16,25,27,32,33,36,37,39,46,47,51,54,57],start_pass:[38,39],start_pserv:39,startup:42,stat:[26,36,39,55,56,57],state:[10,11,16,17,25,32,39,43,48,55,57],state_act:[10,11,16,17],statement:[34,42],staticinput:[10,32],statist:[10,16,39,52,55,56,57],statset:36,statu:[9,33,36,42,43],status:43,std:[34,39],stderr:37,stdout:37,step:[5,10,11,12,16,17,19,32,34,36,37,42,43,52,54,55,56,57],still:50,stmt1482205552000:42,stmt1482205746000:42,stochast:12,stock:56,stop:[10,37,39,43,54],storag:[42,43,49],store:[9,10,16,34,37,39,42,43,47,49,50,52,54,55,56,57],str:[22,41],straight:33,strategi:[3,19,39,55],street:[10,16,55],strength:48,strict:24,stride:[10,16],stride_i:[10,16],stride_x:[10,16],string:[2,3,8,9,10,16,34,39,42,56],strip:[52,54,55],structur:[20,37,42,47,49,52,54,55,56,57],sts:42,stub:[10,16],student:53,stuff:33,stun:3,style:[3,10,16,26,33],sub:[9,10,16,20,23,32,34,49,52,57],sub_sequ:3,subgradi:12,submit:[33,38,39,42],subnet0:42,subnet:[23,42],subobjectpath:43,subsequenceinput:10,subset:[34,57],substanti:50,substitut:57,succe:56,succeed:43,success:[42,43,50,55],successfulcr:43,successfuli:56,successfulli:[50,54,56],successor:[39,57],sucessfulli:57,sudo:[26,29,42,49],suffic:[24,25],suffici:39,suffix:57,suggest:[10,16,36],suitabl:[33,39,49],sum:[9,10,12,13,16,32,34],sum_:10,sum_to_one_norm:10,summar:[52,56],sumpool:[10,16],support:[7,9,10,12,15,16,19,20,24,26,27,29,32,34,36,39,42,55],suppos:[25,34,52],sure:[33,34,42,49,56],survei:56,swap_channel:50,swig:[5,26],swig_paddl:[5,20,48],symbol:10,sync:[33,39,48],syncflag:34,synchron:[12,37,39,42],syntact:55,syntax:[24,54],synthect:25,synthes:48,synthet:25,sys:50,system:[26,27,37,43,52,55,56,57],t2b:47,tab:52,tabl:[3,10,16,50,52,57],tableproject:[10,16],tag:[9,32],tagtyp:9,take:[3,5,9,10,11,16,17,23,32,34,36,42,43,48,55,57],taken:[3,55],tanh:[6,10,11,16,17,34],tanhactiv:[10,11,32],taobao:56,tar:[20,26,42],tarbal:42,target:[10,16,32,47,52,57],target_dict_dim:32,target_language_word:32,targetinlink:10,task:[3,9,10,16,25,32,41,47,50,55,56,57],tconf:56,tcp:[39,42],teach:52,tear:36,technician:53,techniqu:[32,34],tee:[43,49,54,55,56,57],tell:[36,54],tellig:56,templat:[43,55],tempor:[10,16,52,55],tensor:10,term:[10,11,16,17,55,56],termin:[27,43],terminolog:25,tese:2,tesh:55,test:[2,3,8,9,10,16,20,23,24,26,27,29,33,36,37,38,47,49,50,52,53,57],test_all_data_in_one_period:[43,49,54,55,56],test_data:57,test_fcgrad:34,test_gpuprofil:36,test_layergrad:34,test_list:[3,8,25,49,52],test_part_000:56,test_pass:[38,39,41,57],test_period:[38,39,41],test_ratio:54,test_wait:[38,39],testa:23,testb:23,testbilinearfwdbwd:36,testconfig:34,tester:[54,57],testfcgrad:34,testfclay:34,testlayergrad:34,testmodel_list:38,testq:23,testsave_dir:38,testutil:34,text:[2,3,9,11,17,20,23,27,32,42,47,51,52,54,56],text_conv:52,text_conv_pool:54,text_fil:[20,56],tflop:36,tgz:26,than:[3,5,7,9,10,11,12,15,16,17,26,27,32,34,37,42,50,55,56,57],thank:[0,47,57],thei:[3,23,25,32,34,36,37,38,42,50,56],them:[2,3,11,17,23,24,25,27,32,36,38,39,42,49,50,52,54,56,57],theori:36,therefor:26,therein:[10,16],therun:50,thi:[2,3,7,8,9,10,11,12,15,16,17,20,23,24,25,26,27,29,32,33,34,36,37,39,41,42,43,47,48,49,50,52,53,54,55,56,57],thing:[3,25,32,33,36,54,55],think:23,third:[10,16,36,50,56],those:[50,55],thought:36,thread:[34,36,39,41,54,55,56,57],thread_local_rand_use_global_se:[38,39],threadid:41,threadloc:36,three:[3,9,10,12,16,24,25,32,39,48,50,56,57],threshold:[7,9,12,15,39,56],thriller:53,through:[5,10,16,32,34,36,37,47,48,49,56,57],throughout:52,throughput:36,thu:[3,10,16,25,34,42,57],tier:43,tight:26,time:[3,10,11,16,17,19,20,23,24,25,32,36,39,41,43,52,53,55,56,57],timelin:[10,16,36],timeo:42,timer:26,timestamp:[10,16,53],timestep:[3,10,16],titil:54,titl:[33,53,54],tmall:56,todo:[9,11,17,20,22],toend:[10,16],togeth:[3,10,11,16,17,20,32],token:[9,10,23,32,47,56,57],too:[27,29],tool:[32,33,42,56],toolchain:26,toolkit:[26,29],top:[9,50,55],top_k:9,topolog:[16,23],toronto:[20,49],total:[9,24,36,37,43,47,57],total_pass:24,touch:56,tourism:56,tourist:57,toward:25,tra:57,track:10,tractabl:10,tradesman:53,tradit:[10,16],trail:20,train:[1,2,3,5,7,8,9,10,12,15,16,20,30,32,34,35,36,38,44,45,50],train_conf:[47,57],train_config_dir:42,train_data:57,train_id:42,train_list:[3,8,25,49,50,52],train_part_000:56,trainabl:[10,16],traindot_period:38,trainer:[3,5,23,25,34,37,39,41,48,52,55,56,57],trainer_config:[2,3,25,37,42,43,52,54,56],trainer_config_help:[3,6,7,8,9,10,11,12,13,25,34,49,52,54],trainer_count:[38,39,41,42,43,54,55,56,57],trainer_id:[39,42],trainerintern:[52,54,57],training_machin:48,trainingtest_period:38,trainonedatabatch:48,tran:[10,34,39],trane:3,transact:56,transfer:[2,3],transform:[10,16,32,34,48,49,52,55],transform_param_attr:[11,17],translat:[10,11,17,25,47,54,56,57],transpar:37,transport:39,transpos:[10,16,34,48],transposedfullmatrixproject:[10,16],travel:[3,11],travi:[26,33],treat:[10,16,32],tree:[10,16,27,33,39,57],trg:57,trg_dict:32,trg_dict_path:32,trg_embed:32,trg_id:32,trg_ids_next:32,triain:2,trivial:3,trn:52,truck:49,true_imag:24,true_label:24,true_read:24,truth:[9,10,16,52,57],tst:52,tune:[7,15,35,52,54,57],tuninglog_barrier_abstract:38,tupl:[3,8,10,11,16,20,24],ture:[10,16],turn:[10,24,48],tutori:[32,33,34,36,37,42,43,44,45,46,50,52],tweet:56,twelv:57,twitter:56,two:[2,3,10,11,16,17,23,24,25,32,36,37,41,42,47,48,49,50,52,54,55,56,57],txt:[3,34,37,42,52,54,56],type:[3,8,9,10,11,12,16,17,19,20,22,23,24,25,32,34,39,41,42,43,49,50,52,54,55],type_nam:[10,54],typic:[5,9,36,56],ubuntu:29,ubyt:24,uci:20,ufldl:[10,16],uid:43,unbalanc:39,unbound:32,unconstrain:56,under:[25,26,42,53,56],underli:25,understand:[27,36,47,49,56],understudi:57,undeterminist:36,unemploi:53,unexist:55,uniform:[7,10,15,16,20,24,39,48],uniqu:[23,33,39,42],unique_ptr:34,unit:[10,11,16,17,25,26,27,32,33,55],unittestcheckgrad_ep:38,univ:57,unix:37,unk:[47,57],unk_idx:[52,55],unknown:[10,16],unlabel:56,unlik:[55,56,57],unseg:[10,16],unsup:56,unsupbow:56,until:[37,42,55],unus:54,unzip:54,updat:[7,10,12,15,16,26,34,37,39,41,56],updatecallback:34,updatestack:42,upon:[0,55],upstream:33,uri:42,url:[29,56],urls_neg:56,urls_po:56,urls_unsup:56,usag:[2,3,9,10,11,16,17,20,22,25,36,47,48,54],use:[0,2,3,5,7,8,9,10,11,12,15,16,17,19,20,23,25,26,27,28,29,32,33,34,36,37,39,41,42,43,47,48,49,50,52,53,54,55,56,57],use_global_stat:[10,16],use_gpu:[38,39,41,43,48,49,50,52,54,55,56,57],use_jpeg:49,use_old_updat:[38,39],use_seq:[25,54],use_seq_or_not:54,used:[2,3,5,9,10,11,12,16,17,19,20,23,24,25,28,29,32,34,36,37,38,39,41,42,47,49,50,52,54,55,56,57],useful:[2,3,10,11,17,32,34,41,52,55,56],usegpu:[34,48],useless:37,user:[2,3,7,9,10,11,15,16,17,20,22,23,24,25,27,33,37,38,39,42,50,52,55],user_featur:54,user_head:54,user_id:54,user_meta:54,user_nam:54,userid:53,usernam:33,uses:[3,32,33,34,39,42,49,50,52,54,57],using:[2,3,5,7,8,10,15,16,20,23,24,25,27,32,33,34,36,39,41,42,43,47,48,49,50,52,55,56],usr:[26,27,37,39,42],usrdict:47,usrmodel:47,usual:[10,16,20,25,26,27,36,39,41,42,56],utf:47,util:[5,26,32,34,36,49,54,56],v28:[10,16],valid:[24,42,50,56],valu:[3,5,7,9,10,12,15,16,19,20,22,25,32,34,39,41,42,48,49,50,55,56],value1:39,value2:39,value_rang:20,vanilla:32,vanish:56,vari:[36,42],variabl:[3,10,16,20,23,25,26,29,34,37,42,43,56],varianc:[10,16,50],vast:33,vector:[3,10,11,16,17,20,23,32,34,47,52,54,56,57],vectorenable_parallel_vector:38,verb:55,veri:[3,10,16,19,32,36,49,52,56],verifi:[33,34],versa:26,version:[10,11,16,17,26,27,29,34,36,37,38,39,42,43,47,49,53,55,56,57],versu:23,vertic:[10,16,50],vgg:[11,17,49],vgg_16_cifar:49,via:[24,26,36,37,42,52],vice:26,view:[10,16],vim:33,virtualenv:54,vision:49,visipedia:49,visual:[10,16,27,36],viterbi:55,voc_dim:52,vocab:56,volum:[27,43],volumemount:[42,43],volumn:42,voluntarili:53,vutbr:20,wai:[3,10,11,16,17,23,25,27,32,34,37,41,54,55,57],wait:[12,39],walk:[5,48],wall:55,want:[3,10,11,16,17,23,24,25,26,27,34,39,41,47,50,52,54,55,56],war:53,warn:[10,16],warp:[10,16,36],wbia:[42,50],web:27,websit:[49,52,55,56],wei:[55,56],weight:[9,10,11,12,16,17,32,34,39,41,49,50],weight_act:[11,17],weightlist:34,weights_:34,weights_t:34,welcom:[54,56],well:[34,39,42,49,52],west:42,western:53,wether:[10,16],what:[7,10,11,12,15,16,17,25,37,52,54],wheel:26,when:[2,3,7,9,10,12,15,16,20,29,32,33,34,36,39,41,42,43,47,48,49,55,56,57],whenev:54,where:[3,10,11,12,16,17,23,25,32,34,36,37,39,41,47,50,55,57],whether:[9,10,11,16,17,24,34,39,48,49,54,56,57],which:[0,2,3,5,9,10,11,12,16,17,20,23,24,25,29,32,34,36,37,39,41,42,48,49,50,52,53,54,55,56,57],whichev:48,whl:26,who:[47,50,53],whole:[3,9,20,42,43,52,53,54,57],whole_cont:54,whose:[3,20,32,54,55],why:[11,17],wide:55,width:[9,10,16,20,24,34,49,57],wiki:[10,16],wikipedia:[10,16],wilder:3,window:[10,16,19,27,56],wise:[10,16],with_avx:27,with_avxcompil:26,with_doccompil:26,with_doubl:34,with_doublecompil:26,with_dsocompil:26,with_gpucompil:26,with_profil:36,with_profilercompil:26,with_pythoncompil:26,with_rdmacompil:26,with_style_checkcompil:26,with_swig_pycompil:26,with_testingcompil:26,with_tim:36,with_timercompil:26,within:[10,25],without:[9,10,16,24,37,56],wmt14:57,wmt14_data:57,wmt14_model:57,wmt:57,woboq:27,won:[36,50],wonder:3,word:[3,9,10,20,32,41,51,54,55,56,57],word_dict:[52,55],word_dim:52,word_id:3,word_slot:55,word_vector:52,word_vector_dim:[32,47],words_freq_sort:20,work:[3,5,20,23,24,26,27,32,33,34,36,37,39,42,43,52,54],worker:42,workercount:42,workflow:[33,42],workspac:[39,54],worri:25,wors:48,would:[22,24,27,37,42,48,52,55],wouldn:27,wrap:55,wrapper:[11,17,36],writ:54,write:[3,20,23,24,32,33,35,37,42,49,54,55,57],writelin:25,writer:[23,53],written:[54,56],wrong:[3,24],wsize:42,wsj:55,www:[10,16,20,27,49,57],x64:26,xarg:[27,34],xgbe0:39,xgbe1:39,xiaojun:56,xrang:[24,25,34],xxbow:56,xxx:[23,27,50,57],xxxxxxxxx:42,xxxxxxxxxx:42,xxxxxxxxxxxxx:42,xxxxxxxxxxxxxxxxxxx:42,xzf:26,y_i:10,y_predict:25,yaml:[42,54],yann:20,year:53,yeild:49,yield:[3,20,23,24,25,32,52,54,55,56],you:[2,3,5,7,10,11,12,15,16,17,25,26,27,29,32,33,34,36,37,39,41,42,47,48,49,50,52,54,55,56,57],your:[3,10,16,23,26,27,34,36,37,41,42,52,56],your_access_key_id:42,your_secrete_access_kei:42,yum:26,yuyang18:[11,17,20,22],yyi:27,zachari:56,zeng:56,zero:[3,7,10,12,15,16,20,34,39,42,52],zhidao:47,zhou:[55,56],zip:53,zone:42,zxvf:42,zzz:27},titles:["ABOUT","API","Introduction","PyDataProvider2","API","Python Prediction","Activations","Parameter Attributes","DataSources","Evaluators","Layers","Networks","Optimizers","Poolings","Activation","Parameter Attribute","Layers","Networks","Optimizer","Pooling","Datasets","Model Configuration","Training and Inference","PaddlePaddle Design Doc","Python Data Reader Design Doc","Simple Linear Regression","Installing from Sources","PaddlePaddle in Docker Containers","Install and Build","Debian Package installation guide","GET STARTED","RNN Models","RNN Configuration","Contribute Code","Write New Layers","HOW TO","Tune GPU Performance","Run Distributed Training","Argument Outline","Detail Description","Set Command-line Parameters","Use Case","Distributed PaddlePaddle Training on AWS with Kubernetes","Paddle On Kubernetes","&lt;no title&gt;","&lt;no title&gt;","PaddlePaddle Documentation","Chinese Word Embedding Model Tutorial","Generative Adversarial Networks (GAN)","Image Classification Tutorial","Model Zoo - ImageNet","TUTORIALS","Quick Start","MovieLens Dataset","Regression MovieLens Ratting","Semantic Role labeling Tutorial","Sentiment Analysis Tutorial","Text generation Tutorial"],titleterms:{"case":41,"class":34,"function":47,"new":34,"return":24,AWS:42,Abs:14,DNS:42,EFS:42,For:43,KMS:42,Use:[41,43],Using:[27,33],about:0,absactiv:6,access:42,account:42,activ:[6,14],adadelta:18,adadeltaoptim:12,adagrad:18,adagradoptim:12,adam:18,adamax:18,adamaxoptim:12,adamoptim:12,add:42,address:42,addto:16,addto_lay:10,adversari:48,aggreg:[10,16],algorithm:52,analysi:56,api:[1,4],appendix:52,applic:4,approach:36,architectur:[32,52],argument:[24,38,41,52],asset:42,associ:42,async:39,attent:32,attribut:[7,15],auc_evalu:9,avg:19,avgpool:13,avx:27,aws:42,background:25,base:[9,10],baseactiv:6,basepool:19,basepoolingtyp:13,basesgdoptim:12,batch:24,batch_norm:16,batch_norm_lay:10,batch_siz:24,beam_search:[10,16],between:23,bidirect:56,bidirectional_lstm:[11,17],bilinear_interp:16,bilinear_interp_lay:10,bleu:57,block_expand:16,block_expand_lay:10,book:27,brelu:14,breluactiv:6,bucket:42,build:[26,28,43],built:36,cach:3,cento:26,check:[10,16,34,37],chines:47,choos:42,chunk_evalu:9,cifar:20,classif:[9,49],classification_error_evalu:9,classification_error_printer_evalu:9,clone:33,cloudform:42,cluster:[37,41,42],code:33,column_sum_evalu:9,command:[40,41,52,57],commit:[33,43],common:39,commun:39,compos:24,concat:16,concat_lay:10,concept:42,config:[4,41,54,55],configur:[21,32,35,37,42,52,54],conll05:20,connect:[10,16],contain:[27,43],content:[36,42],context_project:[10,16],contribut:33,conv:[10,16],conv_oper:[10,16],conv_project:[10,16],conv_shift:16,conv_shift_lay:10,convolut:[49,52],core:42,cos_sim:[10,16],cost:[10,16],cpu:[27,41],creat:[24,33,42,43],creator:24,credenti:42,credit:0,crf:16,crf_decod:16,crf_decoding_lay:10,crf_layer:10,cross_entropi:10,cross_entropy_cost:16,cross_entropy_with_selfnorm:10,cross_entropy_with_selfnorm_cost:16,ctc:16,ctc_error_evalu:9,ctc_layer:10,cudnnavg:19,cudnnmax:19,custom:24,dat:53,data:[10,16,20,24,25,32,42,43,47,48,49,52,54,55,56,57],data_lay:10,datafeed:20,dataprovid:[3,4,39],dataset:[20,53,54,57],datasourc:8,datatyp:20,date:33,debian:29,decayedadagrad:18,decayedadagradoptim:12,decor:24,defin:[42,52,56,57],delet:42,delv:49,demo:42,depend:26,deriv:34,descript:[39,48,53,55],design:[23,24],destroi:42,detail:[39,49],develop:[27,35],devic:41,dictionari:[24,47],differ:41,directori:42,distribut:[23,37,39,42],doc:[23,24],docker:[27,43],document:[27,46],dotmul_oper:[10,16],dotmul_project:[10,16],down:42,download:[26,42,43,47,50,54,57],dropout_lay:[11,17],ec2:42,elast:42,embed:[16,47,52],embedding_lay:10,entri:24,eos:16,eos_lay:10,equat:34,evalu:[9,25,54],evalutaion:57,event:[22,23],exampl:[23,47,48],exercis:49,exp:14,expactiv:6,expand:16,expand_lay:10,extern:42,extract:[47,50,54,57],fc_layer:10,featur:[50,53,54,55],field:54,file:[42,43,52,53,54],find:42,first_seq:[10,16],fork:33,format:52,from:[23,26,28],full_matrix_project:[10,16],fulli:[10,16],gan:48,gate:32,gener:[32,48,57],get:[30,43],get_output:16,get_output_lay:10,github:33,gpu:[27,36,39,41],gradient:34,gradient_printer_evalu:9,group:[10,16,42],gru:[11,17,39],gru_group:[11,17],gru_step:16,gru_step_lay:10,gru_unit:[11,17],grumemori:[10,16],guid:29,hand:36,handler:23,hook:33,how:[24,35,36],hsigmoid:[10,16],huber_cost:[10,16],iam:42,ident:14,identity_project:[10,16],identityactiv:6,imag:[10,11,16,17,27,43,49],imagenet:50,imdb:[20,56],img_cmrnorm:16,img_cmrnorm_lay:10,img_conv:16,img_conv_bn_pool:[11,17],img_conv_group:[11,17],img_conv_lay:10,img_pool:16,img_pool_lay:10,imikolov:20,implement:[24,34,48],infer:[22,52],info:50,ingredi:23,init_hook:3,initi:[41,42],input_typ:3,inspect:42,instal:[26,28,29,42,52],instanc:42,integr:42,interfac:[20,24,50],interpol:16,interpolation_lay:10,introduct:[2,47,50,56,57],isn:24,job:[37,42,43],join:[10,16],keep:33,kei:42,kill:37,kube:42,kubectl:42,kubernet:[42,43],label:55,lambda_cost:[10,16],last_seq:[10,16],lastest:33,launch:37,layer:[10,16,23,34,41],layeroutput:10,layertyp:10,line:[40,52],linear:[14,25],linear_comb:16,linear_comb_lay:10,linearactiv:6,list:24,local:[41,42],log:[14,52],logactiv:6,logist:52,lstm:[11,17,39,55,56],lstm_step:16,lstm_step_lay:10,lstmemori:[10,16],lstmemory_group:[11,17],lstmemory_unit:[11,17],map:24,math:[10,16],matrix:39,max:19,maxframe_printer_evalu:9,maxid:16,maxid_lay:10,maxid_printer_evalu:9,maxout:16,maxout_lay:10,maxpool:13,memori:[10,16],meta:54,mini:24,minibatch:20,misc:[11,17],mix:[10,16,41],mixed_lay:10,mnist:[20,48],model:[3,4,21,23,25,31,32,37,41,47,48,49,50,51,52,57],modifi:43,momentum:18,momentumoptim:12,movi:[53,54],movielen:[20,53,54],mse_cost:10,multi_binary_label_cross_entropi:10,multi_binary_label_cross_entropy_cost:16,multipl:24,name:42,nce:16,nce_lay:10,need:[24,36],network:[11,17,32,41,48,49,50,52,54,55],neural:[32,49,52,54,55],neuralnetwork:25,nlp:[11,17,39],non:[3,27],norm:[10,16],nvprof:36,nvvp:36,object:54,observ:[47,50],onli:[24,27],optim:[12,18,35,52],option:[26,47],outlin:38,output:[11,37,42],overview:52,packag:29,pad:16,pad_lay:10,paddl:[24,43],paddlepaddl:[23,27,28,42,46,47,57],pair:42,parallel_nn:41,paramet:[7,15,22,23,39,40,42,47,50],paraphras:47,pass:41,perform:[36,39],pnpair_evalu:9,point:42,pool:[10,13,16,19],pooling_lay:10,power:16,power_lay:10,pre:33,precision_recall_evalu:9,predict:[5,49,50,54,55,56],prefetch:24,prepar:[25,32,37,42,47,48,49,54,56,57],preprocess:[47,49,52,54,57],prerequisit:37,pretrain:[47,57],print:9,privat:42,problem:25,profil:36,provid:[3,24,52,54,55],pull:33,push:33,pydataprovider2:3,python:[5,24,34,50,52,54],quick:52,randomnumb:39,rank:9,rank_cost:[10,16],rat:54,rate:53,reader:[20,23,24],recurr:[10,11,16,17,32,52],recurrent_group:[10,16],recurrent_lay:10,refer:[3,36,55,56],region:42,regress:[25,52,54],relu:14,reluactiv:6,render:42,repeat:16,repeat_lay:10,request:33,requir:[26,33],reshap:[10,16],resnet:50,result:[37,43,57],revis:[33,47],rmsprop:18,rmspropoptim:12,rnn:[31,32,39],role:55,rotat:16,rotate_lay:10,route53:42,run:[37,43,55],sampl:[10,16],sampling_id:16,sampling_id_lay:10,scale:16,scaling_lay:10,scaling_project:[10,16],script:43,secur:42,selective_fc:16,selective_fc_lay:10,semant:55,sentiment:[20,56],seq_concat:16,seq_concat_lay:10,seq_reshap:16,seq_reshape_lay:10,seqtext_printer_evalu:9,sequenc:32,sequence_conv_pool:[11,17],sequencesoftmax:14,sequencesoftmaxactiv:6,sequenti:3,server:[39,42],servic:42,set:[12,40],setup:[26,42],sgd:39,share:23,shuffl:24,sigmoid:14,sigmoidactiv:6,simpl:[25,32],simple_attent:[11,17],simple_gru:[11,17],simple_img_conv_pool:[11,17],simple_lstm:[11,17],singl:24,slice:[10,16],slope_intercept:16,slope_intercept_lay:10,softmax:14,softmaxactiv:6,softrelu:14,softreluactiv:6,sourc:[26,28],span:26,spars:41,specifi:[41,47],split:54,spp:16,spp_layer:10,squar:14,squareactiv:6,squarerootn:19,squarerootnpool:13,stack:56,standard:52,stanh:14,stanhactiv:6,start:[23,30,42,43,52],startup:43,structur:48,suffici:24,sum:19,sum_cost:[10,16],sum_evalu:9,sum_to_one_norm:16,sum_to_one_norm_lay:10,summar:23,summari:52,sumpool:13,system:42,table_project:[10,16],take:24,tanh:14,tanhactiv:6,tear:42,templat:42,tensor:16,tensor_lay:10,test:[34,39,41,54,55,56],text:57,text_conv_pool:[11,17],timer:36,tip:36,toi:48,tool:36,train:[22,23,24,25,37,39,41,42,43,47,48,49,52,54,55,56,57],trainer:[22,42,54],tran:16,trans_full_matrix_project:[10,16],trans_lay:10,transfer:52,tune:[36,39],tutori:[47,49,51,55,56,57],ubuntu:26,uci_h:20,unit:[34,39],updat:[23,33,42],usag:[24,27,35],use:24,user:[47,53,54,56,57],util:9,value_printer_evalu:9,vector:39,verifi:42,version:33,vgg_16_network:[11,17],visual:50,volum:42,vpc:42,warp_ctc:16,warp_ctc_lay:10,what:36,why:[24,36],wmt14:20,word:[47,52],workflow:57,workspac:37,wrapper:34,write:[34,52],yaml:43,your:33,zoo:[50,51]}}) Search.setIndex({docnames:["about/index_en","api/index_en","api/v1/data_provider/dataprovider_en","api/v1/data_provider/pydataprovider2_en","api/v1/index_en","api/v1/predict/swig_py_paddle_en","api/v1/trainer_config_helpers/activations","api/v1/trainer_config_helpers/attrs","api/v1/trainer_config_helpers/data_sources","api/v1/trainer_config_helpers/evaluators","api/v1/trainer_config_helpers/layers","api/v1/trainer_config_helpers/networks","api/v1/trainer_config_helpers/optimizers","api/v1/trainer_config_helpers/poolings","api/v2/config/activation","api/v2/config/attr","api/v2/config/layer","api/v2/config/networks","api/v2/config/optimizer","api/v2/config/pooling","api/v2/data","api/v2/model_configs","api/v2/run_logic","design/api","design/multi_language_interface/why_plain_c","design/reader/README","getstarted/basic_usage/index_en","getstarted/build_and_install/build_from_source_en","getstarted/build_and_install/docker_install_en","getstarted/build_and_install/index_en","getstarted/build_and_install/ubuntu_install_en","getstarted/index_en","howto/deep_model/rnn/index_en","howto/deep_model/rnn/rnn_config_en","howto/dev/contribute_to_paddle_en","howto/dev/new_layer_en","howto/index_en","howto/optimization/gpu_profiling_en","howto/usage/cluster/cluster_train_en","howto/usage/cmd_parameter/arguments_en","howto/usage/cmd_parameter/detail_introduction_en","howto/usage/cmd_parameter/index_en","howto/usage/cmd_parameter/use_case_en","howto/usage/k8s/k8s_aws_en","howto/usage/k8s/k8s_en","howto/usage/k8s/src/k8s_data/README","howto/usage/k8s/src/k8s_train/README","index_en","tutorials/embedding_model/index_en","tutorials/gan/index_en","tutorials/image_classification/index_en","tutorials/imagenet_model/resnet_model_en","tutorials/index_en","tutorials/quick_start/index_en","tutorials/rec/ml_dataset_en","tutorials/rec/ml_regression_en","tutorials/semantic_role_labeling/index_en","tutorials/sentiment_analysis/index_en","tutorials/text_generation/index_en"],envversion:50,filenames:["about/index_en.rst","api/index_en.rst","api/v1/data_provider/dataprovider_en.rst","api/v1/data_provider/pydataprovider2_en.rst","api/v1/index_en.rst","api/v1/predict/swig_py_paddle_en.rst","api/v1/trainer_config_helpers/activations.rst","api/v1/trainer_config_helpers/attrs.rst","api/v1/trainer_config_helpers/data_sources.rst","api/v1/trainer_config_helpers/evaluators.rst","api/v1/trainer_config_helpers/layers.rst","api/v1/trainer_config_helpers/networks.rst","api/v1/trainer_config_helpers/optimizers.rst","api/v1/trainer_config_helpers/poolings.rst","api/v2/config/activation.rst","api/v2/config/attr.rst","api/v2/config/layer.rst","api/v2/config/networks.rst","api/v2/config/optimizer.rst","api/v2/config/pooling.rst","api/v2/data.rst","api/v2/model_configs.rst","api/v2/run_logic.rst","design/api.md","design/multi_language_interface/why_plain_c.md","design/reader/README.md","getstarted/basic_usage/index_en.rst","getstarted/build_and_install/build_from_source_en.md","getstarted/build_and_install/docker_install_en.rst","getstarted/build_and_install/index_en.rst","getstarted/build_and_install/ubuntu_install_en.rst","getstarted/index_en.rst","howto/deep_model/rnn/index_en.rst","howto/deep_model/rnn/rnn_config_en.rst","howto/dev/contribute_to_paddle_en.md","howto/dev/new_layer_en.rst","howto/index_en.rst","howto/optimization/gpu_profiling_en.rst","howto/usage/cluster/cluster_train_en.md","howto/usage/cmd_parameter/arguments_en.md","howto/usage/cmd_parameter/detail_introduction_en.md","howto/usage/cmd_parameter/index_en.rst","howto/usage/cmd_parameter/use_case_en.md","howto/usage/k8s/k8s_aws_en.md","howto/usage/k8s/k8s_en.md","howto/usage/k8s/src/k8s_data/README.md","howto/usage/k8s/src/k8s_train/README.md","index_en.rst","tutorials/embedding_model/index_en.md","tutorials/gan/index_en.md","tutorials/image_classification/index_en.md","tutorials/imagenet_model/resnet_model_en.md","tutorials/index_en.md","tutorials/quick_start/index_en.md","tutorials/rec/ml_dataset_en.md","tutorials/rec/ml_regression_en.rst","tutorials/semantic_role_labeling/index_en.md","tutorials/sentiment_analysis/index_en.md","tutorials/text_generation/index_en.md"],objects:{"paddle.trainer.PyDataProvider2":{provider:[3,0,1,""]},"paddle.trainer_config_helpers":{attrs:[7,1,0,"-"],data_sources:[8,1,0,"-"]},"paddle.trainer_config_helpers.attrs":{ExtraAttr:[7,2,1,""],ExtraLayerAttribute:[7,3,1,""],ParamAttr:[7,2,1,""],ParameterAttribute:[7,3,1,""]},"paddle.trainer_config_helpers.attrs.ParameterAttribute":{set_default_parameter_name:[7,4,1,""]},"paddle.trainer_config_helpers.data_sources":{define_py_data_sources2:[8,0,1,""]}},objnames:{"0":["py","function","Python function"],"1":["py","module","Python module"],"2":["py","attribute","Python attribute"],"3":["py","class","Python class"],"4":["py","method","Python method"]},objtypes:{"0":"py:function","1":"py:module","2":"py:attribute","3":"py:class","4":"py:method"},terms:{"0000x":53,"00186201e":5,"00m":37,"02595v1":[10,16],"03m":37,"0424m":37,"0473v3":[11,17],"055ee37d":43,"05d":50,"0630u":37,"06u":37,"0810u":37,"08823112e":5,"0957m":37,"0ab":[10,16],"0rc1":28,"0th":58,"10007_10":57,"10014_7":57,"100gb":37,"100gi":43,"10m":37,"1150u":37,"11e6":44,"12194102e":5,"124n":37,"13m":44,"1490u":37,"15501715e":5,"1550u":37,"15mb":53,"1636k":58,"16mb":53,"16u":37,"173m":51,"173n":37,"1770u":37,"18ad":43,"18e457ce3d362ff5f3febf8e7f85ffec852f70f3b629add10aed84f930a68750":44,"197u":37,"1gb":37,"1st":[48,51,57,58],"202mb":58,"210u":37,"211839e770f7b538e2d8":[11,17],"215n":37,"228u":37,"234m":51,"2520u":37,"252kb":53,"25639710e":5,"25k":53,"2680u":37,"27787406e":5,"279n":37,"27m":37,"285m":37,"2863m":37,"28m":37,"28x28":3,"2977m":37,"2cbf7385":43,"2nd":[10,16,57,58],"302n":37,"30u":37,"32777140e":5,"328n":37,"32u":37,"32x32":50,"331n":37,"3320u":37,"36540484e":5,"365e":43,"36u":37,"3710m":37,"3768m":37,"387u":37,"38u":37,"3920u":37,"39u":37,"3rd":[55,57,58],"4035m":37,"4090u":37,"4096mb":40,"4279m":37,"43630644e":5,"43u":37,"448a5b355b84":44,"4560u":37,"4563m":37,"45u":37,"4650u":37,"4726m":37,"473m":44,"48565123e":5,"48684503e":5,"49316648e":5,"4gb":40,"50bd":43,"50gi":43,"51111044e":5,"514u":37,"525n":37,"526u":37,"53018653e":5,"536u":37,"5460u":37,"5470u":37,"54u":37,"55g":58,"5690m":37,"573u":37,"578n":37,"5798m":37,"586u":37,"58s":44,"5969m":37,"6080u":37,"6082v4":[10,16],"6140u":37,"6305m":37,"639u":37,"655u":37,"6780u":37,"6810u":37,"682u":37,"6970u":37,"6ce9":43,"6node":38,"6th":58,"704u":37,"70634608e":5,"7090u":37,"72296313e":5,"72u":37,"73u":37,"75u":37,"760u":37,"767u":37,"783n":37,"784u":37,"78m":37,"7eamaa":20,"7kb":44,"8250u":37,"8300u":37,"830n":37,"849m":37,"85625684e":5,"861u":37,"864k":58,"8661m":37,"892m":37,"901n":37,"90u":37,"918u":37,"9247m":37,"924n":37,"9261m":37,"93137714e":5,"9330m":37,"94u":37,"9530m":37,"96644767e":5,"983m":37,"988u":37,"997u":37,"99982715e":5,"99m":51,"99u":37,"9f18":44,"\u4e0d\u4f7f\u7528\u9759\u6001\u5e93":24,"\u4e0d\u4f7f\u7528c":24,"\u4e0d\u4f7f\u7528swig":24,"\u4e0d\u540c\u7248\u672c\u7684\u7f16\u8bd1\u5668\u4e4b\u95f4":24,"\u4e0d\u540c\u8bed\u8a00\u7684\u63a5\u53e3\u9002\u5e94\u4e0d\u540c\u8bed\u8a00\u7684\u7279\u6027":24,"\u4e0d\u5d4c\u5165\u5176\u4ed6\u8bed\u8a00\u89e3\u91ca\u5668":24,"\u4e0d\u5d4c\u5165python\u89e3\u91ca\u5668":24,"\u4e0d\u663e\u793a\u7684\u5199\u6bcf\u4e2a\u7c7b\u5177\u4f53\u5305\u542b\u4ec0\u4e48":24,"\u4e14\u589e\u52a0\u4e00\u4e2a\u7b2c\u4e09\u65b9\u8bed\u8a00":24,"\u4e14c99\u652f\u6301bool\u7c7b\u578b\u548c\u5b9a\u957f\u6574\u6570":24,"\u4e14c99\u76f8\u5bf9\u4e8ec11\u4f7f\u7528\u66f4\u52a0\u5e7f\u6cdb":24,"\u4e2d":24,"\u4e2d\u5b8c\u5168\u4e00\u81f4":24,"\u4e5f\u4e0d\u4f7f\u7528\u5176\u4ed6\u52a8\u6001\u5e93":24,"\u4e66\u5199":24,"\u4ec5\u4ec5\u4f7f\u7528":24,"\u4ed6\u7684\u76ee\u6807\u662f\u4f7f\u7528c":24,"\u4ee3\u7801\u751f\u6210\u7684\u7b26\u53f7\u53ef\u80fd\u4e0d\u4e00\u81f4":24,"\u4f1a\u5bfc\u81f4\u4e0d\u540c\u7248\u672cpython\u5728\u4e00\u4e2a\u8fdb\u7a0b\u91cc\u7684bug":24,"\u4f1a\u76f4\u63a5\u62a5\u9519\u9000\u51fa":24,"\u4f46\u662f\u89e3\u91ca\u6027\u8bed\u8a00":24,"\u4f5c\u4e3a\u7c7b\u53e5\u67c4":24,"\u4f7f\u7528\u52a8\u6001\u5e93":24,"\u4f7f\u7528\u9759\u6001\u5e93\u548c\u52a8\u6001\u5e93\u96be\u5ea6\u5dee\u4e0d\u591a":24,"\u4f7f\u7528c99\u505a\u63a5\u53e3":24,"\u4f7f\u7528c99\u800c\u4e0d\u4f7f\u7528c11\u7684\u539f\u56e0\u662f":24,"\u4f7f\u7528c99\u800c\u4e0d\u4f7f\u7528c89":24,"\u4f7f\u7528swig\u53ea\u652f\u6301cpython\u89e3\u91ca\u5668":24,"\u4f7f\u7528swig\u9700\u8981\u591a\u8bed\u8a00\u7ed1\u5b9a\u7684\u5f00\u53d1\u4eba\u5458\u719f\u7ec3\u638c\u63e1swig\u914d\u7f6e":24,"\u4f7f\u7528void":24,"\u4f8b\u5982":24,"\u4f8b\u5982\u5bf9\u4e8ejava\u6216\u8005python":24,"\u4f8b\u5982\u5bf9\u4e8ejava\u6765\u8bf4":24,"\u4f8b\u5982\u5bf9\u4e8epython":24,"\u4f8b\u5982c":24,"\u4f8b\u5982java\u4e0epython\u7684\u9519\u8bef\u5904\u7406\u662f\u76f4\u63a5\u6254\u51fa\u6765except":24,"\u4f8b\u5982python\u53ef\u4ee5\u4f7f\u7528":24,"\u4f8b\u5982python\u7684":24,"\u4fbf\u662f\u5c06\u9759\u6001\u5e93\u52a0\u5165jvm\u4e2d":24,"\u505a\u63a5\u53e3":24,"\u5176\u4e2d":24,"\u5185\u90e8\u9a71\u52a8python\u89e3\u91ca\u5668\u8fdb\u884c\u6a21\u578b\u914d\u7f6e\u89e3\u6790\u548c\u6570\u636e\u8bfb\u53d6":24,"\u518d\u5728\u6bcf\u4e00\u4e2aapi\u4e2d\u81ea\u5df1\u68c0\u67e5\u7c7b\u578b":24,"\u5199\u4ee3\u7801":24,"\u51fd\u6570\u547d\u540d":24,"\u52a8\u6001\u5e93":24,"\u5373\u8fd9\u4e2a\u52a8\u6001\u5e93\u662f\u4e0d\u4f9d\u8d56\u4e8e\u5176\u4ed6\u4efb\u4f55\u6587\u4ef6\u7684":24,"\u53c2\u6570":24,"\u53ea\u80fd\u8c03\u7528paddle\u7684\u52a8\u6001\u5e93":24,"\u53ef\u4ee5\u5728\u4efb\u4f55\u673a\u5668\u4e0a\u6267\u884c\u7684":24,"\u540d\u5b57\u4fee\u9970":24,"\u5426\u5219\u5f97\u628apaddle\u9759\u6001\u5e93\u94fe\u63a5\u5230\u89e3\u91ca\u5668\u91cc":24,"\u548c":24,"\u56e0\u4e3aswig\u5728\u7b2c\u4e09\u65b9\u8bed\u8a00\u4e2d\u66b4\u9732\u7684\u51fd\u6570\u540d":24,"\u5728\u8fd9\u4e2a\u52a8\u6001\u5e93\u4e2d\u4e0d\u5d4c\u5165\u4efb\u4f55\u5176\u4ed6\u8bed\u8a00\u7684\u89e3\u91ca\u5668":24,"\u5728c":24,"\u5728c\u7684\u5934\u6587\u4ef6":24,"\u5927\u591a\u6570\u8bed\u8a00\u90fd\u652f\u6301\u4f7f\u7528c\u8bed\u8a00api":24,"\u5982\u679c\u4f7f\u7528swig\u6211\u4eec\u9700\u8981\u5c06\u5728interface\u6587\u4ef6\u91cc":24,"\u5982\u679c\u7528\u6237\u8981\u628apaddle\u7684\u9759\u6001\u5e93":24,"\u5982\u679c\u8c03\u7528\u9759\u6001\u5e93\u53ea\u80fd\u5c06\u9759\u6001\u5e93\u4e0e\u89e3\u91ca\u5668\u94fe\u63a5":24,"\u5b66\u4e60\u6210\u672c\u9ad8":24,"\u5b9e\u73b0\u7b80\u5355":24,"\u5bf9\u4e8e\u4e0d\u540c\u8bed\u8a00":24,"\u5bf9\u4e8e\u540c\u4e00\u6bb5c":24,"\u5bf9\u4e8e\u591a\u8bed\u8a00\u63a5\u53e3":24,"\u5bf9\u4e8e\u5927\u591a\u6570\u8bed\u8a00":24,"\u5bf9\u6bd4":24,"\u5c06\u5927\u91cf\u7684":24,"\u5c31\u9700\u8981\u5bf9\u8fd9\u4e2a\u7b2c\u4e09\u65b9\u8bed\u8a00\u589e\u52a0\u4e00\u4e9b\u5b9a\u4e49":24,"\u5e76\u4e14\u5728\u5e38\u89c1\u7684\u5e73\u53f0\u4e0a":24,"\u5e76\u4e14\u8ba9\u63a5\u53e3\u8131\u79bb\u5b9e\u73b0\u7ec6\u8282":24,"\u5e76\u6ca1\u6709paddle\u7279\u522b\u9700\u8981\u7684\u7279\u6027":24,"\u5f88\u96be\u4fdd\u8bc1\u591a\u8bed\u8a00\u4ee3\u7801\u98ce\u683c\u7684\u4e00\u81f4\u6027":24,"\u5f97\u4f7f\u7528":24,"\u6211\u4eec\u4f7f\u7528\u52a8\u6001\u5e93\u6765\u5206\u53d1paddl":24,"\u6211\u4eec\u6700\u7ec8\u7684\u52a8\u6001\u5e93\u4e2d\u4e0d\u5d4c\u5165python\u6216\u8005\u5176\u4ed6\u4efb\u4f55\u8bed\u8a00\u7684\u89e3\u91ca\u5668":24,"\u6216\u8005":24,"\u624b\u5199\u591a\u8bed\u8a00\u7ed1\u5b9a":24,"\u63a5\u53e3":24,"\u6570\u636e\u8bfb\u53d6\u5747\u4ea4\u7531\u5176\u4ed6\u8bed\u8a00\u5b8c\u6210":24,"\u6587\u4ef6":24,"\u6587\u4ef6\u5185\u5bb9\u4e3a":24,"\u65e0\u6cd5\u505a\u5230\u5bf9\u4e8e\u5404\u79cd\u8bed\u8a00\u9519\u8bef\u5904\u7406\u65b9\u5f0f\u7684\u9002\u914d":24,"\u662f\u4e00\u4e2a\u591a\u8bed\u8a00\u63a5\u53e3\u7684\u4ee3\u7801\u751f\u6210\u5668":24,"\u662f\u4e0d\u5e38\u89c1\u7684\u505a\u6cd5":24,"\u662f\u56e0\u4e3ac99\u652f\u6301":24,"\u6700\u5e38\u89c1\u7684\u9519\u8bef\u5904\u7406\u65b9\u5f0f\u662fexcept":24,"\u6709\u6807\u51c6\u7684":24,"\u6709\u7684\u65f6\u5019":24,"\u6765\u786e\u4fdd\u628a":24,"\u6765\u8868\u793apaddle\u5185\u90e8\u7c7b":24,"\u6a21\u578b\u914d\u7f6e\u89e3\u6790":24,"\u73b0\u9636\u6bb5paddle\u6709\u4e00\u4e2a\u95ee\u9898\u662f":24,"\u751f\u6210\u5404\u79cd\u8bed\u8a00\u7684\u7ed1\u5b9a\u4ee3\u7801":24,"\u751f\u6210\u6587\u6863":24,"\u751f\u6210api\u6587\u6863":24,"\u7531\u4e8ec":24,"\u7684\u547d\u540d\u98ce\u683c\u5e76\u4e0d\u80fd\u9002\u5e94\u5176\u4ed6\u7b2c\u4e09\u65b9\u8bed\u8a00":24,"\u7684\u5934\u6587\u4ef6":24,"\u7684\u63a5\u53e3\u6837\u5f0f":24,"\u7684\u6e90\u7801\u91cc\u4f7f\u7528\u4e86":24,"\u7684\u89c4\u8303":24,"\u76ee\u524d\u5d4c\u5165python\u89e3\u91ca\u5668":24,"\u76ee\u524dpaddle\u7684\u8fdb\u7a0b\u6a21\u578b\u662fc":24,"\u76f4\u63a5\u4f7f\u7528c\u8bed\u8a00\u7684":24,"\u76f4\u63a5\u5bfc\u51fa\u5230c\u7684\u63a5\u53e3\u6bd4\u8f83\u56f0\u96be":24,"\u793e\u533a\u53c2\u4e0e\u56f0\u96be":24,"\u793e\u533a\u8d21\u732e\u4ee3\u7801\u5b66\u4e60\u6210\u672c\u9ad8":24,"\u7c7b\u540d\u548cc":24,"\u7c7b\u578b":24,"\u7ea2\u697c\u68a6":48,"\u7ed3\u8bba":24,"\u7f16\u8bd1\u5668\u6ca1\u6709":24,"\u7f16\u8bd1\u578b\u8bed\u8a00":24,"\u800c\u4e0d\u652f\u6301pypy\u89e3\u91ca\u5668":24,"\u800c\u5728cpp\u91cc\u9762\u5b9e\u73b0\u8fd9\u4e2ac\u7684\u63a5\u53e3":24,"\u800c\u591a\u8bed\u8a00\u63a5\u53e3\u9700\u8981\u76f4\u63a5\u8bfb\u53d6\u751f\u6210\u7684\u4e8c\u8fdb\u5236":24,"\u800c\u5bf9\u4e8egolang":24,"\u800c\u5bf9\u4e8egolang\u9519\u8bef\u5904\u7406\u5e94\u8be5\u4f7f\u7528\u8fd4\u56de\u503c":24,"\u800cswig\u53ea\u80fd\u7b80\u5355\u7684\u66b4\u9732c":24,"\u826f\u597d\u7684\u6587\u6863":24,"\u89e3\u91ca\u578b\u8bed\u8a00\u53ea\u80fd\u8c03\u7528\u52a8\u6001\u5e93":24,"\u89e3\u91ca\u6027\u8bed\u8a00\u5b9e\u9645\u8fd0\u884c\u7684\u4e8c\u8fdb\u5236\u662f\u89e3\u91ca\u5668\u672c\u8eab":24,"\u8fd9\u4e2a\u63a5\u53e3\u9700\u8981\u505a\u5230":24,"\u8fd9\u4e2a\u6587\u4ef6\u5177\u6709\u72ec\u7279\u7684\u8bed\u6cd5":24,"\u8fd9\u5bf9\u4e8e\u901a\u5e38\u7684java\u7684\u5f00\u53d1\u8005\u6765\u8bf4":24,"\u8fd9\u662f\u56e0\u4e3a":24,"\u8fd9\u90fd\u9700\u8981\u8fd9\u4e2a\u63a5\u53e3\u6309\u7167\u7ea6\u5b9a\u4fd7\u6210\u7684\u89c4\u5219\u6765\u6ce8\u91ca\u5b8c\u5907":24,"\u90fd\u662fabi\u8c03\u7528\u6807\u51c6\u7684":24,"\u91cc\u6240\u6709\u7684\u7b26\u53f7\u90fd\u5199\u5165\u81ea\u5df1\u7684\u7a0b\u5e8f\u7684\u4e8c\u8fdb\u5236\u6587\u4ef6\u91cc":24,"\u91cd\u547d\u540d\u6210":24,"\u94fe\u63a5\u5230\u81ea\u5df1\u7684\u7a0b\u5e8f\u91cc":24,"\u9519\u8bef\u5904\u7406":24,"\u9519\u8bef\u5904\u7406\u65b9\u5f0f\u662f\u8fd4\u56de\u503c":24,"\u9519\u8bef\u5904\u7406\u7684\u65b9\u5f0f\u4e5f\u4e0d\u5c3d\u76f8\u540c":24,"\u9700\u8981\u6709\u7a33\u5b9a\u7684\u5bfc\u51fa\u7b26\u53f7":24,"\ufb01xed":58,"abstract":[35,40],"api\u4e2d\u4f7f\u7528":24,"boolean":24,"break":53,"c99\u662f\u76ee\u524dc\u6700\u5e7f\u6cdb\u7684\u4f7f\u7528\u6807\u51c6":24,"c\u6709\u6807\u51c6\u7684abi":24,"c\u8bed\u8a00\u662f\u6709\u5bfc\u51fa\u7b26\u53f7\u7684\u6807\u51c6\u7684":24,"case":[10,16,25,26,33,34,35,37,41,43,49,53],"char":55,"class":[5,7,10,12,14,15,16,17,19,20,23,24,39,50,57],"const":35,"default":[3,7,9,10,11,12,15,16,17,19,20,22,23,28,38,40,42,43,44,53,55,57,58],"export":[27,28,50],"final":[11,17,26,27,35,55,57],"float":[3,7,9,10,12,15,16,20,26,35,37,42,48,51,55],"function":[3,5,8,10,11,12,16,17,20,23,25,26,33,35,37,38,40,49,50,53,56,57,58],"golang\u53ef\u4ee5\u4f7f\u7528":24,"golang\u7684":24,"h\u5e76\u4e0d\u56f0\u96be":24,"import":[3,5,9,10,16,23,26,28,33,37,43,48,49,50,51,53,55,57,58],"int":[3,7,9,10,11,12,15,16,17,20,24,25,35,42,53,55,56],"interface\u6587\u4ef6\u7684\u5199\u6cd5\u975e\u5e38":24,"long":[2,10,11,16,17,20,28,37,56,57],"new":[3,10,16,20,25,34,36,43,44,49,53,56,57],"null":[10,35,40,55],"paddle\u4e00\u4e2a\u52a8\u6001\u5e93\u53ef\u4ee5\u5728\u4efb\u4f55linux\u7cfb\u7edf\u4e0a\u8fd0\u884c":24,"paddle\u5185\u5d4c\u7684python\u89e3\u91ca\u5668\u548c\u5916\u90e8\u4f7f\u7528\u7684python\u5982\u679c\u7248\u672c\u4e0d\u540c":24,"paddle\u5185\u90e8\u7684\u7c7b\u4e3ac":24,"paddle\u7684\u591a\u8bed\u8a00\u63a5\u53e3\u5b9e\u73b0\u5305\u62ec\u4e00\u4e0b\u51e0\u4e2a\u65b9\u9762":24,"paddle\u7684\u94fe\u63a5\u65b9\u5f0f\u6bd4\u8f83\u590d\u6742":24,"paddle\u9700\u8981\u4e00\u4e2a\u591a\u8bed\u8a00\u63a5\u53e3":24,"paddle\u9759\u6001\u5e93\u94fe\u63a5\u590d\u6742":24,"public":[35,38,43,44,57],"return":[3,8,9,10,11,16,17,19,20,22,23,26,33,35,43,49,51,53,54,55,58],"short":[10,11,16,17,26,55,56,57],"static":[10,43],"super":35,"swig\u652f\u6301\u7684\u8bed\u8a00\u6216\u8005\u89e3\u91ca\u5668\u6709\u5c40\u9650":24,"swig\u66b4\u9732\u7684\u63a5\u53e3\u4fdd\u7559\u4e86c":24,"swig\u751f\u6210\u7684\u4ee3\u7801\u4e0d\u80fd\u4fdd\u8bc1\u591a\u8bed\u8a00\u4ee3\u7801\u98ce\u683c\u7684\u4e00\u81f4\u6027":24,"swig\u76f4\u63a5\u8bfb\u53d6c":24,"swig\u9700\u8981\u5199\u4e00\u4e2ainterface\u6587\u4ef6":24,"switch":[43,57],"throw":43,"true":[3,7,9,10,11,12,15,16,17,19,20,23,25,26,33,35,40,42,43,51,55,56,57,58],"try":[12,25,37,49,55],"void":[24,35],"while":[2,3,7,9,15,20,25,33,40,49,53,57,58],AGE:[43,44],AND:55,ARE:55,AWS:[36,45,46],Abs:6,Age:54,And:[3,9,10,12,16,25,28,30,34,42,43,44,48,51,55,57,58],But:[3,10,11,16,17],EOS:[10,16],For:[2,3,8,9,10,12,16,20,23,25,26,27,28,33,35,37,38,39,40,42,48,50,51,53,57,58],Going:57,Has:3,IDs:53,Ids:53,Into:43,Its:[3,33,43,55],Not:[23,38],ONE:3,One:[9,10,11,17,33,35,40,49,53,57,58],QoS:44,THE:3,TLS:[23,43],That:[10,16,20,25,28,40,42],The:[2,3,5,7,8,9,10,11,12,14,15,16,17,20,22,23,25,26,27,28,29,30,33,34,35,37,38,40,42,43,44,48,49,50,51,53,54,55,56,57,58],Their:[3,10,16],Then:[5,10,27,28,33,34,35,37,43,44,48,50,55,56,57],There:[9,10,16,22,23,26,30,37,43,49,50,51,52,53,55,58],These:[38,42,50,56],USE:55,USING:55,Use:[3,23,25,35,37,40,41,43,55],Used:[11,17],Useful:3,Using:[44,57],VPS:43,WITH:34,Will:20,With:[3,10,11,16,17,26,49,56],Yes:28,___fc_layer_0__:43,__init__:35,__list_to_map__:55,__main__:51,__meta__:55,__name__:51,__rnn_step__:33,_error:49,_link:[11,17],_proj:[10,16],_res2_1_branch1_bn:51,_source_language_embed:[33,48],_target_language_embed:[33,48],aaaaaaaaaaaaa:43,abc:[10,16],abl:[10,16,23,49,57],about:[5,10,11,16,17,26,28,37,39,40,43,47,56,57,58],abov:[3,5,10,16,23,26,28,37,43,44,49,51,53,56],abs:[11,17,49],absolut:[2,38],academ:54,acceler:42,accept:[3,5,20,23,25,53,56],acceptor:56,access:[2,10,11,17,23,33,58],accessmod:43,accident:54,accord:[2,3,9,10,16,33,34,38,39,40,42],accordingli:[5,35],accordingto:56,accrod:[11,17],accuraci:[9,35,53,54,57],achiev:[37,50],ack:40,acl:57,aclimdb:57,aclimdb_v1:20,across:[10,16],act:[10,11,16,17,26,33,53],act_typ:53,action:[43,54],activ:[0,4,5,10,11,16,17,21,26,27,35,40,53,57],activi:[11,17],actual:[3,10,16,26,28],adadelta:[12,53],adagrad:[12,53],adam:[12,23,53,57,58],adamax:[12,53],adamoptim:[48,53,57,58],adapt:[9,12,26,57,58],add:[3,10,11,16,17,20,26,27,34,35,37,42,53,55],add_input:35,add_test:35,add_to:[10,16],add_unittest_without_exec:35,addbia:35,added:[3,9,35],adding:51,addit:[10,11,16,17,28,53],address:[28,37,40],addrow:35,addtion:38,addto:10,addtolay:[10,16],adject:57,adjust:26,admin:54,adopt:56,advanc:[33,37,40],advantag:[28,57],adventur:54,adverb:57,adversari:25,advic:37,affect:[10,16],afi:3,aforement:38,after:[10,16,27,30,33,35,38,40,42,43,44,49,50,51,53,55,56,57,58],again:[23,37],against:43,age:55,agg_level:[10,16],aggreg:43,aggregatelevel:[10,16],aid:37,aim:[57,58],aircraft:58,airplan:50,aistat:[10,16],alex:[10,16,57],alexnet_pass1:42,alexnet_pass2:42,algorithm:[10,12,16,26,33,48,50,57,58],alia:[6,7,13,14,15],align:[10,11,16,17,20,58],all:[0,3,7,9,10,12,15,16,22,23,26,28,33,34,35,37,38,39,40,42,43,44,48,49,51,53,54,55,56,57,58],alloc:[7,15,35,42],allow:[23,28,34,35,37,40,43,53],allow_only_one_model_on_one_gpu:[39,40,42],almost:[11,17,26,38,48],along:57,alreadi:[28,37,38,40,43,44,57],alreali:[39,58],also:[2,3,9,10,11,16,17,23,25,27,28,33,35,37,38,44,49,50,51,53,56,57],although:26,alwai:[5,10,11,16,17,25,26,40,43,58],amaz:50,amazon:[43,44,53,57],amazonaw:43,amazonec2fullaccess:43,amazonelasticfilesystemfullaccess:43,amazonroute53domainsfullaccess:43,amazonroute53fullaccess:43,amazons3fullaccess:43,amazonvpcfullaccess:43,ambigu:[25,56],amd64:43,amend:34,american:50,among:[43,57],amount:[37,57],analysi:[26,37,52,56],analyz:[53,57],andd:43,ani:[2,3,10,11,16,17,20,23,25,33,34,37,43,53,55,58],anim:54,annot:56,annual:56,anoth:[3,10,16,23,28,40,43,56,57],ans:43,answer:[26,43,56],anyth:[20,25,34,43,56],api:[16,20,23,27,35,37,43,47,49,53,55,57],apiserv:43,apivers:[43,44],apo:58,appar:58,appear:56,append:[3,25,33,35,38,55],appleclang:27,appleyard:37,appli:[0,10,11,16,17,33,35,50,53],applic:[28,37,43,44,57],appreci:[34,57],approach:[10,16],apt:[27,30,50],arbitrari:10,architectur:[48,56,57,58],architecur:57,archiv:24,arg:[3,8,9,10,11,12,16,17,20,26,28,39,49,50,51,53,55,56,57],arg_nam:[10,16],argu:56,argument:[3,5,8,10,16,20,33,35,40,41,48,49,50,51,55,56,57,58],argv:51,arn:43,around:[3,10,16,43],arrai:[5,10,16,20,22,25,26,51],art:[26,56],articl:[38,44],artifact:43,artifici:49,artist:54,arxiv:[10,11,16,17,49,57],aspect:57,assign:[10,40,43],associ:[56,57,58],assum:[10,16,33,42,48],assur:2,astyp:[25,49],async:[12,39],async_count:40,async_lagged_grad_discard_ratio:40,async_lagged_ratio_default:[39,40],async_lagged_ratio_min:[39,40],asynchron:40,atla:27,atlas_root:27,attenion:[11,17],attent:[10,11,17,58],attitud:57,attr:[7,11,15,16,17],attribut:[3,4,10,11,16,17,21,35,48,56],auc:[9,39],aucvalidationlay:40,authent:43,author:[43,51],authorized_kei:38,autmot:34,auto:[24,35,37,52,55],autom:[43,58],automak:27,automat:[10,16,23,27,28,33,35,38,39,40,43,55,56,58],automaticli:[10,16],automobil:50,avail:[27,43],availabel:27,averag:[9,10,12,16,19,40,51,53,55,56,57,58],average_test_period:[39,40,56],average_window:57,averagepool:[10,16],avg:[13,37,53],avgcost:[9,53,55,57,58],avgpool:[10,16,53],avoid:37,avx:[27,30],await:44,awar:[23,28,43],aws_account_id:43,awsaccountid:43,awskeymanagementservicepowerus:43,b2t:48,b363:44,b8561f5c79193550d64fa47418a9e67ebdd71546186e840f88de5026b8097465:44,ba5f:43,back:[3,28],background:31,backward:[10,11,14,16,17,33,35,40,42],backward_first:33,backwardactiv:35,bag:[53,57],baidu:[0,10,16,26,30,34,44,48],baik:48,balanc:[40,43,49],balasubramanyan:57,bank:56,bardward:[11,17],bare:44,barrier:40,barrierstatset:37,base:[6,12,16,17,19,20,23,26,30,33,34,35,37,38,40,43,48,49,53,55,57,58],baseactiv:[10,11],basematrix:35,basenam:9,basepool:13,basepoolingtyp:[10,11,16,17],baseregular:12,basestr:[7,8,9,10,11,15,16,17,19,55],bash:[28,43,44],bashrc:27,basic:[3,10,34,35,53,54,57],batch:[3,9,10,11,12,16,17,20,22,23,35,38,40,43,44,49,50,51,53,55,56,57,58],batch_0:51,batch_norm:[10,17],batch_norm_lay:11,batch_norm_typ:[10,16],batch_read:25,batch_siz:[3,12,20,22,26,38,48,49,50,53,55,57,58],batchsiz:[10,16,35],bcd:[10,16],beam:[10,33,40,56,58],beam_gen:[10,33],beam_search:33,beam_siz:[10,33,39,40,42],beamsiz:58,becaus:[5,10,16,23,25,33,34,35,42,43,50,53,56],becom:[34,37],been:[3,27,34,50,53,56,57,58],befor:[5,10,11,16,17,25,28,34,38,43,50,55,57,58],begin:[5,9,10,35],beginiter:[22,23],beginn:33,beginpass:[22,23],begintrain:23,behavior:37,being:[25,49],belong:[10,16,58],below:[3,10,16,25,33,35,37,38,43,49,50,53,55],benefit:[11,17],bengio:[10,16],bertolami:57,besid:[2,10,16,58],best:[8,10,16,27,28,40,53,55,57,58],best_model_path:56,besteffort:44,beta1:12,beta2:12,beta:51,better:[10,11,16,17,26,38,43,49,55],between:[10,12,16,26,34,43,49,53,54,57,58],bgr:51,bi_lstm:[11,17],bia:[10,11,12,16,17,33,35,51],bias:[10,16,35],bias_attr:[10,11,16,17,26,33],bias_param_attr:[11,17],biases_:35,biasparameter_:35,biassiz:35,bidi:44,bidirect:[11,17,33,56,58],bidirectional_lstm_net:57,big:37,biggest:57,bilinear:[10,16],bilinear_interpol:[10,16],bilinearfwdbwd:37,bin:[27,28,38,43,44,55],binari:[3,9,10,16,20,37,43,48,53,57],bird:50,bison:27,bit:53,bitext:58,bla:27,blank:[10,16,43],block:[10,16,26,35,37,40,51,57],block_expand:10,block_i:[10,16],block_x:[10,16],blog:57,bn_attr:17,bn_bias_attr:[11,17],bn_layer_attr:11,bn_param_attr:[11,17],bollen:57,bool:[3,7,9,10,11,12,15,16,17,19,20,35,40,42,53,55,57],boot:[10,33],boot_bia:10,boot_bias_active_typ:10,boot_lay:[10,33],boot_with_const_id:10,bootstrap:27,bos_id:[10,33],both:[0,7,10,11,14,15,16,17,23,28,33,35,37,43,49,51,53],bottleneck:[37,51],bottom:57,bow:[53,57],box:37,branch:[10,16,23,34],breadth:[40,58],brelu:6,brendan:57,brew:27,briefli:37,brows:28,browser:[28,43],bryan:57,bucket_nam:43,buf_siz:20,buffer:[3,20,25,40],buffered_read:25,bug:43,bui:57,build:[0,26,28,31,40,43,45,46,48,50,51,53,55,57,58],build_and_instal:28,built:[0,27,49,56],bunch:[37,53],bunk:57,button:[34,43],c11:24,c99e:43,cach:[53,55,56],cache_pass_in_mem:[3,53,55,56],cachetyp:[3,53,55,56],calc_batch_s:[3,56],calcul:[3,9,10,11,12,16,17,33,35,37,40,42,49,55],call:[3,10,11,16,17,23,26,33,35,37,40,43,50,51,53,57,58],callabl:[3,10,20],callback:35,caller:43,caltech:50,can:[2,3,5,7,8,9,10,11,15,16,17,20,23,25,26,27,28,30,33,34,35,37,38,39,40,42,43,44,48,49,50,51,53,55,56,57,58],can_over_batch_s:[3,56],candid:[10,16],cannot:35,caoi:58,capabl:[27,57],capac:43,caption:[26,58],captur:[26,38],card:38,care:[11,17,25,39,40,54],carefulli:[38,40,51],cat:[28,50,51,57],categor:56,categori:[10,16,53,57],categoryfil:44,caution:[43,44],ccb2_pc30:58,cde:[10,16],ceil:[10,16],ceil_mod:[10,16],cell:[10,11,16,17,57],center:3,ceph:44,certain:[2,39,56],certif:[23,43],cffi:24,cfg:44,cgo:24,chain:[20,35],chanc:[23,35,53],chang:[10,25,26,28,33,34,35,37,40,43,53,57],channel:[10,16,37,38,51],channl:[38,51],char_bas:55,charact:[53,55],character:26,characterist:[42,50],check:[3,20,26,27,28,34,40,42,43,54],check_align:20,check_eq:35,check_fail_continu:3,check_l:35,check_sparse_distribution_batch:[39,40],check_sparse_distribution_in_pserv:[39,40],check_sparse_distribution_ratio:[39,40],check_sparse_distribution_unbalance_degre:[39,40],checkgrad:40,checkgrad_ep:40,checkout:34,children:54,chines:52,chmod:[27,43],choic:[28,54],choos:[40,53,55],chosen:[2,54,58],chunk:[9,49,56],chunk_schem:9,chunktyp:9,cifar:[49,50],cifar_vgg_model:50,claim:43,claimnam:43,clang:[24,27,34],class1:57,class2:57,class_dim:57,classfic:[51,57],classfiic:50,classic:[10,16,26],classif:[3,5,10,16,42,51,52,53,57,58],classifc:57,classifi:[9,49,50,51,53,57],classification_cost:[50,53],classification_error_evalu:[49,53,57,58],classification_threshold:9,claster:43,clean:[5,55],cleric:54,cli:43,click:[34,37,43],client:34,clip:[7,12,15,40,53,57],clock:[10,16],clone:[27,28],close:[3,25],closer:26,cls:53,cludform:43,cluster:[23,39,40,44,53,58],cluster_train:38,cm469:43,cmake3:27,cmake:[27,35,37],cmakelist:35,cmd:44,cna:[10,16],cname:43,cnn:[44,51,53],code:[0,3,5,16,20,23,25,26,27,28,29,33,35,36,37,38,43,44,49,53,54],coeff:[10,16],coeffici:[10,16],collect:[10,16,22,26,54],collectbia:35,colleg:54,color:[50,51],column:[9,10,16,25,35,48,58],colunm:58,com:[10,11,16,17,20,27,28,30,34,43,44,51],combin:[10,11,16,17,20,49,55,57],come:57,comedi:54,comma:[40,48],command:[2,5,26,27,28,30,34,35,36,37,38,43,44,45,46,48,49,50,51,55,56,57],commandlin:[37,57],commenc:53,comment:[11,17,20,34,53,57],commnun:38,common:[33,35,39],common_util:[38,55],commonli:[33,37,42],commun:[0,35,38,43],compani:57,compar:[35,49,53],compat:3,compet:57,competit:49,compil:[27,34,35],complet:[0,5,10,11,16,17,20,22,35,43,44,53],complex:[2,3,11,17,25,33,37,53],complic:[10,16],compon:35,compos:[20,23,49,56],composenotalign:20,comput:[10,11,16,17,23,26,27,28,33,35,37,42,43,53,55,56,57],computation:33,conat:16,conat_lay:10,concat:[10,58],concat_lay:33,concaten:[11,17],concept:[3,23,33],concern:23,concurrentremoteparameterupdat:40,condit:[10,16,33,38,44,58],conduct:37,conf:[5,10,16,38,48,49,51,58],conf_paddle_gradient_num:43,conf_paddle_n:43,conf_paddle_port:43,conf_paddle_ports_num:43,conf_paddle_ports_num_spars:43,confid:57,config:[3,7,10,11,15,16,17,26,35,38,39,40,43,44,48,49,50,51,53,57,58],config_:40,config_arg:[39,40,42,51,53,56,57],config_bas:[16,17,22],config_fil:56,config_gener:[38,55],config_lay:35,config_pars:[5,35],configur:[1,2,3,5,8,10,16,26,28,32,34,35,37,40,48,50,51,57,58],conflict:34,confront:58,congest:40,conll05st:56,conll:56,connect:[2,11,17,26,28,35,43,44,49,50,51,53,55,57],connectionist:[10,16,57],connor:57,consequ:[10,11,16,17],consid:[9,10,12,16,27,37,42,50],consider:[3,11,17],consist:[10,16,25,28,50,51,53,56,58],consol:[37,43],constant:35,construct:[3,5,23,33,55],construct_featur:55,constructor:35,consum:57,contain:[3,8,9,10,11,16,17,19,20,23,29,30,33,34,38,43,50,51,53,54,57,58],containerport:43,contemporan:57,content:[44,56,57],context:[10,11,16,17,33,48,53,55,56,57,58],context_attr:[11,17],context_len:[10,11,16,17,53,55],context_proj_layer_nam:11,context_proj_nam:17,context_proj_param_attr:[11,17],context_project:[11,17,55],context_start:[10,11,16,17,53],contibut:34,contin:43,continu:[3,30,40],contrast:[10,16,58],contribut:[0,29,36,57],contributor:0,control:[7,15,40,43,44,58],conv:[11,17],conv_act:[11,17],conv_attr:17,conv_batchnorm_drop_r:[11,17],conv_bias_attr:[11,17],conv_filter_s:[11,17],conv_layer_attr:11,conv_num_filt:[11,17],conv_op:[10,16],conv_pad:[11,17],conv_param_attr:[11,17],conv_shift:10,conv_strid:[11,17],conv_with_batchnorm:[11,17],conveni:[23,38],converg:[38,49,57],convert:[3,5,20,25,33,48,50,51,53,55],convlay:[10,16],convolut:[10,11,16,17,49,51,55],convoper:[10,16],convtranslay:[10,16],cool:[3,34],copi:[23,43,49,55],copy_shared_paramet:49,copytonumpymat:49,core:[3,7,15,40,58],coreo:43,corespond:56,corpora:58,corpu:56,correct:[3,9,10,16,35,43],correctli:[9,20,35,49],correl:[26,50,57],correspoind:23,correspond:[3,5,23,26,33,35,50,54,56,57,58],corss_entropi:23,cos:[10,16],cos_sim:55,cosin:[10,16,55],cost:[5,12,23,26,40,49,53,55,57,58],cost_id:10,could:[3,5,9,10,16,20,22,23,25,37,38,43,53,55],count:[25,37,40,42,44,48,55,56,57,58],coupl:26,coverag:27,coveral:27,coveralls_uploadpackag:27,cpickl:[51,55],cpp:[24,34,35,37,53,55,58],cpu:[2,3,7,10,15,16,27,30,37,40,44,49,56,57,58],cpuinfo:28,craftsman:54,crash:[37,38,40],crazi:38,creat:[5,7,10,15,16,20,23,26,27,28,35,38,40,48,49,50,58],create_bias_paramet:35,create_input_paramet:35,createargu:49,createfromconfigproto:[5,49],createstack:43,creation:43,creationd:43,creator:20,credit:49,cretor:20,crf:[10,56],crf_decod:10,crime:54,critic:57,crop:51,crop_siz:51,cross:[10,16,53,56],cross_entropi:[16,23,49],cross_entropy_with_selfnorm:16,csc:35,cslm:58,csr:35,csv:54,ctc:10,ctc_layer:9,ctest:28,ctrl:[38,55],ctx:56,ctx_0:56,ctx_0_slot:56,ctx_n1:56,ctx_n1_slot:56,ctx_n2:56,ctx_n2_slot:56,ctx_p1:56,ctx_p1_slot:56,ctx_p2:56,ctx_p2_slot:56,cub:50,cuda:[27,28,30,37,38,40],cuda_dir:[39,40],cuda_so:28,cudaconfigurecal:37,cudadevicegetattribut:37,cudaeventcr:37,cudaeventcreatewithflag:37,cudafre:37,cudagetdevic:37,cudagetdevicecount:37,cudagetdeviceproperti:37,cudagetlasterror:37,cudahostalloc:37,cudalaunch:37,cudamalloc:37,cudamemcpi:37,cudaprofilerstart:37,cudaprofilerstop:37,cudaruntimegetvers:37,cudasetdevic:37,cudasetupargu:37,cudastreamcr:37,cudastreamcreatewithflag:37,cudastreamsynchron:37,cudeviceget:37,cudevicegetattribut:37,cudevicegetcount:37,cudevicegetnam:37,cudevicetotalmem:37,cudnn:[10,16,19,27,30,40],cudnn_batch_norm:[10,16],cudnn_conv:[10,16],cudnn_conv_workspace_limit_in_mb:[39,40],cudnn_dir:[39,40],cudrivergetvers:37,cuinit:37,cumul:[10,16],curl:[27,43],current:[3,10,12,16,26,28,33,34,35,38,40,43,53,57,58],current_word:33,currentcost:[9,53,55,57,58],currentev:[9,53,55,57,58],curv:[23,50,56],custom:[2,3,23,35,43,54,57],custom_batch_read:25,cyclic:[10,16],cython:24,d3e0:43,daemon:28,dai:58,daili:57,dalla:3,dan:56,danger:3,darwin:43,dat:[20,38,55],data:[2,3,5,8,11,12,17,22,23,27,31,35,37,38,39,40,42,45,51,54],data_batch_gen:49,data_dir:[48,50,57,58],data_feed:20,data_fil:26,data_initialz:53,data_lay:[3,9,26,33,49,50,53,55,56],data_nam:20,data_provid:8,data_read:[20,25],data_reader_creator_random_imag:25,data_sourc:[8,49],data_typ:[16,20],databas:57,datadim:[10,16],datalay:[10,16],dataprovid:[2,8,26,33,38,55,56],dataprovider_bow:53,dataprovider_emb:53,dataproviderconvert:5,datasci:[10,16],dataset:[1,3,25,26,40,48,50,51,53,56,57],datasourc:[4,55],date:56,db_lstm:56,dcgan:49,dcmake_install_prefix:27,deal:[34,49],deb:[29,30],debian:29,debug:3,decai:[12,50],decid:[23,25],declar:[10,11,16,55],decod:[10,11,16,17,33,56,58],decoder_boot:33,decoder_group_nam:33,decoder_input:33,decoder_mem:33,decoder_prev:[11,17],decoder_s:33,decoder_st:[11,17,33],deconv:[10,16],deconvolut:[10,16],decor:[3,20,35],decreas:26,decrypt:43,deep:[0,10,16,26,28,37,49,50,51,53,56],deeper:[26,28,51],deer:50,def:[3,10,16,20,23,25,26,33,35,49,51,53,55,56],defalut:[10,16,40,42],default_devic:42,default_valu:42,defferenct:3,defin:[2,3,8,9,10,11,16,17,20,23,25,26,33,35,38,40,48,49,50,55,56],define_py_data_sources2:[3,8,26,50,51,53,55],defini:58,definit:[3,20,26,28,48,53,57],degre:[10,16],del:55,delai:40,delar:53,deletestack:43,delimit:[9,54,55],demo:[10,33,38,44,45,48,49,50,51,52,53,54,55,56,57,58],demograph:54,demolish:44,demonstr:[26,33,49,55],denot:[42,53,54,56],dens:[3,10,16,20,35,43,53,55],dense_vector:[3,5,16,20,26,55],dense_vector_sequ:20,depend:[26,30,38,42,50,54],deploi:[38,42],deploy:[38,43],deriv:[14,23],descent:[10,12,16],describ:[23,26,35,43,44,49,53,56],describestack:43,describestackev:43,describestackresourc:43,descript:[5,27,33,41,43,50,55],design:[3,10,16,20,24,57],desir:[43,44,48],destructor:35,detail:[3,5,7,10,11,12,15,16,17,33,34,35,37,38,41,42,43,44,48,49,51,53,55,57,58],detect:9,determin:[3,10,16,20,35,49],dev:[27,28,50,55,58],devel:27,develop:[0,27,34,39,40,58],deverlop:40,deviat:[7,15],devic:[7,15,28,40,58],deviceid:42,devid:[10,16,40],dez:57,dfs:11,diagnos:38,diagram:51,dict:[3,8,53,55,57,58],dict_dim:57,dict_fil:[9,33,53,56],dict_nam:8,dictionai:53,dictionari:[3,8,9,10,20,22,23,33,42,51,53,55,56,57,58],dictsiz:58,did:3,differ:[3,8,9,10,16,26,28,33,34,35,38,40,43,44,48,50,51,53,57,58],difficult:26,dig:[28,37,43],digit:[3,10,16],dim:[20,35,48,51,53,57],dimens:[10,14,16,19,20,35,42,48,53,55,57],dimension:[3,26,33,35,49,53],dimenst:48,dimes:[10,16],din:55,dir:[38,51,53,55,56,57,58],direct:[10,11,16,17,28,51,56],directli:[2,3,11,17,26,38,44,57],directori:[2,27,34,37,38,40,44,50,51,53,55,56,57,58],diretcoti:51,dis_conf:49,dis_train:49,dis_training_machin:49,disabl:3,discard:[20,40],discount:[10,16],discov:56,discoveri:43,discrep:37,discrimin:49,discriminator_train:49,discuss:23,disk:44,dispatch:[38,40],disput:58,dist_train:23,distanc:9,distibut:48,distinguish:[38,49,58],distribut:[10,16,27,36,44,45,46,49,53,56],distribute_test:[39,40],distributedli:35,disucss:23,divid:[12,39,50,58],diy_beam_search_prob_so:[39,40],dmkl_root:27,dns:43,do_forward_backward:25,doc:[5,11,17,20,27,28,38],docker:[29,43,45,46],docker_build:23,docker_push:23,dockerfil:28,dockerhub:28,doctor:54,document:[3,5,11,17,27,34,42,50,53,55,56,57],documentari:[3,54],doe:[3,5,11,17,25,26,30,33,35,37,53,55,56],doesn:[7,10,15,20,23,25,28,34,37,44,58],dog:[50,51],doing:37,domain:43,don:[11,17,23,25,26,28,43,57],done:[10,11,16,17,33,37,43,49,57],dopenblas_root:27,dot:[40,51,58],dot_period:[40,42,49,50,55,57,58],dotmuloper:[10,16],dotmulproject:[10,16],doubl:[3,27,40],down:[37,53],download:[20,30,49,50,53,56,57],download_cifar:50,downsampl:50,doxygen:[27,34],dpkg:30,drama:54,driver:28,drop:3,drop_rat:[7,15],dropout:[7,10,15,16,35,53],dropout_lay:10,dropout_r:[11,17],drwxr:44,dtoh:37,dtype:[5,26,51],dubai:58,due:[54,55],duplic:54,durat:37,dure:[2,3,10,16,26,34,35,39,40,43,53,55,56,58],durn:3,dwith_doc:27,dwith_profil:37,dwith_tim:37,dynam:[2,3,25,27,37,40],dynamic_cast:35,each:[2,3,5,9,10,16,19,20,22,25,26,28,33,34,35,38,40,42,43,48,50,51,53,54,55,56,57,58],each_feature_vector:14,each_meta:55,each_pixel_str:3,each_sequ:[10,16],each_time_step_output:14,each_timestep:[10,16],each_word:3,eaqual:[10,16],eas:[20,25,51],easi:[0,25,28,35,38,53],easier:[23,25,35],easili:[23,25,26],echo:[28,55,57],edit:[9,43],editor:34,edu:[20,43,44,50],educ:54,eeoi3ezpr86c:43,effect:[3,40,43],effici:[0,2,3,33,35],efg:[10,16],efs:43,efs_dns_nam:43,efsvol:43,eight:56,either:[10,16,20,22,23,37,53,55],elb:43,elbapis:43,elec:53,electron:[44,53],elem_dim:[10,16],element:[3,5,9,10,11,16,17,20,22,25,53,57,58],elif:[23,55],elimin:56,els:[10,23,28,35,51,53,55],emac:34,emb:[44,53],embed:[10,23,33,52,55,57],embedd:56,embedding_lay:[33,53,55],embedding_nam:33,embedding_s:33,emphas:37,empir:[10,16],emplace_back:35,emploi:[33,54],empti:[9,20,26],emul:58,enabl:[3,7,15,37,38,40,43],enable_grad_shar:[39,40],enable_parallel_vector:40,enc_proj:[11,17,33],enc_seq:[11,17],enc_vec:33,encod:[11,17,33,58],encoded_proj:[11,17,33],encoded_sequ:[11,17,33],encoded_vector:33,encoder_last:10,encoder_proj:33,encoder_s:33,encrypt:43,encrypt_decrypt:43,end:[3,9,10,16,25,26,33,40,48,56,57,58],end_pass:23,enditer:[22,23],endpass:[22,23],endpoint:43,endtrain:23,engin:[0,37,54],english:[3,10,16,58],enjoi:28,enough:26,ensembl:[11,17],ensur:[3,35],enter:54,entir:[10,11,16,17,57],entri:[20,28,35,43,54],entropi:[10,16,53,56],enumer:[10,14,53,55],env:[34,43],environ:[23,27,28,30,37,38,39,40,43,44,49,50,55],eol:34,eos:10,eos_id:[10,16,33],epel:27,epoch:54,epsilon:12,equal:[10,11,12,16,17,40],equat:[10,11,12,16,17,28],equilibrium:49,equip:[27,33],equival:[10,16,23],error:[7,9,10,12,15,16,23,26,30,35,38,40,43,50,51,53,54,55,57,58],error_clipping_threshold:[7,15],errorr:9,especi:[3,11,17,56],essenc:23,essenti:[10,23,27,56,58],estat:26,estim:[10,16,23],eta:44,etc:[12,20,25,38,39,42,43,57,58],eth0:[38,43],ethternet:38,eval:[9,53,55,57,58],eval_bleu:58,evalu:[2,4,10,16,31,37,38,53,57,58],evaluate_pass:57,evaluator_bas:9,evalut:[26,58],even:[23,25,37,40,57],evenli:43,event:44,event_handl:23,everi:[2,3,9,10,11,17,20,23,33,34,35,40,53,56,57,58],everyth:[26,28,34],exactli:[3,9,10,11,16,17,43,56],exampl:[2,3,8,9,10,11,12,16,17,20,22,25,26,27,28,33,35,37,38,39,40,42,43,44,50,51,52,53,57,58],exceed:10,except:[3,42,48,55,57],excluded_chunk_typ:9,exconv:[10,16],exconvt:[10,16],exdb:20,exec:40,execut:[35,37,43,54,56,57],exist:[23,25,35,40,43,54,57],exit:[40,44],exp:6,expand:[10,35,56,57,58],expand_a:[10,16],expand_level:[10,16],expandconvlay:[10,16],expandlevel:[10,16],expect:[10,16,37,57],expens:58,experi:42,explain:[3,9,38,49,57],explan:[10,16,53,58],explanatori:[26,28],explicit:35,explicitli:[3,23],exploit:50,explor:10,exponenti:14,expos:[28,43],express:[23,43,57],extend:[0,55],extens:[12,54,55,58],extern:[3,24],extra:[10,11,15,16,17,26],extraattr:[7,15,42],extraattribut:[16,17],extraattributenon:16,extract:[10,16,43,50,56,57],extract_fea_c:51,extract_fea_pi:51,extract_para:48,extralayerattribut:[7,10,11,15],extralayeroutput:11,extrapaddl:17,extrem:[10,37],extremli:2,f120da72:44,f7e3:43,fa0wx:44,fabric:38,facotr:[10,16],fact:51,factor:[7,10,12,15,16],factori:24,fail:[3,40,42,44,50],fake:49,fake_imag:25,fals:[3,7,9,10,11,12,15,16,17,20,25,26,33,35,40,42,44,48,53,55,56,57,58],false_label:25,false_read:25,famili:58,familiar:[3,26],fanscin:3,fantasi:54,fantast:53,far:0,farmer:54,fascinatingli:2,fast:[10,16,34,37],faster:[10,11,16,17,33,37,57],favorit:34,fbd1f2bb71f4:44,fc1:[35,42],fc2:42,fc3:42,fc4:42,fc8a365:43,fc8a:43,fc_act:[11,17],fc_attr:[11,17],fc_bias_attr:[11,17],fc_layer:[26,35,42,53,55],fc_layer_nam:11,fc_name:17,fc_param_attr:[11,17],fclayer:35,fdata:56,fea:51,fea_output:51,feat:57,featur:[3,10,14,16,20,34,40,50,53,57,58],feature_map:55,feed:[11,17,20,22,23,26,57],feedback:0,feeder:20,feedforward:50,femal:54,fernan:57,festiv:3,fetch:[20,33,35],few:[3,25],fewer:10,fg0:[10,16],field:[10,16,22,37,43],figur:[23,33,35,37,48,49,50,51,56,57,58],file1:58,file2:58,file:[2,3,5,9,10,16,20,23,25,26,27,33,34,35,38,40,48,50,51,56,57,58],file_list:3,file_nam:[3,26,51,53,56],filenam:[3,55],filer:[10,16],filesystem:43,fill:[10,16,43,53],film:54,filter:[10,16,51],filter_s:[10,11,16,17],filter_size_i:[10,16],finali:38,find:[10,12,37,50,57,58],fine:[7,15,55],fingerprint:43,finish:[3,38,43,44,50],finit:35,first:[3,10,16,20,23,26,30,33,34,35,37,40,42,43,48,49,50,51,53,55,56,57,58],first_seq:33,firstn:20,firstseen:44,fit:[2,20,34],five:[37,53],fix:[3,7,15,24,58],flag:[40,49,50,56],flexiabl:25,flexibl:[0,2,10,11,17,23,33],flight:58,float32:[5,20,25,26,49,51],floor:[10,16],flow:34,fly:[26,53],fnt03:43,focu:[3,37],folder:[27,43,50,57,58],follow:[2,3,9,10,11,12,16,17,20,23,25,27,28,30,33,34,35,37,38,42,43,44,45,46,48,49,50,51,53,54,55,56,57,58],fool:49,forbid:23,force_load:24,forecast:57,forget:[12,23,28,57],form:[2,3,11,12,17,37,56],format:[2,3,9,26,34,35,40,43,48,50,54,55,57],former:[23,58],formula:[10,11,16,17],formular:[10,16],forward:[11,14,17,33,34,35,42,49,56,57],forwardactiv:35,forwardtest:5,found:[3,5,10,16,27,33,49,50,53,57],four:[3,30,48,51,53,55,56,57],frame:9,framework:[23,35,51,53,57],free:58,french:58,frequenc:[20,37,48,53,57],frequent:[25,38,58],frog:50,from:[0,3,5,10,11,16,17,20,22,25,26,28,31,33,34,35,37,38,40,42,43,44,48,49,50,51,53,54,55,56,57,58],from_timestep:[10,16],fromfil:[25,26,51],fulfil:37,full:[10,16,28,33,35],full_matrix_project:[11,17,33],fulli:[26,34,35,37,49,50,51,53,55,57],fullmatrixproject:[10,16],fully_matrix_project:[11,17],fullyconnect:48,fullyconnectedlay:35,func:20,fundament:26,further:10,fusion:55,gain:[10,16],game:49,gamma:51,gan:23,gan_train:49,gap:40,gate:[10,11,16,17,57],gate_act:[10,11,16,17],gate_recurr:[10,16],gather:[10,35,55],gauss:[7,15],gaussian:49,gcc:[24,27],gdebi:30,gen:[10,58],gen_conf:[49,58],gen_data:58,gen_result:58,gen_train:49,gen_training_machin:49,gen_trans_fil:33,gender:[54,55],gener:[2,3,5,9,10,11,16,17,20,22,23,25,26,27,28,37,38,40,42,43,48,51,52,53,55,57],generatedinput:33,generator_conf:49,generator_machin:49,generator_train:49,genert:3,genr:[54,55],gereat:9,get:[3,10,11,16,17,26,27,30,33,35,37,38,43,47,50,51,53,55,56,57],get_batch_s:56,get_best_pass:57,get_config_arg:[42,53,55,57],get_data:[44,53,56],get_imdb:57,get_input_lay:35,get_mnist_data:49,get_model:51,get_nois:49,get_output_attr:17,get_output_layer_attr:11,get_training_loss:49,get_word_dict:20,getbatchs:35,getenv:23,getinput:35,getinputgrad:35,getinputvalu:35,getoutputgrad:35,getoutputvalu:35,getparameterptr:35,getsiz:35,getslotvalu:49,gettempl:43,gettranspos:35,getw:35,getweight:35,getwgrad:35,gfortran:27,gildea:56,gist:[11,17],git:[27,28,34],github:[10,11,16,17,27,28,30,51],give:[3,26,28,35,37,43,53],given:[3,20,22,25,35,40,49,53,56,57,58],global:[3,7,12,15,23,37,40,43,55,57],global_learning_r:[7,15],globalstat:37,globalstatinfo:37,globe:3,goal:[37,56],godoc:24,goe:[10,11,16,17,26],going:[53,57],good:[10,16,25,37,57,58],goodfellow13:[10,16],googl:23,googleapi:43,got:28,gpg2:43,gpg:43,gpu:[2,3,7,10,12,15,16,19,27,30,36,38,49,50,51,55,56,57,58],gpu_id:[40,42,49],gpugpu_id:39,grab:57,grad:[40,54],grad_share_block_num:[39,40],gradient:[7,9,10,12,15,16,40,53,57],gradient_clipping_threshold:[7,12,15,53,57],gradientmachin:[5,49,55,58],gradual:[26,37],grai:50,gram:[48,57],grant:43,graph:[10,48],graphviz:51,grave:57,grayscal:3,greater:[10,16],grep:[28,57],groudtruth:33,ground:[9,10,16,53,58],group:[11,17,57],group_id:55,group_input:33,grouplen:54,gru:[10,16,33,53,58],gru_attr:17,gru_bias_attr:[11,17],gru_decod:33,gru_decoder_with_attent:33,gru_encoder_decod:[48,58],gru_layer_attr:11,gru_memori:[11,17],gru_siz:53,gru_step:[17,33],gru_step_lay:[11,33],grumemori:[11,17,33],gserver:[10,35],gsizex:37,guarante:35,guess:[26,57],gui:37,guid:[29,33,34,35,37,43,44,48,50,57,58],guidenc:26,gur_group:[11,17],gzip:44,hack:[29,38],hadoop:23,half:43,hand:[54,55,57],handl:[23,25,38,55,57],handwrit:[3,57],hard:[43,53],hardwar:[28,37],has:[3,5,10,11,12,16,17,23,33,35,37,43,44,48,50,53,54,55,56,57,58],have:[2,3,5,9,10,11,16,17,20,23,25,26,27,33,34,35,37,38,40,42,43,48,50,53,54,55,57,58],hdf:2,head:[34,48,57],header:[26,35,48,51,55],health:54,heavi:38,height:[10,16,20,24,25,35,50],hello:23,help:[3,5,34,38],helper:[8,10,11,16,17,35],here:[3,5,7,10,11,15,16,17,20,23,25,26,27,33,38,39,42,43,44,48,50,51,52,53,54,55,56,57,58],heurist:[10,40,58],hidden:[10,11,16,17,33,43,53,55,57],hidden_s:[11,17,55],hierarch:[10,16,33],high:[7,15,35,49],higher:2,highest:[20,58],highli:[2,3,33,42,55,57],him:23,hint:26,histor:57,hl_get_sync_flag:35,hold:[23,43],home:[38,43,44],homemak:54,hook:[3,55,56],hope:0,horizont:[10,16,51],horror:54,hors:50,horst:57,host:[27,38,43,44],hostnam:[38,43],hostpath:44,hostport:43,hot:55,hour:58,hous:[3,20,26,48],how:[2,3,7,10,15,16,23,26,33,38,40,43,44,47,50,51,53,55],howev:[3,11,17,25,26,33,34,39,40,43,57,58],hpp:24,html:[20,28,50],htod:37,http:[10,11,16,17,20,27,28,30,34,43,44,49,50,51,58],huber:[10,16],huge:[10,16,34],huina:57,human:58,hyper:[10,16,35],hyperplan:20,i0601:55,i0706:58,i0719:58,i1117:37,iamfullaccess:43,iamusersshkei:43,ib0:38,icwsm:57,id_input:[9,33],idea:[10,16,25],ident:[26,43,54],identifi:[33,35],identityoffsetproject:[10,16],identityproject:[10,16],ids:[9,10,16,22,35,53,55],idx:35,ieee:57,ignor:[3,9,40],ijcnlp:57,illustr:[3,33,35,37,53],ilsvrc:51,imag:[3,19,20,23,25,26,29,42,43,45,46,49,51,52,58],image_a:25,image_b:25,image_classif:50,image_fil:25,image_lay:25,image_list_provid:51,image_nam:23,image_path:25,image_provid:50,image_reader_cr:25,image_s:51,imagenet:52,imagepullpolici:43,imageri:[10,16],images_reader_cr:25,imdb:54,imdber:57,img:[3,10,16,50],img_conv:17,img_conv_lay:11,img_featur:3,img_norm_typ:10,img_pool:17,img_pool_lay:11,img_siz:50,imgsiz:37,imgsizei:37,imgsizex:37,immedi:43,immutable_paramet:23,implement:[3,10,11,12,16,17,20,33,53,56],importerror:55,improv:[0,37,43,57,58],inbound:43,includ:[2,3,10,11,16,17,23,24,27,28,33,35,37,40,43,44,48,53,54,56,58],inconsist:54,incorrect:[10,16],increas:[40,58],increment:40,incupd:35,inde:[20,25],independ:[10,16,53],index:[3,9,10,16,19,20,33,38,43,55],indexslot:[10,56],indic:[3,9,10,16,26,38,43,56],individu:[26,43],infer:[1,23,27],infiniband:38,info:[9,10,16,35,38],infom:34,inform:[5,9,35,37,40,43,54,55,56,57,58],infrastructur:[43,49],ingor:40,ininst:23,init:[7,15,35,42,43,49,53,55,56],init_hook:[53,55,56],init_hook_wrapp:8,init_model_path:[39,40,42,48,53,56],initi:[3,5,7,10,15,16,33,35,40,48,49,53,56],initial_max:[7,15],initial_mean:[7,10,15,16],initial_min:[7,15],initial_std:[7,10,15,16],initpaddl:[5,49],inlcud:[11,17],inlin:43,inner:35,inner_param_attr:[11,17],input1:[10,11,16,17],input2:[10,16],input:[3,5,9,10,11,14,16,17,19,20,22,25,26,33,35,42,48,49,50,51,53,55,56,57,58],input_data:35,input_data_target:35,input_featur:14,input_fil:[26,56],input_hassub_sequence_data:35,input_id:[10,16],input_imag:[11,17,50],input_index:35,input_label:35,input_lay:[10,35],input_nam:23,input_sequence_data:35,input_sequence_label:35,input_sparse_float_value_data:35,input_sparse_non_value_data:35,input_t:35,input_typ:[26,33,53,55],inputdef:35,inputlayers_:35,inputtyp:[3,20],insid:[9,10,16,25,28,43],inspir:48,instal:[28,31,34,38,44,50,51,55,56,57],instanc:[10,12,16,33,35,37,40,56],instance_ip:43,instead:[10,16,19,25,34,38,53,58],instruct:[28,30,37,53],int32:40,integ:[3,9,10,16,20,24,33,35,53,57],integer_valu:[3,20,53],integer_value_sequ:[3,20,33,53,56],integr:[27,56],intend:0,inter:[10,16,38],interact:[28,43],intercept:[10,16],interest:[37,57],interfac:[5,7,10,11,15,16,17,38,43,50,55,57],interg:53,intergr:[10,16],intermedi:56,intern:[10,11,17,20,43],internet:57,interpol:10,interpret:[3,9,27,28,37],interv:57,intrins:27,introduc:[3,44,55,57],introduct:[4,49],invalid:25,invari:50,invok:[3,10,37,43,55],involv:49,iob:9,ioe:9,ips:43,ipt:[10,16,33],ipython:23,is_async:12,is_discriminator_train:49,is_gener:[10,48,49,58],is_generator_train:49,is_kei:55,is_layer_typ:10,is_predict:[53,55,57],is_seq:[10,33,55],is_sequ:55,is_stat:[7,15],is_test:[51,56,57],is_train:3,isn:37,isspars:35,issu:[27,28,37],item:[10,16,20,25],iter:[10,11,12,17,20,22,23,25,50,56,57],its:[3,9,10,11,16,17,23,35,37,40,43,48,49,50,53,57,58],itself:[11,17],java:24,jeremi:37,jie:[56,57],jmlr:[10,16],job:[5,9,39,40,42,51,53,55,56,57,58],job_dispatch_packag:38,job_mod:48,job_nam:43,job_namespac:43,job_path:43,job_workspac:38,jobpath:43,jobport0:43,jobport1:43,jobport2:43,jobport3:43,johan:57,joint:[48,58],jointli:[11,17,58],journal:[56,57],journei:28,jpeg:50,jpg:51,json:[38,43,44,55],jth:[11,17],judg:58,jupyt:28,just:[3,9,10,11,14,16,17,26,28,34,38,42,43,50,55,56,57],jx4xr:43,jypyt:23,k8s_data:43,k8s_job:23,k8s_token:23,k8s_train:43,k8s_user:23,kaim:[10,16],kaimingh:51,kebilinearinterpbw:37,kebilinearinterpfw:37,keep:[3,10,16],kei:[3,37,38,55,57],kernel:[10,16,37,53],key1:40,key2:40,key_pair_nam:43,keyid:43,keymetadata:43,keypair:43,keyserv:43,keystat:43,keyusag:43,keyword:3,kill:43,kind:[2,3,23,26,43,44,49,53,55],kingsburi:56,kms:43,know:[3,11,17,23,26,28,35,37,43,55],knowledg:57,known:[49,57,58],kriz:[20,50],ksimonyan:[11,17],kube_cluster_tl:23,kube_ctrl_start_job:23,kube_list_containers_in_job_and_return_current_containers_rank:23,kubeconfig:43,kubectl:44,kuberent:43,kubernet:[23,36,38,45,46],kubernetes_service_host:23,kwarg:[3,9,10,11,12,16,17,20,53,55,56],l1_rate:[7,15],l2_rate:[7,15],l2regular:[50,53,57],label:[3,5,9,10,12,16,20,22,25,26,33,44,49,50,51,52,53,55,57],label_dict:56,label_dim:[10,16,53],label_fil:[25,56],label_lay:[10,25],label_list:56,label_path:25,label_slot:56,labeledbow:57,labl:57,lag:40,lake:3,lambdacost:[10,16],lambdarank:[10,16],languag:[10,16,42,48,56,57,58],laptop:28,larg:[19,56,57,58],larger:[3,7,9,10,12,15,16,38],last:[9,10,11,16,17,26,33,38,40,53,57,58],last_time_step_output:10,lastseen:44,late:57,latenc:[38,43],later:[27,34,43,53],latest:[10,16,28,34,44,57],latter:58,launch:[40,43,57],launcher:23,lawyer:54,layer1:[10,11,16,17],layer2:[10,16],layer3:[10,16],layer:[4,5,7,9,11,15,17,19,20,21,22,25,26,33,36,39,40,48,49,50,51,53,55,56,57],layer_0:35,layer_attr:[10,16,33,42],layer_num:[42,51],layer_s:[10,16],layer_typ:[10,16],layerbas:35,layerconfig:35,layergradutil:35,layermap:35,layeroutput:[9,11,55],lbl:[9,50],ld_library_path:[27,30,38],lead:37,learn:[0,7,9,10,11,12,15,16,17,23,25,26,28,33,35,37,50,51,53,56,57,58],learnabl:[10,16],learning_method:[12,26,48,50,53,55,57,58],learning_r:[7,12,15,26,48,50,53,55,57,58],least:[9,10,16,27,54],leav:[3,43],lecun:20,left:[10,16,26,51],leman:58,len:[3,10,16,33,35,53,55,56],length:[10,11,16,17,20,33,40,44,57,58],less:[10,16,23,38,58],less_than:23,let02:44,let:[5,10,16,23,26,28,43,55],level:[7,10,15,16,38,40,49,55,57,58],lib64:[27,28,38,40],libcuda:28,libcudnn:27,libjpeg:50,libnvidia:28,libpaddl:24,libpython:27,librari:[10,16,27,38,40,55],licens:56,like:[3,9,10,16,25,26,27,33,37,38,39,42,43,48,51,53,55,57,58],limit:[10,20,37,40],line:[2,3,5,9,20,26,34,36,37,38,42,43,48,50,51,55,56,57,58],linear:[6,10,16,31],linear_comb:10,linearactiv:[10,26],linguist:56,link:[10,11,16,17,27,43,53,57],linux:[27,28,30,43,58],lipeng:48,lipton:57,list:[2,3,8,9,10,11,16,20,23,26,33,35,38,40,42,43,50,51,53,55,56,57,58],listen:[28,40],literatur:57,littl:[2,3,40,53,57],lium:58,live:28,liwicki:57,load:[2,3,5,10,16,23,26,40,43,51,55,56,57,58],load_featur:51,load_feature_c:51,load_feature_pi:51,load_missing_parameter_strategi:[39,40,42,48,56],load_uniform_data:49,loadparamet:5,loadsave_parameters_in_pserv:[39,40],local:[7,15,27,28,34,38,39,40,44,50,57],localhost:28,locat:[33,35,53,56],log:[3,6,28,34,35,38,40,43,44,50,55,56,57,58],log_barrier_abstract:40,log_barrier_lowest_nod:[39,40],log_barrier_show_log:[39,40],log_clip:[39,40],log_error_clip:[39,40],log_period:[40,42,44,49,50,53,55,56,57,58],log_period_serv:[39,40],logarithm:14,logger:3,logic:[3,38],longer:58,look:[3,9,26,38,39,43,44,49,53],lookup:53,loop:25,loss:[10,16,35,49,53,57,58],lot:39,low:[10,16],lower:38,lowest:40,lst:55,lstm:[10,16,33,44,53],lstm_attr:17,lstm_bias_attr:[11,17],lstm_cell_attr:[11,17],lstm_group:[11,17],lstm_layer_attr:11,lstm_size:53,lstm_step:[11,17],lstmemori:[11,17,33],lstmemory_group:10,ltr:[10,16],lucki:26,mac:[27,28],machan:[11,17],machin:[10,11,12,16,17,26,34,35,39,40,42,43,44,53,55,57,58],made:[3,26,33,54],mai:[3,8,9,10,16,25,34,37,43,54],main:[3,5,34,43,50,56,57],mainli:40,maintain:[10,43],major:[28,34,49,51,57,58],make:[3,10,16,23,25,27,28,34,35,37,38,43,50,53,55,57],male:54,malloc:35,manag:[34,38],manageri:54,mandarin:[10,16],mani:[0,10,11,16,17,26,40,53,54,55,57],mannal:38,manual:[28,34],manufactur:58,mao:57,map:[3,10,16,23,40,50,51,55],map_read:20,mapreduc:23,marcu:57,mark:[3,33,56],mark_slot:56,market:[26,54,57],martha:56,mask:[7,10,15,16],master:[23,34,40,57],mat_param_attr:[11,17],match:37,math:[11,17,24,35,37],matirx:[10,16],matplotlib:50,matric:[5,33,35],matrix:[9,10,11,16,17,20,24,33,35,39,42,51,56],matrixptr:35,matter:3,max:[3,7,10,13,15,16,20,37,40,42,50,53,55],max_id:53,max_length:[10,33],max_sort_s:[10,16],maxid:[9,10,53],maxid_lay:[9,53],maxim:[10,58],maximum:[9,33,37,40,53,56,57],maxinum:19,maxout:10,maxpool:[10,16],mayb:[10,11,16,17,50],mean:[3,7,9,10,11,12,15,16,17,19,20,22,25,26,33,37,38,40,42,43,48,49,50,51,53,55,56,57,58],mean_img_s:50,mean_meta:51,mean_meta_224:51,mean_valu:51,measur:[26,37],mechan:[10,11,17,33,43,57],media:57,meet:56,member:23,memcpi:37,memor:57,memori:[2,3,11,17,33,35,37,40,42,44,53,56,57,58],memory_threshold_on_load_data:40,mere:[11,17],merg:[34,40,48,58],mergedict:[48,58],messag:[26,40,44,55,57,58],meta:[38,50,51,53],meta_config:[38,55],meta_fil:55,meta_gener:[38,55],meta_path:50,meta_to_head:55,metadata:[43,44],metaplotlib:23,method:[3,8,10,11,12,16,22,28,35,37,40,42,53,55,57,58],might:[10,16,35,43],mileag:37,million:[42,54],min:[7,15,37,42,43,55],min_pool_s:3,mind:38,mini:[3,10,16,20],mini_batch:25,minibatch:[10,16],minibatch_data:20,minim:[3,12,26,40],minimum:[10,16],minimun:40,minst:3,minut:[43,58],miss:[40,48,56],mit:43,mix:[11,17,33,56],mixed_attr:17,mixed_bias_attr:[11,17],mixed_lay:[11,33,56],mixed_layer_attr:11,mixedlayertyp:10,mkdir:[27,43],mkl:27,mkl_path:27,mkl_root:27,ml_data:[38,55],mnist:[3,5,25],mnist_provid:3,mnist_random_image_batch_read:25,mnist_train:[3,25],mnist_train_batch_read:25,mod:56,modal:56,mode:[10,16,40,49,50,51,55,57,58],model:[1,2,5,8,10,11,12,16,17,31,34,35,36,40,43,55,56,57],model_averag:12,model_config:[5,49],model_list:[40,42,56,57],model_output:57,model_path:42,model_zoo:[48,51],modelaverag:12,modifi:[5,33,34,35,38,43],modul:[2,3,5,8,11,17,20,26,27,50,51,53,55,56],modulo:[10,16],momentum:[7,12,15,26,53],momentumoptim:[26,50],mon:44,monitor:[53,57],mono:[10,16],month:[53,58],mood:57,more:[2,3,5,9,10,11,16,17,20,23,25,26,28,33,35,37,38,42,44,50,53,56,57,58],morin:[10,16],mose:[57,58],moses_bleu:58,mosesdecod:57,most:[3,5,10,20,23,25,26,33,35,37,39,55,56,57,58],mostli:[50,54],mount:[28,43,44],mountpath:[43,44],move:[10,16,37,43,55,57],movement:[37,57],movi:[3,57],movie_featur:55,movie_head:55,movie_id:55,movie_meta:55,movie_nam:55,movie_review:20,movieid:54,movielen:52,moving_average_fract:[10,16],mpi:38,mse:10,mse_cost:[26,55],much:[10,16,25,37],mul:35,mulit:38,multi:[10,16,35,39,40,51,58],multi_binary_label_cross_entropi:16,multi_crop:51,multinomi:[10,16],multipl:[9,10,11,16,17,20,23,33,35,40,42,43,49,53,55,57],multipli:[9,10,16,35,50],multithread:3,music:54,must:[3,9,10,11,14,16,17,25,27,33,34,35,38,40,42,43,58],my_cluster_nam:43,my_cool_stuff_branch:34,my_external_dns_nam:43,mypaddl:44,mysteri:54,name:[3,7,8,9,10,11,15,16,17,19,20,23,26,28,33,35,37,38,40,42,44,45,46,48,49,50,51,53,55,57,58],namespac:[24,35,44],nano:34,nativ:[10,16],natur:[42,56,57],nchw:[10,16],ndarrai:22,ndcg:[10,16],ndcg_num:[10,16],nearest:53,necessari:[3,10,16,27,35,38,53,57],necessarili:35,need:[3,10,11,16,17,20,23,26,27,28,30,33,34,35,38,39,40,42,43,44,49,50,51,53,55,56,57,58],neg:[3,9,10,16,53,56,57],neg_distribut:[10,16],negat:56,neighbor:53,nest:[3,20],net:[10,11,16,17],net_conf:57,net_diagram:51,network:[2,3,4,5,7,9,10,12,15,16,20,21,22,23,25,26,35,37,38,40,48,57,58],network_config:42,networkadministr:43,neural:[3,5,10,11,12,16,17,20,22,23,26,37,40,48,49,51,57,58],neuralnetwork:[10,16,31],neuron:[5,35,53,57],never:[20,25,43,44],newest:34,newtork:57,next:[10,33,35,37,40,43,44,56,57,58],nfs4:43,nfs:43,nfsver:43,nginx:28,nic:[38,39,40],nine:56,nlp:[3,10],nltk:20,nmt:58,nnz:35,no_cach:3,no_sequ:[3,55],noah:57,noavx:[28,30],node:[10,16,35,38,40,43,44,57,58],node_0:43,node_1:43,node_2:43,nodefil:38,noir:54,nois:[10,16,49],noise_dim:49,non:[10,16,35,40,43],none:[2,3,5,7,8,9,10,11,12,15,16,17,19,20,22,23,26,33,51,53],nonlinear:35,norm:49,norm_by_tim:[10,16],normal:[3,5,10,11,16,17,30,33,35,38,40,44,48,49,51],normzal:51,north:50,notat:[10,16],note:[3,5,7,10,11,12,15,16,17,19,23,25,27,28,37,40,42,43,48,50,55,57],notebook:28,noth:[14,40],notic:[33,35],novel:57,now:[0,3,10,16,26,28,34,40,43,49,55,56],np_arrai:20,nproc:27,ntst1213:58,ntst14:58,nullptr:35,num:[10,16,38,40,53,56,57,58],num_channel:[10,11,16,17,50],num_chunk_typ:9,num_class:[10,11,16,17,50],num_filt:[10,11,16,17],num_gradient_serv:[39,40],num_group:[10,16],num_neg_sampl:[10,16],num_parameter_serv:23,num_pass:[26,39,40,42,44,53,55,56,57,58],num_repeat:[10,16],num_result:9,num_results_per_sampl:10,number:[3,9,10,16,20,25,26,35,38,40,43,48,50,51,53,56,57,58],numchunktyp:9,numdevices_:42,numlogicaldevices_:42,numofallsampl:9,numofwrongpredict:9,numpi:[20,22,25,26,27,49,51],numsampl:37,numtagtyp:9,nvidia:[27,28,37,40],obj:[3,8,26,50,51,53,55],object:[3,5,7,8,9,10,11,12,15,16,17,20,22,23,24,37,49,50,51,53,56],observ:[12,26,35,37,58],obtain:[53,56,57],occup:[54,55],occur:[20,34],oct:44,odd:[10,16],off:28,offer:[5,56],offici:[28,43,50],offset:[10,16,55],often:[9,38,53,58],ograd:35,old:[28,34,40],omit:53,on_coverallscompil:27,on_init:3,on_travisexclud:27,onc:[3,10,28,34,35,43,53],one:[3,8,9,10,11,12,14,16,17,19,20,23,25,26,28,34,35,38,40,42,43,44,48,49,50,51,53,55,56,57,58],one_host_dens:55,one_hot_dens:55,onli:[2,3,5,9,10,11,16,17,19,20,23,26,27,33,34,35,37,39,40,42,43,44,48,51,53,54,57,58],onlin:[12,25],onto:43,open:[0,3,10,16,23,25,26,28,43,51,53,55,56],openbla:27,openblas_path:27,openblas_root:27,oper:[10,11,12,16,17,28,33,35,37,40,43,48,50,55],opinion:57,opt:[23,27],optim:[3,4,7,15,21,26,35,37,57],option:[3,9,10,16,23,26,34,35,38,42],order:[3,10,11,16,17,20,25,35,40,43,44,49,51,53,57,58],ordinari:57,oregon:43,org:[10,11,16,17,27,49],organ:[10,16,50,57,58],origin:[0,2,3,10,16,20,34,49,56,58],other:[3,9,10,11,12,16,17,20,27,30,33,34,42,43,44,48,49,50,51,53,54,55,56,57,58],otherchunktyp:9,otherwis:[2,8,10,16,20,23,25,33,38,42,55,58],our:[23,28,33,35,43,44,48,50,53,56,57,58],out:[10,16,23,26,33,37,40,43,44,50,57],out_dir:43,out_left:[10,16],out_mem:33,out_right:[10,16],out_size_i:[10,16],out_size_x:[10,16],outlin:41,outperform:56,output:[5,7,9,10,14,15,16,17,19,20,22,23,25,26,33,35,37,40,42,44,48,49,50,51,53,55,56,57,58],output_:[10,16,35],output_dir:51,output_fil:56,output_id:[10,16],output_lay:[22,51],output_max_index:19,output_mem:[10,16,33],outputh:[10,16],outputw:[10,16],outsid:[3,10,11,16,17],outter_kwarg:3,outv:35,over:[2,10,11,16,17,23,34,35,37,53,56,57],overcom:57,overhead:37,overlap:35,overrid:35,owe:0,own:[34,38,43],pacakg:30,packag:[3,16,20,29,43],pad:[10,33,53],pad_c:[10,16],pad_h:[10,16],pad_w:[10,16],paddepaddl:2,padding_attr:[10,16],padding_i:[10,16],padding_x:[10,16],paddl:[3,5,6,7,8,9,10,11,12,13,14,15,16,17,19,20,22,23,24,26,27,28,29,30,34,35,36,37,38,40,42,43,49,50,53,55,56,57,58],paddle_error:24,paddle_matrix:24,paddle_matrix_shap:24,paddle_n:38,paddle_output:44,paddle_port:38,paddle_ports_num:38,paddle_ports_num_for_spars:38,paddle_pserver2:38,paddle_root:48,paddle_source_root:48,paddle_train:38,paddledev:[28,43,44],paddlepaddl:[0,2,3,5,10,11,12,16,17,20,25,26,27,30,31,33,34,35,36,37,38,45,46,51,53,55,56,57],paddlepadl:3,paddlpaddl:0,paddpepaddl:3,page:[34,43,55],pair:[9,56],palmer:56,paper:[10,16,48,49,51,56,57,58],paraconvert:48,paragraph:57,parallel:[37,40,42,43,44,58],parallel_nn:[7,15,39,40],param:[7,10,15,16,55],param_attr:[10,11,16,17,26,33],paramattr:[7,10,15,16,26,33],paramet:[2,3,4,5,8,9,10,11,12,16,17,19,20,21,25,26,35,36,42,49,50,53,55,56,57,58],parameter_attribut:[10,16],parameter_block_s:[39,40],parameter_block_size_for_spars:[39,40],parameter_learning_r:[7,15],parameter_nam:23,parameter_serv:23,parameterattribut:[7,10,11,15,16,17],parametermap:35,parameters_:35,parameterset:23,parametris:12,paramt:[43,48],paramutil:55,paraphras:58,paraphrase_data:48,paraphrase_model:48,paraspars:35,parent:[10,35],pars:[5,20,42,43,49,55,56],parse_config:[5,49],parser:55,part:[3,16,26,33,34,35,37,49,53,55,56,57,58],parti:[37,55],partial:[10,16,49],participl:48,particular:37,partit:43,pass:[3,8,10,16,22,25,26,34,35,37,38,40,43,44,49,50,53,55,56,57,58],pass_idx:25,pass_test:49,passtyp:35,password:[28,38],past:[23,28,43],path:[2,3,9,20,25,26,27,33,38,40,42,43,44,48,50,51,53,56,57,58],pattern:[24,26,43,55,57],paul:56,pave:58,pdf:[10,11,16,17],pem:[23,43],penn:56,per:[10,25,40,50,53],perfom:[40,42],perform:[2,10,11,16,17,26,33,34,35,36,38,39,49,50,53,57,58],period:[2,40,53,55,56,57,58],perl:[57,58],permiss:43,peroid:[10,16],persist:43,persistentvolum:43,persistentvolumeclaim:43,person:23,perspect:37,perturb:35,pgp:43,phase:26,photo:50,pick:[3,43],pickl:55,picklabl:8,pictur:53,piec:[10,11,16,17,26],pillow:50,pip:[27,34,38,50,55],pipe:54,pipelin:56,pixel:[3,10,16,20],pixels_float:3,pixels_str:3,place:[2,3,35,37,38,51,58],placehold:26,plai:[56,57],plain:[2,9,10,16],plan:35,platform:[0,26,28,43],pleas:[3,5,7,10,11,12,15,16,17,23,25,27,28,29,33,34,35,43,48,50,53,55,56],plot:[23,50],plotcurv:50,png:[50,51],pnpairvalidationlay:40,pnpairvalidationpredict_fil:39,pod:[43,44],pod_nam:43,point:[26,28,37],polar:57,polici:43,polit:57,poll:57,poo:50,pool3:35,pool:[3,4,11,17,21,50,53,55],pool_attr:[11,17],pool_bias_attr:[11,17],pool_layer_attr:11,pool_pad:[11,17],pool_siz:[3,10,11,16,17],pool_size_i:[10,16],pool_strid:[11,17],pool_typ:[10,11,16,17],pooling_lay:[11,53,55],pooling_typ:[10,16,53],poolingtyp:19,popular:[26,51],port:[28,38,39,40,43,44],port_num:39,ports_num:40,ports_num_for_spars:[39,40,42],pos:[55,57],posit:[3,9,10,16,20,53,56,57,58],positive_label:9,possibl:[23,34,37,49],post1:27,potenti:37,power:[10,53,58],practic:[8,10,16,26,33,35],pre:[3,10,11,17,23,43,44,48,50,56,57,58],pre_dictandmodel:48,precis:[9,27],pred:[53,56],predefin:57,predetermin:[10,40,58],predic:56,predicate_dict:56,predicate_dict_fil:56,predicate_slot:56,predict:[3,4,9,10,12,16,22,26,33,38,40,48,53,58],predict_fil:40,predict_output_dir:[39,40,53],predict_sampl:5,predicted_label_id:53,predictor:55,predin:50,prefer:57,prefetch:35,prefix:43,pregrad:35,preinstal:27,premodel:48,prepar:[5,31,45,53],preprcess:57,preprocess:[20,33,38,44,57],prerequisit:27,present:[23,51,56,58],pretti:26,prev_batch_st:[39,40],prevent:[2,12,23],previou:[10,11,16,17,35,40,43,56,58],previous:[44,51],price:26,primari:16,primarili:57,principl:23,print:[7,15,22,23,26,33,40,48,53,55,56,57,58],printallstatu:37,printer:9,printstatu:37,prite:9,privileg:43,prob:[9,49],probabilist:[10,16,48],probability_of_label_0:53,probability_of_label_1:53,probabl:[9,10,16,22,33,34,51,53,56],problem:[5,10,12,16,23,31,53,56,57],proc:28,proc_from_raw_data:53,proce:[20,25,43],procedur:[48,56,58],proceed:[10,16,56],process:[2,3,5,7,8,10,11,12,15,16,17,23,26,33,38,40,42,43,44,48,50,51,53,55,56,57,58],process_pr:53,process_test:8,process_train:8,processdata:[50,51],processor:37,produc:[11,17,20,25,28,51,53],product:[0,35,43,53,57],productgraph:44,profil:27,proflier:37,program:[2,20,23,25,37,38,40],programm:54,progress:40,proivid:3,proj:[10,16],project:[10,11,16,17,27,33,35,55],promis:[10,11,17],prompt:34,prone:23,prop:56,propag:[12,40,42],properli:53,properti:[3,40],propos:58,proposit:56,protect:35,proto:19,protobuf:27,protocol:40,prove:53,proven:58,provid:[0,8,10,16,20,23,26,33,37,38,43,48,49,50,51,54,57],providermemory_threshold_on_load_data:39,provis:43,provod:3,prune:10,pserver:[38,39,40,43],pserver_num_thread:[39,40],pserverstart_pserv:39,pseudo:23,psize:35,pull:[48,58],punctuat:57,purchas:53,purpos:[0,37],push_back:35,put:[35,38,44,53],pvc:43,pwd:28,py_paddl:[5,20,49],pydataprovid:[2,3,53],pydataprovider2:[4,5,26,33,53,55,57],pydataproviderwrapp:8,pyramid:[10,16],pyramid_height:[10,16],python:[2,3,4,8,16,22,23,24,26,27,28,34,38,48,49,50,56,57,58],pythonpath:50,pzo:57,qualifi:27,qualiti:53,queri:[10,16,43,58],question:[10,16,23,43,56],quick:[40,44,52,58],quick_start:[43,44,45,53],quick_start_data:44,quickli:26,quickstart:44,quit:37,quot:54,rac:10,rais:20,ramnath:57,ran:37,rand:[37,40,42,49,56],random:[3,7,10,15,16,20,25,26,40,49,50,56],randomli:57,randomnumberse:39,rang:[3,10,16,20,25,40,42,50,54,56],rank:[10,16,23,43,51,53],rare:3,rate:[7,9,12,15,35,38,50,53,55,57,58],rather:[5,43,57],ratio:40,raw:[10,16,26,53,57],raw_meta:55,rdma:[27,40],rdma_tcp:[39,40],reach:[37,56],read:[2,3,20,23,25,26,33,38,43,51,53,55],read_from_realistic_imag:23,read_from_rng:23,read_mnist_imag:23,read_ranking_model_data:23,reader:[22,58],reader_creator_bool:25,reader_creator_random_imag:[20,25],reader_creator_random_image_and_label:[20,25],reader_dict:20,readi:[26,43,44,50],readm:[54,55,57],readonesamplefromfil:3,readwritemani:43,real:[3,25,26,49],realist:23,reason:[10,11,17,23,28,44],rebas:34,recal:9,receiv:8,recent:58,reciev:40,recogn:50,recognit:[3,10,16,51,57],recommand:3,recommend:[2,11,17,23,33,35,38,40,55],recommonmark:27,recompil:37,record:[43,55,56],recordio:23,recov:[26,49],rectangular:[10,16],recurr:[56,57],recurrent_group:[11,17,33],recurrent_lay:11,recurrentgroup:9,recurrentlay:40,recurs:28,recv:43,reduc:[12,38,40,42],refer:[2,5,7,8,10,11,12,15,16,17,33,35,38,44,48,50,53,55,58],referenc:10,regard:56,regardless:58,regex:55,region:[37,56],regist:[35,37],register_gpu_profil:37,register_lay:35,register_timer_info:37,registri:44,regress:[9,31,52],regular:[7,12,15,35,43,50,53,57],rel:[2,11,17,38],relat:[3,8,30,44,55,57],relationship:[26,49],releas:[27,28,30,43,54,56],relev:[56,58],reli:27,relu:[6,10,16,35],reluactiv:10,remain:53,remot:[7,15,28,34,35,38,40,42,43],remoteparameterupdat:40,remov:[20,38,40,57],renam:58,reorgan:[10,16],repeat:10,replac:57,repo:34,report:[37,38],repositori:34,repres:[3,5,10,12,16,33,35,43,50,53,54],represent:[53,57],reproduc:58,request:[43,44,48,58],requir:[2,9,10,16,23,35,38,43,44,49,50,53,55],requrest:34,res5_3_branch2c_bn:51,res5_3_branch2c_conv:51,res:56,research:[10,16,50,54,57],resembl:57,reserv:3,reserveoutput:35,reset:[10,16],reshap:25,reshape_s:[10,16],residu:51,resnet:52,resnet_101:51,resnet_152:51,resnet_50:51,resolv:[34,44],resourc:[28,43],respect:[3,26,33,35,40,50,51,56,58],respons:[10,16,43,44],rest:[3,10,16,26],restart:[43,44],restartpolici:[43,44],restrict:40,resu:25,result:[5,9,10,14,16,22,33,37,40,43,50,51,53,55,56,57],result_fil:[9,33],ret_val:55,retir:54,retran:43,retriev:[35,44],return_seq:[11,17],reus:[25,35],reveal:23,revers:[10,11,16,17,33,56,57],review:[34,44,53,57],reviews_electronics_5:44,revis:53,rewrit:58,rgb:[10,16],rgen:57,rho:12,rich:26,right:[3,10,16,51],rmsprop:[12,53],rmspropoptim:55,rnn:[10,11,17,36,39,53,57],rnn_bias_attr:33,rnn_layer_attr:33,rnn_out:33,rnn_step:10,rnn_use_batch:[39,40],rnnlm:20,robot:50,role:[23,33,43,52,57],roman:57,romanc:54,root:[12,19,28,38,43,44],root_dir:38,rot:[10,16],rotat:10,roughli:[3,49],routin:55,routledg:57,row:[5,9,10,16,20,35,51],row_id:[10,16],rsize:43,rtype:[10,55],rule:[35,43],run:[23,28,34,35,36,37,40,43,45,46,48,50,51,53,55,57,58],runinitfunct:37,runtim:[2,3,27,38],s_fusion:55,s_id:55,s_param:49,s_recurrent_group:33,sacrif:2,sai:[26,40,42],sake:35,sale:54,same:[3,5,8,9,10,11,16,17,23,33,38,42,43,48,53,55,56,57,58],samping_id:[10,16],sampl:[3,5,9,20,38,40,42,48,49,51,53,55,56,57,58],sample_dim:49,sample_id:9,sample_num:9,santiago:57,satisfi:[38,43,53],save:[3,10,16,20,26,40,42,43,44,50,51,53,55,56,57,58],save_dir:[26,40,42,44,49,50,53,55,56,57,58],save_only_on:[39,40],saving_period:[39,40],saving_period_by_batch:[39,40,42,53],saw:3,scalabl:0,scalar:[3,10,16],scale:[0,10,14,51,54,55],scalingproject:[10,16],scatter:10,scenario:[26,39],scene:39,schdule:43,schedul:[43,49],scheduler_factor:[7,15],schema:48,scheme:[9,12,56],schmidhub:57,schwenk:58,sci:54,scienc:57,scientist:[0,54],score:[9,10,16,55,57,58],screen:55,scrip:53,script:[5,20,28,38,43,50,51,53,56,57,58],seaplane_s_000978:50,search:[10,27,33,40,56,58],seat:58,second:[3,10,16,20,23,25,26,34,38,48,51,53,54,55,57],secret:43,section:[3,33,35,38,43,53],sed:57,see:[3,5,10,11,16,17,23,26,34,37,43,48,49,51,53,55,57,58],seed:[37,40],segment:9,segmentor:48,sel_fc:[10,16],select:[10,16,34,43,54,58],selectiv:[10,16],selector:44,self:[26,35,54,57],selfnorm:[10,16],semant:[23,33,52,57],semat:23,sen_len:56,send:[40,43],sens:10,sent:[23,44],sent_id:33,sentenc:[3,10,33,53,56,57,58],sentiment:[3,26,52,53,56],sentiment_data:57,sentiment_net:57,sentimental_provid:3,separ:[3,9,40,48,53,54,55,56,58],seq:[10,16,55],seq_pool:[10,16],seq_text_print:9,seq_to_seq_data:[48,58],seq_typ:[3,20,55],seqtext_printer_evalu:33,seqtoseq:[10,33,48,58],seqtoseq_net:[10,33,48,58],sequel:3,sequenc:[3,9,10,11,14,16,17,19,20,35,48,53,55,56,57,58],sequence_conv_pool:53,sequence_layer_group:10,sequence_nest_layer_group:10,sequencesoftmax:6,sequencestartposit:[10,16],sequencetextprint:9,sequencetyp:3,sequenti:[8,10,16,33,53,56],seri:[11,17,57],serial:3,serv:[28,37,43,49],server:[23,28,35,38,39],servic:54,session:37,set:[2,3,5,7,9,10,11,15,16,17,20,23,26,27,28,30,33,35,36,37,38,39,40,42,43,44,48,50,51,53,54,55,56,57,58],set_active_typ:35,set_default_parameter_nam:[7,15],set_drop_r:35,set_siz:35,set_typ:35,setp:43,settup:35,setup:[3,35,53],sever:[3,10,16,38,42,43,52,53,55,56,57,58],sgd:[12,23,38,49,57,58],sgdasync_count:39,shallow:56,shape:[10,16,51],shard:43,share:[10,16,27,28,37,40,44,56],shared_bia:[11,17],shared_bias:[10,16],shell:[43,51],shift:51,ship:50,shold:57,shop:57,shorter:51,should:[3,5,9,10,12,16,20,22,23,25,26,30,33,34,38,43,50,53,55,56,57,58],should_be_fals:23,should_be_tru:23,should_shuffl:[3,56],shouldn:34,show:[5,12,16,26,34,40,43,44,48,51,53,55,56,57,58],show_check_sparse_distribution_log:[39,40],show_layer_stat:[39,40],show_parameter_stats_period:[39,40,42,44,53,56,57,58],shown:[3,9,10,16,23,33,35,37,43,49,50,51,53,55,57,58],shrink:35,shuf:55,shuffl:[3,20,55,57],sid:43,side:[10,16,51],sig:43,sigint:38,sigmoid:[6,10,16,17,35],sigmoidactiv:[10,11],sign:43,signal:38,signatur:43,signific:37,similar:[10,16,25,43,53,55],similarli:[10,16,56],simpl:[2,3,9,10,11,14,16,17,20,27,31,34,37,40,53,55,56,57],simple_attent:33,simple_gru:53,simple_lstm:[10,16,53],simple_rnn:[10,33],simplest:43,simpli:[2,10,16,23,27,28,33,34,37,48,51,55,57,58],simplifi:[23,35,44],simultan:43,sinc:[10,16,25,26,37,43,49,53,54,58],sincer:[34,57],singl:[3,9,11,12,17,20,28,35,38,44,51,53,56,58],site:43,six:[48,56,58],size:[3,9,10,11,12,16,17,20,25,26,33,35,38,40,49,50,51,53,54,55,56,57,58],size_a:[10,16],size_b:[10,16],size_t:35,sizeof:48,skill:58,skip:[25,26,38,43,51],slide:12,slightli:50,slope:[10,16],slot:[55,56],slot_dim:55,slot_nam:55,slottyp:55,slow:[3,37],small:[3,35,38,40,50,58],small_messag:[39,40],small_vgg:50,smaller:[10,16],smith:57,snap:44,snapshot:43,snippet:[33,35,37,43,53],social:57,sock_recv_buf_s:[39,40],sock_send_buf_s:[39,40],socket:40,softmax:[6,10,11,16,17,23,33,35,48,53,56,57],softmax_param_attr:[11,17],softmax_selfnorm_alpha:[10,16],softmaxactiv:[33,53],softrelu:6,softwar:37,solv:[23,56],solver:58,some:[3,7,10,12,15,16,20,23,26,27,34,35,37,39,40,42,43,49,53,54,55,56,57,58],some_python_class:24,somecppclass:24,somedata:22,somegotyp:24,someth:[3,10,16],sometim:[12,25,37,57],sophist:[26,35,38],sort:[10,16,20,40,43,55,57,58],sourc:[0,8,10,16,25,26,28,31,33,34,43,44,48,53,55,58],source_dict_dim:33,source_language_word:33,space:[9,33,37],space_seperated_tokens_from_dictionary_according_to_seq:9,space_seperated_tokens_from_dictionary_according_to_sub_seq:9,spars:[3,7,10,12,15,16,20,35,38,40,43,53],sparse_binary_vector:[3,20,53],sparse_binary_vector_sequ:20,sparse_float_vector:3,sparse_non_value_slot:20,sparse_upd:[7,15],sparse_value_slot:20,sparse_vector:20,sparse_vector_sequ:20,sparseparam:35,sparseprefetchrowcpumatrix:35,spatial:[10,16,50],speak:[33,58],spec:[43,44],specfii:40,speci:50,special:[10,27,48,53,58],specif:[2,42,50,53,55],specifi:[2,3,9,10,16,20,23,26,27,33,35,40,43,49,50,51,53,54,55,57,58],speech:[10,16],speed:[11,17],spefici:51,sphinx:[24,27],sphinx_rtd_them:27,split:[3,10,16,38,42,43,48,51,53,56],split_count:43,spp:10,sql:2,squar:[6,10,12,16,19,26],squarerootn:13,squarerootnpool:[10,16],squash:58,srand:40,src:58,src_backward:33,src_dict:33,src_embed:33,src_forward:33,src_id:33,src_root:5,src_word_id:33,srl:56,ssh:[28,38,43,44],sshd:28,ssl:27,sstabl:23,stabl:43,stack:[26,43,53,56],stacked_lstm_net:57,stacked_num:57,stackexchang:[10,16],stage:38,stake:58,stale:34,stamp:37,standard:[7,15,48,50,56,57,58],stanford:[20,44],stanh:6,star:54,start:[10,16,26,28,33,34,37,38,40,47,48,52,55,58],start_pass:[39,40],start_pserv:40,startup:43,stat:[27,37,40,56,57,58],state:[10,11,16,17,26,33,40,44,49,56,58],state_act:[10,11,16,17],statement:[35,43],staticinput:[10,33],statist:[10,16,40,53,56,57,58],statset:37,statu:[9,34,37,43,44],status:44,std:[35,40],stderr:38,stdout:38,step:[5,10,11,12,16,17,19,33,35,37,38,43,44,53,55,56,57,58],still:51,stmt1482205552000:43,stmt1482205746000:43,stochast:12,stock:57,stop:[10,38,40,44,55],storag:[43,44,50],store:[9,10,16,35,38,40,43,44,48,50,51,53,55,56,57,58],str:[22,42],straight:34,strategi:[3,19,40,56],street:[10,16,56],strength:49,strict:25,stride:[10,16],stride_i:[10,16],stride_x:[10,16],string:[2,3,8,9,10,16,35,40,43,57],strip:[53,55,56],structur:[20,38,43,48,50,53,55,56,57,58],sts:43,stub:[10,16],student:54,stuff:34,stun:3,style:[3,10,16,27,34],sub:[9,10,16,20,23,33,35,50,53,58],sub_sequ:3,subgradi:12,submit:[34,39,40,43],subnet0:43,subnet:[23,43],subobjectpath:44,subsequenceinput:10,subset:[35,58],substanti:51,substitut:58,succe:57,succeed:44,success:[43,44,51,56],successfulcr:44,successfuli:57,successfulli:[51,55,57],successor:[40,58],sucessfulli:58,sudo:[27,30,43,50],suffic:[25,26],suffici:40,suffix:58,suggest:[10,16,37],suitabl:[34,40,50],sum:[9,10,12,13,16,33,35],sum_:10,sum_to_one_norm:10,summar:[53,57],sumpool:[10,16],support:[7,9,10,12,15,16,19,20,25,27,28,30,33,35,37,40,43,56],suppos:[26,35,53],sure:[34,35,43,50,57],survei:57,swap_channel:51,swig:[5,24,27],swig_paddl:[5,20,49],symbol:10,sync:[34,40,49],syncflag:35,synchron:[12,38,40,43],syntact:56,syntax:[25,55],synthect:26,synthes:49,synthet:26,sys:51,system:[27,28,38,44,53,56,57,58],t2b:48,tab:53,tabl:[3,10,16,51,53,58],tableproject:[10,16],tag:[9,33],tagtyp:9,take:[3,5,9,10,11,16,17,23,33,35,37,43,44,49,56,58],taken:[3,56],tanh:[6,10,11,16,17,35],tanhactiv:[10,11,33],taobao:57,tar:[20,27,43],tarbal:43,target:[10,16,33,48,53,58],target_dict_dim:33,target_language_word:33,targetinlink:10,task:[3,9,10,16,26,33,42,48,51,56,57,58],tbd:24,tconf:57,tcp:[40,43],teach:53,tear:37,technician:54,techniqu:[33,35],tee:[44,50,55,56,57,58],tell:[37,55],tellig:57,templat:[44,56],tempor:[10,16,53,56],tensor:10,term:[10,11,16,17,56,57],termin:[28,44],terminolog:26,tese:2,tesh:56,test:[2,3,8,9,10,16,20,23,25,27,28,30,34,37,38,39,48,50,51,53,54,58],test_all_data_in_one_period:[44,50,55,56,57],test_data:58,test_fcgrad:35,test_gpuprofil:37,test_layergrad:35,test_list:[3,8,26,50,53],test_part_000:57,test_pass:[39,40,42,58],test_period:[39,40,42],test_ratio:55,test_wait:[39,40],testa:23,testb:23,testbilinearfwdbwd:37,testconfig:35,tester:[55,58],testfcgrad:35,testfclay:35,testlayergrad:35,testmodel_list:39,testq:23,testsave_dir:39,testutil:35,text:[2,3,9,11,17,20,23,28,33,43,48,52,53,55,57],text_conv:53,text_conv_pool:55,text_fil:[20,57],tflop:37,tgz:27,than:[3,5,7,9,10,11,12,15,16,17,27,28,33,35,38,43,51,56,57,58],thank:[0,48,58],thei:[3,23,26,33,35,37,38,39,43,51,57],them:[2,3,11,17,23,25,26,28,33,37,39,40,43,50,51,53,55,57,58],theori:37,therefor:27,therein:[10,16],therun:51,thi:[2,3,7,8,9,10,11,12,15,16,17,20,23,25,26,27,28,30,33,34,35,37,38,40,42,43,44,48,49,50,51,53,54,55,56,57,58],thing:[3,26,33,34,37,55,56],think:23,third:[10,16,37,51,57],those:[51,56],thought:37,thread:[35,37,40,42,55,56,57,58],thread_local_rand_use_global_se:[39,40],threadid:42,threadloc:37,three:[3,9,10,12,16,25,26,33,40,49,51,57,58],threshold:[7,9,12,15,40,57],thriller:54,through:[5,10,16,33,35,37,38,48,49,50,57,58],throughout:53,throughput:37,thu:[3,10,16,26,35,43,58],tier:44,tight:27,time:[3,10,11,16,17,19,20,23,25,26,33,37,40,42,44,53,54,56,57,58],timelin:[10,16,37],timeo:43,timer:27,timestamp:[10,16,54],timestep:[3,10,16],titil:55,titl:[34,54,55],tmall:57,todo:[9,11,17,20,22],toend:[10,16],togeth:[3,10,11,16,17,20,33],token:[9,10,23,33,48,57,58],too:[28,30],tool:[33,34,43,57],toolchain:27,toolkit:[27,30],top:[9,51,56],top_k:9,topolog:[16,23],toronto:[20,50],total:[9,25,37,38,44,48,58],total_pass:25,touch:57,tourism:57,tourist:58,toward:26,tra:58,track:10,tractabl:10,tradesman:54,tradit:[10,16],trail:20,train:[1,2,3,5,7,8,9,10,12,15,16,20,31,33,35,36,37,39,45,46,51],train_conf:[48,58],train_config_dir:43,train_data:58,train_id:43,train_list:[3,8,26,50,51,53],train_part_000:57,trainabl:[10,16],traindot_period:39,trainer:[3,5,23,26,35,38,40,42,49,53,56,57,58],trainer_config:[2,3,26,38,43,44,53,55,57],trainer_config_help:[3,6,7,8,9,10,11,12,13,26,35,50,53,55],trainer_count:[39,40,42,43,44,55,56,57,58],trainer_id:[40,43],trainerintern:[53,55,58],training_machin:49,trainingtest_period:39,trainonedatabatch:49,tran:[10,35,40],trane:3,transact:57,transfer:[2,3],transform:[10,16,33,35,49,50,53,56],transform_param_attr:[11,17],translat:[10,11,17,26,48,55,57,58],transpar:38,transport:40,transpos:[10,16,35,49],transposedfullmatrixproject:[10,16],travel:[3,11],travi:[27,34],treat:[10,16,33],tree:[10,16,28,34,40,58],trg:58,trg_dict:33,trg_dict_path:33,trg_embed:33,trg_id:33,trg_ids_next:33,triain:2,tricki:24,trivial:3,trn:53,truck:50,true_imag:25,true_label:25,true_read:25,truth:[9,10,16,53,58],tst:53,tune:[7,15,36,53,55,58],tuninglog_barrier_abstract:39,tupl:[3,8,10,11,16,20,25],ture:[10,16],turn:[10,25,49],tutori:[33,34,35,37,38,43,44,45,46,47,51,53],tweet:57,twelv:58,twitter:57,two:[2,3,10,11,16,17,23,25,26,33,37,38,42,43,48,49,50,51,53,55,56,57,58],txt:[3,35,38,43,53,55,57],type:[3,8,9,10,11,12,16,17,19,20,22,23,24,25,26,33,35,40,42,43,44,50,51,53,55,56],type_nam:[10,55],typedef:24,typic:[5,9,37,57],ubuntu:30,ubyt:25,uci:20,ufldl:[10,16],uid:44,uint64:24,uint64_t:24,unbalanc:40,unbound:33,unconstrain:57,under:[26,27,43,54,57],underli:26,understand:[28,37,48,50,57],understudi:58,undeterminist:37,unemploi:54,unexist:56,uniform:[7,10,15,16,20,25,40,49],uniqu:[23,34,40,43],unique_ptr:35,unit:[10,11,16,17,26,27,28,33,34,56],unittestcheckgrad_ep:39,univ:58,unix:38,unk:[48,58],unk_idx:[53,56],unknown:[10,16],unlabel:57,unlik:[56,57,58],unseg:[10,16],unsup:57,unsupbow:57,until:[38,43,56],unus:55,unzip:55,updat:[7,10,12,15,16,27,35,38,40,42,57],updatecallback:35,updatestack:43,upon:[0,56],upstream:34,uri:43,url:[30,57],urls_neg:57,urls_po:57,urls_unsup:57,usag:[2,3,9,10,11,16,17,20,22,26,37,48,49,55],use:[0,2,3,5,7,8,9,10,11,12,15,16,17,19,20,23,26,27,28,29,30,33,34,35,37,38,40,42,43,44,48,49,50,51,53,54,55,56,57,58],use_global_stat:[10,16],use_gpu:[39,40,42,44,49,50,51,53,55,56,57,58],use_jpeg:50,use_old_updat:[39,40],use_seq:[26,55],use_seq_or_not:55,used:[2,3,5,9,10,11,12,16,17,19,20,23,25,26,29,30,33,35,37,38,39,40,42,43,48,50,51,53,55,56,57,58],useful:[2,3,10,11,17,33,35,42,53,56,57],usegpu:[35,49],useless:38,user:[2,3,7,9,10,11,15,16,17,20,22,23,25,26,28,34,38,39,40,43,51,53,56],user_featur:55,user_head:55,user_id:55,user_meta:55,user_nam:55,userid:54,usernam:34,uses:[3,33,34,35,40,43,50,51,53,55,58],using:[2,3,5,7,8,10,15,16,20,23,25,26,28,33,34,35,37,40,42,43,44,48,49,50,51,53,56,57],usr:[27,28,38,40,43],usrdict:48,usrmodel:48,usual:[10,16,20,26,27,28,37,40,42,43,57],utf:48,util:[5,27,33,35,37,50,55,57],v28:[10,16],valid:[25,43,51,57],valu:[3,5,7,9,10,12,15,16,19,20,22,26,33,35,40,42,43,49,50,51,56,57],value1:40,value2:40,value_rang:20,vanilla:33,vanish:57,vari:[37,43],variabl:[3,10,16,20,23,26,27,30,35,38,43,44,57],varianc:[10,16,51],vast:34,vector:[3,10,11,16,17,20,23,33,35,48,53,55,57,58],vectorenable_parallel_vector:39,verb:56,veri:[3,10,16,19,33,37,50,53,57],verifi:[34,35],versa:27,version:[10,11,16,17,27,28,30,35,37,38,39,40,43,44,48,50,54,56,57,58],versu:23,vertic:[10,16,51],vgg:[11,17,50],vgg_16_cifar:50,via:[25,27,37,38,43,53],vice:27,view:[10,16],vim:34,virtualenv:55,vision:50,visipedia:50,visual:[10,16,28,37],viterbi:56,voc_dim:53,vocab:57,volum:[28,44],volumemount:[43,44],volumn:43,voluntarili:54,vutbr:20,wai:[3,10,11,16,17,23,26,28,33,35,38,42,55,56,58],wait:[12,40],walk:[5,49],wall:56,want:[3,10,11,16,17,23,25,26,27,28,35,40,42,48,51,53,55,56,57],war:54,warn:[10,16],warp:[10,16,37],wbia:[43,51],web:28,websit:[50,53,56,57],wei:[56,57],weight:[9,10,11,12,16,17,33,35,40,42,50,51],weight_act:[11,17],weightlist:35,weights_:35,weights_t:35,welcom:[55,57],well:[35,40,43,50,53],west:43,western:54,wether:[10,16],what:[7,10,11,12,15,16,17,26,38,53,55],wheel:27,when:[2,3,7,9,10,12,15,16,20,30,33,34,35,37,40,42,43,44,48,49,50,56,57,58],whenev:55,where:[3,10,11,12,16,17,23,26,33,35,37,38,40,42,48,51,56,58],whether:[9,10,11,16,17,25,35,40,49,50,55,57,58],which:[0,2,3,5,9,10,11,12,16,17,20,23,25,26,30,33,35,37,38,40,42,43,49,50,51,53,54,55,56,57,58],whichev:49,whl:27,who:[48,51,54],whole:[3,9,20,24,43,44,53,54,55,58],whole_cont:55,whose:[3,20,33,55,56],why:[11,17],wide:56,width:[9,10,16,20,24,25,35,50,58],wiki:[10,16],wikipedia:[10,16],wilder:3,window:[10,16,19,28,57],wise:[10,16],with_avx:28,with_avxcompil:27,with_doccompil:27,with_doubl:35,with_doublecompil:27,with_dsocompil:27,with_gpucompil:27,with_profil:37,with_profilercompil:27,with_pythoncompil:27,with_rdmacompil:27,with_style_checkcompil:27,with_swig_pycompil:27,with_testingcompil:27,with_tim:37,with_timercompil:27,within:[10,26],without:[9,10,16,25,38,57],wmt14:58,wmt14_data:58,wmt14_model:58,wmt:58,woboq:28,won:[37,51],wonder:3,word:[3,9,10,20,33,42,52,55,56,57,58],word_dict:[53,56],word_dim:53,word_id:3,word_slot:56,word_vector:53,word_vector_dim:[33,48],words_freq_sort:20,work:[3,5,20,23,25,27,28,33,34,35,37,38,40,43,44,53,55],worker:43,workercount:43,workflow:[34,43],workspac:[40,55],worri:26,wors:49,would:[22,25,28,38,43,49,53,56],wouldn:28,wrap:56,wrapper:[11,17,37],writ:55,write:[3,20,23,25,33,34,36,38,43,50,55,56,58],writelin:26,writer:[23,54],written:[55,57],wrong:[3,25],wsize:43,wsj:56,www:[10,16,20,28,50,58],x64:27,xarg:[28,35],xgbe0:40,xgbe1:40,xiaojun:57,xrang:[25,26,35],xxbow:57,xxx:[23,28,51,58],xxxxxxxxx:43,xxxxxxxxxx:43,xxxxxxxxxxxxx:43,xxxxxxxxxxxxxxxxxxx:43,xzf:27,y_i:10,y_predict:26,yaml:[43,55],yann:20,year:54,yeild:50,yield:[3,20,23,25,26,33,53,55,56,57],you:[2,3,5,7,10,11,12,15,16,17,26,27,28,30,33,34,35,37,38,40,42,43,48,49,50,51,53,55,56,57,58],your:[3,10,16,23,27,28,35,37,38,42,43,53,57],your_access_key_id:43,your_secrete_access_kei:43,yum:27,yuyang18:[11,17,20,22],yyi:28,zachari:57,zeng:57,zero:[3,7,10,12,15,16,20,35,40,43,53],zhidao:48,zhou:[56,57],zip:54,zone:43,zxvf:43,zzz:28},titles:["ABOUT","API","Introduction","PyDataProvider2","API","Python Prediction","Activations","Parameter Attributes","DataSources","Evaluators","Layers","Networks","Optimizers","Poolings","Activation","Parameter Attribute","Layers","Networks","Optimizer","Pooling","Datasets","Model Configuration","Training and Inference","PaddlePaddle Design Doc","Paddle\u591a\u8bed\u8a00\u63a5\u53e3\u5b9e\u73b0","Python Data Reader Design Doc","Simple Linear Regression","Installing from Sources","PaddlePaddle in Docker Containers","Install and Build","Debian Package installation guide","GET STARTED","RNN Models","RNN Configuration","Contribute Code","Write New Layers","HOW TO","Tune GPU Performance","Run Distributed Training","Argument Outline","Detail Description","Set Command-line Parameters","Use Case","Distributed PaddlePaddle Training on AWS with Kubernetes","Paddle On Kubernetes","&lt;no title&gt;","&lt;no title&gt;","PaddlePaddle Documentation","Chinese Word Embedding Model Tutorial","Generative Adversarial Networks (GAN)","Image Classification Tutorial","Model Zoo - ImageNet","TUTORIALS","Quick Start","MovieLens Dataset","Regression MovieLens Ratting","Semantic Role labeling Tutorial","Sentiment Analysis Tutorial","Text generation Tutorial"],titleterms:{"\u4e0d\u4f7f\u7528":24,"\u4e0d\u4f7f\u7528swig\u8fd9\u79cd\u4ee3\u7801\u751f\u6210\u5668":24,"\u4e0d\u5bfc\u51fapaddle\u5185\u90e8\u7684\u7ed3\u6784\u4f53":24,"\u4e0d\u5f15\u7528\u5176\u4ed6\u52a8\u6001\u5e93":24,"\u4ec5\u4ec5\u4f7f\u7528void":24,"\u4f7f\u7528\u52a8\u6001\u5e93\u6765\u5206\u53d1paddl":24,"\u52a8\u6001\u5e93\u4e2d\u4e0d\u5d4c\u5165\u4efb\u4f55\u5176\u4ed6\u8bed\u8a00\u7684\u89e3\u91ca\u5668":24,"\u539f\u56e0":24,"\u539f\u56e0\u5217\u8868":24,"\u57fa\u672c\u8981\u6c42":24,"\u5bfc\u51fac":24,"\u6307\u9488\u4f5c\u4e3a\u7c7b\u578b\u7684\u53e5\u67c4":24,"\u7b26\u53f7":24,"\u7b80\u5355\u5b9e\u73b0":24,"\u7c7b":24,"\u800c\u662f\u624b\u5199\u591a\u8bed\u8a00\u7ed1\u5b9a":24,"\u80cc\u666f":24,"\u8fd9\u4e2a\u52a8\u6001\u5e93\u4f7f\u7528c99\u6807\u51c6\u7684\u5934\u6587\u4ef6\u5bfc\u51fa\u4e00\u4e9b\u51fd\u6570":24,"case":42,"class":35,"function":48,"new":35,"paddle\u52a8\u6001\u5e93\u4e2d":24,"paddle\u591a\u8bed\u8a00\u63a5\u53e3\u5b9e\u73b0":24,"return":25,AWS:43,Abs:14,DNS:43,EFS:43,For:44,KMS:43,Use:[42,44],Using:[28,34],about:0,absactiv:6,access:43,account:43,activ:[6,14],adadelta:18,adadeltaoptim:12,adagrad:18,adagradoptim:12,adam:18,adamax:18,adamaxoptim:12,adamoptim:12,add:43,address:43,addto:16,addto_lay:10,adversari:49,aggreg:[10,16],algorithm:53,analysi:57,api:[1,4],appendix:53,applic:4,approach:37,architectur:[33,53],argument:[25,39,42,53],asset:43,associ:43,async:40,attent:33,attribut:[7,15],auc_evalu:9,avg:19,avgpool:13,avx:28,aws:43,background:26,base:[9,10],baseactiv:6,basepool:19,basepoolingtyp:13,basesgdoptim:12,batch:25,batch_norm:16,batch_norm_lay:10,batch_siz:25,beam_search:[10,16],between:23,bidirect:57,bidirectional_lstm:[11,17],bilinear_interp:16,bilinear_interp_lay:10,bleu:58,block_expand:16,block_expand_lay:10,book:28,brelu:14,breluactiv:6,bucket:43,build:[27,29,44],built:37,cach:3,cento:27,check:[10,16,35,38],chines:48,choos:43,chunk_evalu:9,cifar:20,classif:[9,50],classification_error_evalu:9,classification_error_printer_evalu:9,clone:34,cloudform:43,cluster:[38,42,43],code:34,column_sum_evalu:9,command:[41,42,53,58],commit:[34,44],common:40,commun:40,compos:25,concat:16,concat_lay:10,concept:43,config:[4,42,55,56],configur:[21,33,36,38,43,53,55],conll05:20,connect:[10,16],contain:[28,44],content:[37,43],context_project:[10,16],contribut:34,conv:[10,16],conv_oper:[10,16],conv_project:[10,16],conv_shift:16,conv_shift_lay:10,convolut:[50,53],core:43,cos_sim:[10,16],cost:[10,16],cpu:[28,42],creat:[25,34,43,44],creator:25,credenti:43,credit:0,crf:16,crf_decod:16,crf_decoding_lay:10,crf_layer:10,cross_entropi:10,cross_entropy_cost:16,cross_entropy_with_selfnorm:10,cross_entropy_with_selfnorm_cost:16,ctc:16,ctc_error_evalu:9,ctc_layer:10,cudnnavg:19,cudnnmax:19,custom:25,dat:54,data:[10,16,20,25,26,33,43,44,48,49,50,53,55,56,57,58],data_lay:10,datafeed:20,dataprovid:[3,4,40],dataset:[20,54,55,58],datasourc:8,datatyp:20,date:34,debian:30,decayedadagrad:18,decayedadagradoptim:12,decor:25,defin:[43,53,57,58],delet:43,delv:50,demo:43,depend:27,deriv:35,descript:[40,49,54,56],design:[23,25],destroi:43,detail:[40,50],develop:[28,36],devic:42,dictionari:[25,48],differ:42,directori:43,distribut:[23,38,40,43],doc:[23,25],docker:[28,44],document:[28,47],dotmul_oper:[10,16],dotmul_project:[10,16],down:43,download:[27,43,44,48,51,55,58],dropout_lay:[11,17],ec2:43,elast:43,embed:[16,48,53],embedding_lay:10,entri:25,eos:16,eos_lay:10,equat:35,evalu:[9,26,55],evalutaion:58,event:[22,23],exampl:[23,48,49],exercis:50,exp:14,expactiv:6,expand:16,expand_lay:10,extern:43,extract:[48,51,55,58],fc_layer:10,featur:[51,54,55,56],field:55,file:[43,44,53,54,55],find:43,first_seq:[10,16],fork:34,format:53,from:[23,27,29],full_matrix_project:[10,16],fulli:[10,16],gan:49,gate:33,gener:[33,49,58],get:[31,44],get_output:16,get_output_lay:10,github:34,gpu:[28,37,40,42],gradient:35,gradient_printer_evalu:9,group:[10,16,43],gru:[11,17,40],gru_group:[11,17],gru_step:16,gru_step_lay:10,gru_unit:[11,17],grumemori:[10,16],guid:30,hand:37,handler:[23,24],hook:34,how:[25,36,37],hsigmoid:[10,16],huber_cost:[10,16],iam:43,ident:14,identity_project:[10,16],identityactiv:6,imag:[10,11,16,17,28,44,50],imagenet:51,imdb:[20,57],img_cmrnorm:16,img_cmrnorm_lay:10,img_conv:16,img_conv_bn_pool:[11,17],img_conv_group:[11,17],img_conv_lay:10,img_pool:16,img_pool_lay:10,imikolov:20,implement:[25,35,49],infer:[22,53],info:51,ingredi:23,init_hook:3,initi:[42,43],input_typ:3,inspect:43,instal:[27,29,30,43,53],instanc:43,integr:43,interfac:[20,25,51],interpol:16,interpolation_lay:10,introduct:[2,48,51,57,58],isn:25,job:[38,43,44],join:[10,16],keep:34,kei:43,kill:38,kube:43,kubectl:43,kubernet:[43,44],label:56,lambda_cost:[10,16],last_seq:[10,16],lastest:34,launch:38,layer:[10,16,23,35,42],layeroutput:10,layertyp:10,line:[41,53],linear:[14,26],linear_comb:16,linear_comb_lay:10,linearactiv:6,list:25,local:[42,43],log:[14,53],logactiv:6,logist:53,lstm:[11,17,40,56,57],lstm_step:16,lstm_step_lay:10,lstmemori:[10,16],lstmemory_group:[11,17],lstmemory_unit:[11,17],map:25,math:[10,16],matrix:40,max:19,maxframe_printer_evalu:9,maxid:16,maxid_lay:10,maxid_printer_evalu:9,maxout:16,maxout_lay:10,maxpool:13,memori:[10,16],meta:55,mini:25,minibatch:20,misc:[11,17],mix:[10,16,42],mixed_lay:10,mnist:[20,49],model:[3,4,21,23,26,32,33,38,42,48,49,50,51,52,53,58],modifi:44,momentum:18,momentumoptim:12,movi:[54,55],movielen:[20,54,55],mse_cost:10,multi_binary_label_cross_entropi:10,multi_binary_label_cross_entropy_cost:16,multipl:25,name:43,nce:16,nce_lay:10,need:[25,37],network:[11,17,33,42,49,50,51,53,55,56],neural:[33,50,53,55,56],neuralnetwork:26,nlp:[11,17,40],non:[3,28],norm:[10,16],nvprof:37,nvvp:37,object:55,observ:[48,51],onli:[25,28],optim:[12,18,36,53],option:[27,48],outlin:39,output:[11,38,43],overview:53,packag:30,pad:16,pad_lay:10,paddl:[25,44],paddlepaddl:[23,28,29,43,47,48,58],pair:43,parallel_nn:42,paramet:[7,15,22,23,40,41,43,48,51],paraphras:48,pass:42,perform:[37,40],pnpair_evalu:9,point:43,pool:[10,13,16,19],pooling_lay:10,power:16,power_lay:10,pre:34,precision_recall_evalu:9,predict:[5,50,51,55,56,57],prefetch:25,prepar:[26,33,38,43,48,49,50,55,57,58],preprocess:[48,50,53,55,58],prerequisit:38,pretrain:[48,58],print:9,privat:43,problem:26,profil:37,provid:[3,25,53,55,56],pull:34,push:34,pydataprovider2:3,python:[5,25,35,51,53,55],quick:53,randomnumb:40,rank:9,rank_cost:[10,16],rat:55,rate:54,reader:[20,23,25],recurr:[10,11,16,17,33,53],recurrent_group:[10,16],recurrent_lay:10,refer:[3,37,56,57],region:43,regress:[26,53,55],relu:14,reluactiv:6,render:43,repeat:16,repeat_lay:10,request:34,requir:[27,34],reshap:[10,16],resnet:51,result:[38,44,58],revis:[34,48],rmsprop:18,rmspropoptim:12,rnn:[32,33,40],role:56,rotat:16,rotate_lay:10,route53:43,run:[38,44,56],sampl:[10,16],sampling_id:16,sampling_id_lay:10,scale:16,scaling_lay:10,scaling_project:[10,16],script:44,secur:43,selective_fc:16,selective_fc_lay:10,semant:56,sentiment:[20,57],seq_concat:16,seq_concat_lay:10,seq_reshap:16,seq_reshape_lay:10,seqtext_printer_evalu:9,sequenc:33,sequence_conv_pool:[11,17],sequencesoftmax:14,sequencesoftmaxactiv:6,sequenti:3,server:[40,43],servic:43,set:[12,41],setup:[27,43],sgd:40,share:23,shuffl:25,sigmoid:14,sigmoidactiv:6,simpl:[26,33],simple_attent:[11,17],simple_gru:[11,17],simple_img_conv_pool:[11,17],simple_lstm:[11,17],singl:25,slice:[10,16],slope_intercept:16,slope_intercept_lay:10,softmax:14,softmaxactiv:6,softrelu:14,softreluactiv:6,sourc:[27,29],span:27,spars:42,specifi:[42,48],split:55,spp:16,spp_layer:10,squar:14,squareactiv:6,squarerootn:19,squarerootnpool:13,stack:57,standard:53,stanh:14,stanhactiv:6,start:[23,31,43,44,53],startup:44,structur:49,suffici:25,sum:19,sum_cost:[10,16],sum_evalu:9,sum_to_one_norm:16,sum_to_one_norm_lay:10,summar:23,summari:53,sumpool:13,system:43,table_project:[10,16],take:25,tanh:14,tanhactiv:6,tear:43,templat:43,tensor:16,tensor_lay:10,test:[35,40,42,55,56,57],text:58,text_conv_pool:[11,17],timer:37,tip:37,toi:49,tool:37,train:[22,23,25,26,38,40,42,43,44,48,49,50,53,55,56,57,58],trainer:[22,43,55],tran:16,trans_full_matrix_project:[10,16],trans_lay:10,transfer:53,tune:[37,40],tutori:[48,50,52,56,57,58],ubuntu:27,uci_h:20,unit:[35,40],updat:[23,34,43],usag:[25,28,36],use:25,user:[48,54,55,57,58],util:9,value_printer_evalu:9,vector:40,verifi:43,version:34,vgg_16_network:[11,17],visual:51,volum:43,vpc:43,warp_ctc:16,warp_ctc_lay:10,what:37,why:[25,37],wmt14:20,word:[48,53],workflow:58,workspac:38,wrapper:35,write:[35,53],yaml:44,your:34,zoo:[51,52]}})
\ No newline at end of file \ No newline at end of file
develop/doc_cn/_sources/design/multi_language_interface/why_plain_c.md.txt 0 → 100644
浏览文件 @ aa789fc3
# Paddle多语言接口实现
## 背景
Paddle需要一个多语言接口，这个接口需要做到:
* 有标准的，良好的文档
* 例如Python可以使用[Sphinx](http://www.sphinx-doc.org/en/stable/)生成API文档，golang可以使用[GoDoc](https://godoc.org/golang.org/x/tools/cmd/godoc)生成文档。这都需要这个接口按照约定俗成的规则来注释完备。
* 不同语言的接口适应不同语言的特性
* 例如Java与Python的错误处理是直接扔出来Exception，而对于golang错误处理应该使用返回值。
## 基本要求
Paddle的多语言接口实现包括一下几个方面:
* 我们使用动态库来分发Paddle。在这个动态库中不嵌入任何其他语言的解释器，也不使用其他动态库。
* 这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号。
* 不导出Paddle内部的结构体、类，仅仅使用`void*`指针作为类型的句柄(handler)。
* 不使用SWIG这种代码生成器，而是手写多语言绑定。
## 原因
### 使用动态库来分发Paddle
* Paddle的链接方式比较复杂
* 如果用户要把Paddle的静态库（libpaddle.a）链接到自己的程序里，得使用 `--whole-archive` (for GCC) 或者 `--force_load` (for Clang) 参数，来确保把 libpaddle.a 里所有的符号都写入自己的程序的二进制文件里。这是因为 Paddle 的源码里使用了[object factory design pattern](http://stackoverflow.com/a/1310326/724872)。
* 编译型语言，例如C/C++使用静态库和动态库难度差不多。但是解释性语言，例如[Python](http://stackoverflow.com/questions/19560594/how-to-import-static-library-in-python)或者[Java](http://stackoverflow.com/questions/24493337/linking-static-library-with-jni)，只能调用Paddle的动态库，否则得把Paddle静态库链接到解释器里。
* 解释性语言实际运行的二进制是解释器本身，如果调用静态库只能将静态库与解释器链接。例如对于Java来说，便是将静态库加入JVM中。这对于通常的Java的开发者来说，是不常见的做法。
### 动态库中不嵌入任何其他语言的解释器
* 目前Paddle的进程模型是C++内部驱动Python解释器进行模型配置解析和数据读取
* 我们最终的动态库中不嵌入Python或者其他任何语言的解释器。模型配置解析，数据读取均交由其他语言完成
现阶段Paddle有一个问题是，Paddle内嵌的Python解释器和外部使用的Python如果版本不同，会直接报错退出。
### Paddle动态库中，不引用其他动态库
* 即这个动态库是不依赖于其他任何文件的，可以在任何机器上执行的。
### 这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号
* 由于C++编译器没有[名字修饰](https://en.wikipedia.org/wiki/Name_mangling#C.2B.2B)的规范，不同版本的编译器之间，对于同一段C++代码生成的符号可能不一致。而多语言接口需要直接读取生成的二进制(动态库)，需要有稳定的导出符号。
* C语言是有导出符号的标准的，并且在常见的平台上，都是ABI调用标准的。
* 大多数语言都支持使用C语言API
* 使用C99而不使用C89，是因为C99支持[Fixed-width integer types](https://en.wikipedia.org/wiki/C_data_types#Fixed-width_integer_types)和[Boolean type](https://en.wikipedia.org/wiki/C_data_types#Boolean_type)。
* 使用C99而不使用C11的原因是，[C11](https://en.wikipedia.org/wiki/C11_(C_standard_revision))并没有Paddle特别需要的特性，且C99相对于C11使用更加广泛。
### 不导出Paddle内部的结构体、类，仅仅使用`void*`指针作为类型的句柄(handler)
* Paddle内部的类为C++书写，直接导出到C的接口比较困难。
* 在C-API中使用`void*`来表示Paddle内部类。再在每一个API中自己检查类型。
在C的头文件 `paddle_matrix.h` 中:
```C
typedef void* paddle_matrix;
typedef int paddle_error;
extern "C"
paddle_error paddle_matrix_shape(paddle_matrix matrix,
uint64_t* width,
uint64_t* height);
```
而在CPP里面实现这个C的接口，文件 `paddle_matrix.cpp`
```cpp
#include "paddle/math/matrix.hpp"
extern "C"
paddle_error paddle_matrix_shape(paddle_matrix matrix,
uint64_t *width,
uint64_t *height) {
auto m = (paddle::math::matrix*)(matrix);
*width = m->width();
*height = m->height();
}
```
其中`paddle/math/matrix.hpp`文件内容为:
```cpp
namespace paddle {
namespace math {
class Matrix {
//...
};
} // namespace math
} // namespace paddle
```
### 不使用SWIG这种代码生成器，而是手写多语言绑定
* [SWIG](http://www.swig.org/)是一个多语言接口的代码生成器。他的目标是使用C/C++写代码，SWIG直接读取C/C++的头文件，生成各种语言的绑定代码。
* 对于多语言接口，SWIG需要写一个interface文件。这个文件具有独特的语法，学习成本高。且增加一个第三方语言，就需要对这个第三方语言增加一些定义。有的时候，interface文件的写法非常[tricky](https://github.com/PaddlePaddle/Paddle/blob/develop/paddle/api/Paddle.swig#L36)。社区贡献代码学习成本高。
* SWIG暴露的接口保留了C++的接口样式，很难保证多语言代码风格的一致性。(函数命名，错误处理)
* 因为SWIG在第三方语言中暴露的函数名，类名和C++中完全一致。C++的命名风格并不能适应其他第三方语言。如果使用SWIG我们需要将在interface文件里，将大量的`SomeCppClass`重命名成`some_python_class`，或者`SomeGoTypes`。
* 对于不同语言，错误处理的方式也不尽相同。例如对于Java或者Python，最常见的错误处理方式是Exception，而对于Golang，错误处理方式是返回值。而SWIG只能简单的暴露C++接口，无法做到对于各种语言错误处理方式的适配。
* 对于大多数语言，直接使用C语言的.h并不困难。例如Python的[cffi](https://cffi.readthedocs.io/en/latest/overview.html#simple-example-abi-level-in-line)或者[Cython](http://cython.org/), golang的[cgo](https://golang.org/cmd/cgo/)。
* SWIG支持的语言或者解释器有局限。例如对于Python，使用SWIG只支持CPython解释器，而不支持PyPy解释器。
## 原因列表
| 结论 | 对比 | 原因 |
|---| --- | --- |
| 使用动态库 | 不使用静态库 | 解释型语言只能调用动态库，Paddle静态库链接复杂 |
| 不嵌入其他语言解释器 | 不嵌入Python解释器 | Paddle C++目前嵌入Python解释器，会导致不同版本Python在一个进程里的bug |
| 不引用其他动态库 | | Paddle一个动态库可以在任何Linux系统上运行 |
| 使用C99做接口 | 不使用C++做接口 | C有标准的ABI，C99是目前C最广泛的使用标准，且C99支持bool类型和定长整数(uint64_t等)类型 |
| 使用void*作为类句柄 | 不显示的写每个类具体包含什么| 实现简单，并且让接口脱离实现细节 |
| 手写多语言绑定 | 不使用SWIG | 使用SWIG需要多语言绑定的开发人员熟练掌握SWIG配置，社区参与困难。SWIG生成的代码不能保证多语言代码风格的一致性 |
## 简单实现
TBD
develop/doc_cn/design/multi_language_interface/why_plain_c.html 0 → 100644
浏览文件 @ aa789fc3
<!DOCTYPE html>
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Paddle多语言接口实现 &mdash; PaddlePaddle 文档</title>
<link rel="stylesheet" href="../../_static/css/theme.css" type="text/css" />
<link rel="index" title="索引"
href="../../genindex.html"/>
<link rel="search" title="搜索" href="../../search.html"/>
<link rel="top" title="PaddlePaddle 文档" href="../../index.html"/>
<link rel="stylesheet" href="https://cdn.jsdelivr.net/perfect-scrollbar/0.6.14/css/perfect-scrollbar.min.css" type="text/css" />
<link rel="stylesheet" href="../../_static/css/override.css" type="text/css" />
<script>
var _hmt = _hmt || [];
(function() {
var hm = document.createElement("script");
hm.src = "//hm.baidu.com/hm.js?b9a314ab40d04d805655aab1deee08ba";
var s = document.getElementsByTagName("script")[0];
s.parentNode.insertBefore(hm, s);
})();
</script>
<script src="../../_static/js/modernizr.min.js"></script>
</head>
<body class="wy-body-for-nav" role="document">
<header class="site-header">
<div class="site-logo">
<a href="/"><img src="../../_static/images/PP_w.png"></a>
</div>
<div class="site-nav-links">
<div class="site-menu">
<a class="fork-on-github" href="https://github.com/PaddlePaddle/Paddle" target="_blank"><i class="fa fa-github"></i>Folk me on Github</a>
<div class="language-switcher dropdown">
<a type="button" data-toggle="dropdown">
<span>English</span>
<i class="fa fa-angle-up"></i>
<i class="fa fa-angle-down"></i>
</a>
<ul class="dropdown-menu">
<li><a href="/doc_cn">中文</a></li>
<li><a href="/doc">English</a></li>
</ul>
</div>
<ul class="site-page-links">
<li><a>Home</a></li>
<li><a>Get Started</a></li>
<li class="active"><a>Documentation</a></li>
<li><a>About Us</a></li>
</ul>
</div>
<div class="doc-module">
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../getstarted/index_cn.html">新手入门</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../tutorials/index_cn.html">完整教程</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../howto/index_cn.html">进阶指南</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../api/index_cn.html">API</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../faq/index_cn.html">FAQ</a></li>
</ul>
<div role="search">
<form id="rtd-search-form" class="wy-form" action="../../search.html" method="get">
<input type="text" name="q" placeholder="Search docs" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
</div>
</div>
</div>
</header>
<div class="main-content-wrap">
<nav class="doc-menu-vertical" role="navigation">
<ul>
<li class="toctree-l1"><a class="reference internal" href="../../getstarted/index_cn.html">新手入门</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../getstarted/build_and_install/index_cn.html">安装与编译</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../getstarted/build_and_install/docker_install_cn.html">PaddlePaddle的Docker容器使用方式</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../getstarted/build_and_install/ubuntu_install_cn.html">Ubuntu部署PaddlePaddle</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../getstarted/build_and_install/cmake/build_from_source_cn.html">PaddlePaddle的编译选项</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../getstarted/basic_usage/index_cn.html">经典的线性回归任务</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../tutorials/index_cn.html">完整教程</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/quick_start/index_cn.html">快速入门</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/rec/ml_regression_cn.html">个性化推荐</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/image_classification/index_cn.html">图像分类</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/sentiment_analysis/index_cn.html">情感分析</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/semantic_role_labeling/index_cn.html">语义角色标注</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/text_generation/index_cn.html">机器翻译</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/imagenet_model/resnet_model_cn.html">ResNet模型</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../tutorials/embedding_model/index_cn.html">词向量模型</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../howto/index_cn.html">进阶指南</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/cmd_parameter/index_cn.html">设置命令行参数</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../howto/usage/cmd_parameter/use_case_cn.html">使用案例</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../howto/usage/cmd_parameter/arguments_cn.html">参数概述</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../howto/usage/cmd_parameter/detail_introduction_cn.html">细节描述</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/concepts/use_concepts_cn.html">基本使用概念</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/cluster/cluster_train_cn.html">运行分布式训练</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_basis_cn.html">Kubernetes 简介</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_basis_cn.html#kubernetes">部署Kubernetes集群</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_basis_cn.html#">选择存储方案</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_basis_cn.html#kubectl">配置kubectl</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_cn.html">Kubernetes单机训练</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/usage/k8s/k8s_distributed_cn.html">Kubernetes分布式训练</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/dev/write_docs_cn.html">如何贡献/修改文档</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/dev/contribute_to_paddle_cn.html">如何贡献代码</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/deep_model/rnn/index_cn.html">RNN相关模型</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../howto/deep_model/rnn/rnn_config_cn.html">RNN配置</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../howto/deep_model/rnn/recurrent_group_cn.html">Recurrent Group教程</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../howto/deep_model/rnn/hierarchical_layer_cn.html">支持双层序列作为输入的Layer</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../howto/deep_model/rnn/hrnn_rnn_api_compare_cn.html">单双层RNN API对比介绍</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../howto/optimization/gpu_profiling_cn.html">GPU性能分析与调优</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../api/index_cn.html">API</a><ul>
<li class="toctree-l2"><a class="reference internal" href="../../api/v2/model_configs.html">模型配置</a><ul>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/activation.html">Activation</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/layer.html">Layers</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/optimizer.html">Optimizer</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/pooling.html">Pooling</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/networks.html">Networks</a></li>
<li class="toctree-l3"><a class="reference internal" href="../../api/v2/config/attr.html">Parameter Attribute</a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="../../api/v2/data.html">数据访问</a></li>
<li class="toctree-l2"><a class="reference internal" href="../../api/v2/run_logic.html">训练与应用</a></li>
</ul>
</li>
<li class="toctree-l1"><a class="reference internal" href="../../faq/index_cn.html">FAQ</a></li>
</ul>
</nav>
<nav class="local-toc"><ul>
<li><a class="reference internal" href="#">Paddle多语言接口实现</a><ul>
<li><a class="reference internal" href="#">背景</a></li>
<li><a class="reference internal" href="#">基本要求</a></li>
<li><a class="reference internal" href="#">原因</a><ul>
<li><a class="reference internal" href="#paddle">使用动态库来分发Paddle</a></li>
<li><a class="reference internal" href="#">动态库中不嵌入任何其他语言的解释器</a></li>
<li><a class="reference internal" href="#paddle">Paddle动态库中，不引用其他动态库</a></li>
<li><a class="reference internal" href="#c99-c">这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号</a></li>
<li><a class="reference internal" href="#paddle-void-handler">不导出Paddle内部的结构体、类，仅仅使用<code class="docutils literal"><span class="pre">void*</span></code>指针作为类型的句柄(handler)</a></li>
<li><a class="reference internal" href="#swig">不使用SWIG这种代码生成器，而是手写多语言绑定</a></li>
</ul>
</li>
<li><a class="reference internal" href="#">原因列表</a></li>
<li><a class="reference internal" href="#">简单实现</a></li>
</ul>
</li>
</ul>
</nav>
<section class="doc-content-wrap">
<div role="navigation" aria-label="breadcrumbs navigation">
<ul class="wy-breadcrumbs">
<li>Paddle多语言接口实现</li>
</ul>
</div>
<div class="wy-nav-content" id="doc-content">
<div class="rst-content">
<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
<div itemprop="articleBody">
<div class="section" id="paddle">
<span id="paddle"></span><h1>Paddle多语言接口实现<a class="headerlink" href="#paddle" title="永久链接至标题"></a></h1>
<div class="section" id="">
<span id="id1"></span><h2>背景<a class="headerlink" href="#" title="永久链接至标题"></a></h2>
<p>Paddle需要一个多语言接口，这个接口需要做到:</p>
<ul class="simple">
<li>有标准的，良好的文档<ul>
<li>例如Python可以使用<a class="reference external" href="http://www.sphinx-doc.org/en/stable/">Sphinx</a>生成API文档，golang可以使用<a class="reference external" href="https://godoc.org/golang.org/x/tools/cmd/godoc">GoDoc</a>生成文档。这都需要这个接口按照约定俗成的规则来注释完备。</li>
</ul>
</li>
<li>不同语言的接口适应不同语言的特性<ul>
<li>例如Java与Python的错误处理是直接扔出来Exception，而对于golang错误处理应该使用返回值。</li>
</ul>
</li>
</ul>
</div>
<div class="section" id="">
<span id="id2"></span><h2>基本要求<a class="headerlink" href="#" title="永久链接至标题"></a></h2>
<p>Paddle的多语言接口实现包括一下几个方面:</p>
<ul class="simple">
<li>我们使用动态库来分发Paddle。在这个动态库中不嵌入任何其他语言的解释器，也不使用其他动态库。</li>
<li>这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号。</li>
<li>不导出Paddle内部的结构体、类，仅仅使用<code class="docutils literal"><span class="pre">void*</span></code>指针作为类型的句柄(handler)。</li>
<li>不使用SWIG这种代码生成器，而是手写多语言绑定。</li>
</ul>
</div>
<div class="section" id="">
<span id="id3"></span><h2>原因<a class="headerlink" href="#" title="永久链接至标题"></a></h2>
<div class="section" id="paddle">
<span id="id4"></span><h3>使用动态库来分发Paddle<a class="headerlink" href="#paddle" title="永久链接至标题"></a></h3>
<ul class="simple">
<li>Paddle的链接方式比较复杂<ul>
<li>如果用户要把Paddle的静态库（libpaddle.a）链接到自己的程序里，得使用 <code class="docutils literal"><span class="pre">--whole-archive</span></code> (for GCC) 或者 <code class="docutils literal"><span class="pre">--force_load</span></code> (for Clang) 参数，来确保把 libpaddle.a 里所有的符号都写入自己的程序的二进制文件里。这是因为 Paddle 的源码里使用了<a class="reference external" href="http://stackoverflow.com/a/1310326/724872">object factory design pattern</a>。</li>
</ul>
</li>
<li>编译型语言，例如C/C++使用静态库和动态库难度差不多。但是解释性语言，例如<a class="reference external" href="http://stackoverflow.com/questions/19560594/how-to-import-static-library-in-python">Python</a>或者<a class="reference external" href="http://stackoverflow.com/questions/24493337/linking-static-library-with-jni">Java</a>，只能调用Paddle的动态库，否则得把Paddle静态库链接到解释器里。<ul>
<li>解释性语言实际运行的二进制是解释器本身，如果调用静态库只能将静态库与解释器链接。例如对于Java来说，便是将静态库加入JVM中。这对于通常的Java的开发者来说，是不常见的做法。</li>
</ul>
</li>
</ul>
</div>
<div class="section" id="">
<span id="id5"></span><h3>动态库中不嵌入任何其他语言的解释器<a class="headerlink" href="#" title="永久链接至标题"></a></h3>
<ul class="simple">
<li>目前Paddle的进程模型是C++内部驱动Python解释器进行模型配置解析和数据读取</li>
<li>我们最终的动态库中不嵌入Python或者其他任何语言的解释器。模型配置解析，数据读取均交由其他语言完成</li>
</ul>
<p>现阶段Paddle有一个问题是，Paddle内嵌的Python解释器和外部使用的Python如果版本不同，会直接报错退出。</p>
</div>
<div class="section" id="paddle">
<span id="id6"></span><h3>Paddle动态库中，不引用其他动态库<a class="headerlink" href="#paddle" title="永久链接至标题"></a></h3>
<ul class="simple">
<li>即这个动态库是不依赖于其他任何文件的，可以在任何机器上执行的。</li>
</ul>
</div>
<div class="section" id="c99-c">
<span id="c99-c"></span><h3>这个动态库使用C99标准的头文件导出一些函数，不使用/导出C++符号<a class="headerlink" href="#c99-c" title="永久链接至标题"></a></h3>
<ul class="simple">
<li>由于C++编译器没有<a class="reference external" href="https://en.wikipedia.org/wiki/Name_mangling#C.2B.2B">名字修饰</a>的规范，不同版本的编译器之间，对于同一段C++代码生成的符号可能不一致。而多语言接口需要直接读取生成的二进制(动态库)，需要有稳定的导出符号。</li>
<li>C语言是有导出符号的标准的，并且在常见的平台上，都是ABI调用标准的。</li>
<li>大多数语言都支持使用C语言API</li>
<li>使用C99而不使用C89，是因为C99支持<a class="reference external" href="https://en.wikipedia.org/wiki/C_data_types#Fixed-width_integer_types">Fixed-width integer types</a>和<a class="reference external" href="https://en.wikipedia.org/wiki/C_data_types#Boolean_type">Boolean type</a>。</li>
<li>使用C99而不使用C11的原因是，<a class="reference external" href="https://en.wikipedia.org/wiki/C11_(C_standard_revision)">C11</a>并没有Paddle特别需要的特性，且C99相对于C11使用更加广泛。</li>
</ul>
</div>
<div class="section" id="paddle-void-handler">
<span id="paddle-void-handler"></span><h3>不导出Paddle内部的结构体、类，仅仅使用<code class="docutils literal"><span class="pre">void*</span></code>指针作为类型的句柄(handler)<a class="headerlink" href="#paddle-void-handler" title="永久链接至标题"></a></h3>
<ul class="simple">
<li>Paddle内部的类为C++书写，直接导出到C的接口比较困难。</li>
<li>在C-API中使用<code class="docutils literal"><span class="pre">void*</span></code>来表示Paddle内部类。再在每一个API中自己检查类型。</li>
</ul>
<p>在C的头文件 <code class="docutils literal"><span class="pre">paddle_matrix.h</span></code> 中:</p>
<div class="highlight-C"><div class="highlight"><pre><span></span><span class="k">typedef</span> <span class="kt">void</span><span class="o">*</span> <span class="n">paddle_matrix</span><span class="p">;</span>
<span class="k">typedef</span> <span class="kt">int</span> <span class="n">paddle_error</span><span class="p">;</span>
<span class="k">extern</span> <span class="s">&quot;C&quot;</span>
<span class="n">paddle_error</span> <span class="n">paddle_matrix_shape</span><span class="p">(</span><span class="n">paddle_matrix</span> <span class="n">matrix</span><span class="p">,</span>
<span class="kt">uint64_t</span><span class="o">*</span> <span class="n">width</span><span class="p">,</span>
<span class="kt">uint64_t</span><span class="o">*</span> <span class="n">height</span><span class="p">);</span>
</pre></div>
</div>
<p>而在CPP里面实现这个C的接口，文件 <code class="docutils literal"><span class="pre">paddle_matrix.cpp</span></code></p>
<div class="highlight-cpp"><div class="highlight"><pre><span></span><span class="cp">#include</span> <span class="cpf">&quot;paddle/math/matrix.hpp&quot;</span><span class="cp"></span>
<span class="k">extern</span> <span class="s">&quot;C&quot;</span>
<span class="n">paddle_error</span> <span class="n">paddle_matrix_shape</span><span class="p">(</span><span class="n">paddle_matrix</span> <span class="n">matrix</span><span class="p">,</span>
<span class="kt">uint64_t</span> <span class="o">*</span><span class="n">width</span><span class="p">,</span>
<span class="kt">uint64_t</span> <span class="o">*</span><span class="n">height</span><span class="p">)</span> <span class="p">{</span>
<span class="k">auto</span> <span class="n">m</span> <span class="o">=</span> <span class="p">(</span><span class="n">paddle</span><span class="o">::</span><span class="n">math</span><span class="o">::</span><span class="n">matrix</span><span class="o">*</span><span class="p">)(</span><span class="n">matrix</span><span class="p">);</span>
<span class="o">*</span><span class="n">width</span> <span class="o">=</span> <span class="n">m</span><span class="o">-&gt;</span><span class="n">width</span><span class="p">();</span>
<span class="o">*</span><span class="n">height</span> <span class="o">=</span> <span class="n">m</span><span class="o">-&gt;</span><span class="n">height</span><span class="p">();</span>
<span class="p">}</span>
</pre></div>
</div>
<p>其中<code class="docutils literal"><span class="pre">paddle/math/matrix.hpp</span></code>文件内容为:</p>
<div class="highlight-cpp"><div class="highlight"><pre><span></span><span class="k">namespace</span> <span class="n">paddle</span> <span class="p">{</span>
<span class="k">namespace</span> <span class="n">math</span> <span class="p">{</span>
<span class="k">class</span> <span class="nc">Matrix</span> <span class="p">{</span>
<span class="c1">//...</span>
<span class="p">};</span>
<span class="p">}</span> <span class="c1">// namespace math</span>
<span class="p">}</span> <span class="c1">// namespace paddle</span>
</pre></div>
</div>
</div>
<div class="section" id="swig">
<span id="swig"></span><h3>不使用SWIG这种代码生成器，而是手写多语言绑定<a class="headerlink" href="#swig" title="永久链接至标题"></a></h3>
<ul class="simple">
<li><a class="reference external" href="http://www.swig.org/">SWIG</a>是一个多语言接口的代码生成器。他的目标是使用C/C++写代码，SWIG直接读取C/C++的头文件，生成各种语言的绑定代码。<ul>
<li>对于多语言接口，SWIG需要写一个interface文件。这个文件具有独特的语法，学习成本高。且增加一个第三方语言，就需要对这个第三方语言增加一些定义。有的时候，interface文件的写法非常<a class="reference external" href="https://github.com/PaddlePaddle/Paddle/blob/develop/paddle/api/Paddle.swig#L36">tricky</a>。社区贡献代码学习成本高。</li>
<li>SWIG暴露的接口保留了C++的接口样式，很难保证多语言代码风格的一致性。(函数命名，错误处理)<ul>
<li>因为SWIG在第三方语言中暴露的函数名，类名和C++中完全一致。C++的命名风格并不能适应其他第三方语言。如果使用SWIG我们需要将在interface文件里，将大量的<code class="docutils literal"><span class="pre">SomeCppClass</span></code>重命名成<code class="docutils literal"><span class="pre">some_python_class</span></code>，或者<code class="docutils literal"><span class="pre">SomeGoTypes</span></code>。</li>
<li>对于不同语言，错误处理的方式也不尽相同。例如对于Java或者Python，最常见的错误处理方式是Exception，而对于Golang，错误处理方式是返回值。而SWIG只能简单的暴露C++接口，无法做到对于各种语言错误处理方式的适配。</li>
</ul>
</li>
<li>对于大多数语言，直接使用C语言的.h并不困难。例如Python的<a class="reference external" href="https://cffi.readthedocs.io/en/latest/overview.html#simple-example-abi-level-in-line">cffi</a>或者<a class="reference external" href="http://cython.org/">Cython</a>, golang的<a class="reference external" href="https://golang.org/cmd/cgo/">cgo</a>。</li>
<li>SWIG支持的语言或者解释器有局限。例如对于Python，使用SWIG只支持CPython解释器，而不支持PyPy解释器。</li>
</ul>
</li>
</ul>
</div>
</div>
<div class="section" id="">
<span id="id7"></span><h2>原因列表<a class="headerlink" href="#" title="永久链接至标题"></a></h2>
<p>| 结论 | 对比 | 原因 |
|&#8212;| &#8212; | &#8212; |
| 使用动态库 | 不使用静态库 | 解释型语言只能调用动态库，Paddle静态库链接复杂 |
| 不嵌入其他语言解释器 | 不嵌入Python解释器 | Paddle C++目前嵌入Python解释器，会导致不同版本Python在一个进程里的bug |
| 不引用其他动态库 | | Paddle一个动态库可以在任何Linux系统上运行 |
| 使用C99做接口 | 不使用C++做接口 | C有标准的ABI，C99是目前C最广泛的使用标准，且C99支持bool类型和定长整数(uint64_t等)类型 |
| 使用void*作为类句柄 | 不显示的写每个类具体包含什么| 实现简单，并且让接口脱离实现细节 |
| 手写多语言绑定 | 不使用SWIG | 使用SWIG需要多语言绑定的开发人员熟练掌握SWIG配置，社区参与困难。SWIG生成的代码不能保证多语言代码风格的一致性 |</p>
</div>
<div class="section" id="">
<span id="id8"></span><h2>简单实现<a class="headerlink" href="#" title="永久链接至标题"></a></h2>
<p>TBD</p>
</div>
</div>
</div>
</div>
<footer>
<hr/>
<div role="contentinfo">
<p>
&copy; Copyright 2016, PaddlePaddle developers.
</p>
</div>
Built with <a href="http://sphinx-doc.org/">Sphinx</a> using a <a href="https://github.com/snide/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>.
</footer>
</div>
</div>
</section>
</div>
<script type="text/javascript">
var DOCUMENTATION_OPTIONS = {
URL_ROOT:'../../',
VERSION:'',
COLLAPSE_INDEX:false,
FILE_SUFFIX:'.html',
HAS_SOURCE: true
};
</script>
<script type="text/javascript" src="../../_static/jquery.js"></script>
<script type="text/javascript" src="../../_static/underscore.js"></script>
<script type="text/javascript" src="../../_static/doctools.js"></script>
<script type="text/javascript" src="../../_static/translations.js"></script>
<script type="text/javascript" src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML"></script>
<script type="text/javascript" src="../../_static/js/theme.js"></script>
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js" integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script>
<script src="https://cdn.jsdelivr.net/perfect-scrollbar/0.6.14/js/perfect-scrollbar.jquery.min.js"></script>
<script src="../../_static/js/paddle_doc_init.js"></script>
</body>
</html>
\ No newline at end of file
develop/doc_cn/searchindex.js
浏览文件 @ aa789fc3
因为 它太大了无法显示 source diff 。你可以改为 查看blob。
Markdown is supported
0% 或 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑！
想要评论请 注册 或