Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
s920243400
PaddleDetection
提交
06930531
P
PaddleDetection
项目概览
s920243400
/
PaddleDetection
与 Fork 源项目一致
Fork自
PaddlePaddle / PaddleDetection
通知
2
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
PaddleDetection
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
提交
06930531
编写于
12月 11, 2018
作者:
D
dongdaxiang
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
add liscence
上级
7bd16e3a
变更
5
隐藏空白更改
内联
并排
Showing
5 changed file
with
55 addition
and
12 deletion
+55
-12
python/paddle/fluid/async_executor.py
python/paddle/fluid/async_executor.py
+2
-1
python/paddle/fluid/distributed/downpour.py
python/paddle/fluid/distributed/downpour.py
+13
-0
python/paddle/fluid/distributed/helper.py
python/paddle/fluid/distributed/helper.py
+14
-0
python/paddle/fluid/distributed/node.py
python/paddle/fluid/distributed/node.py
+13
-0
python/paddle/fluid/distributed/ps_instance.py
python/paddle/fluid/distributed/ps_instance.py
+13
-11
未找到文件。
python/paddle/fluid/async_executor.py
浏览文件 @
06930531
...
...
@@ -76,7 +76,7 @@ class AsyncExecutor(object):
Note: Only running on CPUPlace supported.
"""
def
__init__
(
self
,
place
=
None
):
def
__init__
(
self
,
place
=
None
,
run_mode
=
""
):
if
place
is
None
:
place
=
core
.
CPUPlace
()
if
not
isinstance
(
place
,
core
.
CPUPlace
):
...
...
@@ -89,6 +89,7 @@ class AsyncExecutor(object):
self
.
executor
=
core
.
AsyncExecutor
(
scope
,
p
)
self
.
instance
=
None
def
run
(
self
,
program
,
data_feed
,
filelist
,
thread_num
,
fetch
,
mode
=
""
,
debug
=
False
):
"""
Run program by this AsyncExecutor. Training dataset will be in filelist.
...
...
python/paddle/fluid/distributed/downpour.py
浏览文件 @
06930531
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
from
.node
import
DownpourServer
from
.node
import
DownpourWorker
from
..backward
import
append_backward
...
...
python/paddle/fluid/distributed/helper.py
浏览文件 @
06930531
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
from
mpi4py
import
MPI
import
ps_pb2
as
pslib
...
...
python/paddle/fluid/distributed/node.py
浏览文件 @
06930531
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
import
ps_pb2
as
pslib
class
Server
(
object
):
...
...
python/paddle/fluid/distributed/ps_instance.py
浏览文件 @
06930531
#import paddle.fluid.distributed.helper as dist_helper
# Copyright (c) 2018 PaddlePaddle Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
import
helper
as
dist_helper
import
sys
#from mpi4py import MPI
class
PaddlePSInstance
(
object
):
def
__init__
(
self
,
server_worker_mode
,
proc_per_node
):
...
...
@@ -83,17 +93,11 @@ class PaddlePSInstance(object):
return
self
.
_nodes
def
barrier_all
(
self
):
#print self._rankid, "begin"
#sys.stdout.flush()
self
.
dh
.
comm
.
barrier
()
#print self._rankid, "end"
def
barrier_worker
(
self
):
if
self
.
is_worker
():
#print "worker: ", self._rankid, "begin"
#sys.stdout.flush()
self
.
_comm
.
barrier
()
#print "worker: ", self._rankid, "end"
pass
def
finalize
(
self
):
...
...
@@ -104,5 +108,3 @@ class PaddlePSInstance(object):
if
__name__
==
"__main__"
:
instance
=
PaddlePSInstance
(
1
,
1
,
2
,
50
)
instance
.
barrier_all
()
#print "-----"
#instance.barrier_worker()
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录