未验证 提交 f2f3f6e7 编写于 作者: Z ziyoujiyi 提交者: GitHub

Fl-PS bug fix (#45413)

* back fl

* delete ssl cert

* .

* make warning

* .

* unittest paral degree

* solve unittest

* heter & multi cloud commm ready

* .

* .

* fl-ps v1.0

* .

* support N + N mode

* .

* .

* .

* .

* delete print

* .

* .

* .

* .

* fix bug

* .

* .

* fl-ps with coordinator ready

* merge dev

* update message parse only

* update fl client scheduler

* fix bug

* update multithreads sync

* fix ci errors

* update role_maker.py

* update role_maker.py

* fix ci error: windows py import error

* fix ci error: windows py import error

* fix windows ci pylib import error

* add dump fields & params

* try to fix windows import fleet error

* fix ps FLAGS error

* fix logging risk

* fix logging possible risk

* write trainer_desc file

* support split sparse params in local & remote

* fix import paddle.fluid.core.PSGPU

* fix import paddle.fluid.core.PSGPU

* add remote_sparse & local_sparse config

* fix unittest

* fix test_dist_fleet_geo table error

* fix PADDLE_ENFORCE error

* fix other's pr conflict

* forbidden ssd table

* .

* recover ssd table code

* recover file mode
上级 a410c397
...@@ -637,7 +637,6 @@ class SparseTable(Table): ...@@ -637,7 +637,6 @@ class SparseTable(Table):
check_embedding_dim(table_proto.accessor, self.common.table_name, check_embedding_dim(table_proto.accessor, self.common.table_name,
ctx.program_id(), self.context) ctx.program_id(), self.context)
print(">>> set sparse table!")
self.common.parse_by_optimizer(ctx, self.context) self.common.parse_by_optimizer(ctx, self.context)
self.common.parse_entry(self.common.table_name, ctx.program_id(), self.common.parse_entry(self.common.table_name, ctx.program_id(),
self.context) self.context)
...@@ -806,6 +805,9 @@ class PsDescBuilder(object): ...@@ -806,6 +805,9 @@ class PsDescBuilder(object):
not self.context['local_sparse']): not self.context['local_sparse']):
tables.append(globals()['GeoSparseTable'](self.context, tables.append(globals()['GeoSparseTable'](self.context,
ctx)) ctx))
else:
tables.append(globals()['SparseTable'](self.context,
ctx))
else: else:
tables.append(globals()['SparseTable'](self.context, ctx)) tables.append(globals()['SparseTable'](self.context, ctx))
else: else:
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册