1. 12 11月, 2021 21 次提交
    • W
      add_fc_convert_layers_name (#37157) · a76b77a5
      Wangzheee 提交于
      a76b77a5
    • S
      reduce graph-engine cache memory (#37155) · f584d378
      seemingwang 提交于
      * graph engine demo
      
      * upload unsaved changes
      
      * fix dependency error
      
      * fix shard_num problem
      
      * py client
      
      * remove lock and graph-type
      
      * add load direct graph
      
      * add load direct graph
      
      * add load direct graph
      
      * batch random_sample
      
      * batch_sample_k
      
      * fix num_nodes size
      
      * batch brpc
      
      * batch brpc
      
      * add test
      
      * add test
      
      * add load_nodes; change add_node function
      
      * change sample return type to pair
      
      * resolve conflict
      
      * resolved conflict
      
      * resolved conflict
      
      * separate server and client
      
      * merge pair type
      
      * fix
      
      * resolved conflict
      
      * fixed segment fault; high-level VLOG for load edges and load nodes
      
      * random_sample return 0
      
      * rm useless loop
      
      * test:load edge
      
      * fix ret -1
      
      * test: rm sample
      
      * rm sample
      
      * random_sample return future
      
      * random_sample return int
      
      * test fake node
      
      * fixed here
      
      * memory leak
      
      * remove test code
      
      * fix return problem
      
      * add common_graph_table
      
      * random sample node &test & change data-structure from linkedList to vector
      
      * add common_graph_table
      
      * sample with srand
      
      * add node_types
      
      * optimize nodes sample
      
      * recover test
      
      * random sample
      
      * destruct weighted sampler
      
      * GraphEdgeBlob
      
      * WeightedGraphEdgeBlob to GraphEdgeBlob
      
      * WeightedGraphEdgeBlob to GraphEdgeBlob
      
      * pybind sample nodes api
      
      * pull nodes with step
      
      * fixed pull_graph_list bug; add test for pull_graph_list by step
      
      * add graph table;name
      
      * add graph table;name
      
      * add pybind
      
      * add pybind
      
      * add FeatureNode
      
      * add FeatureNode
      
      * add FeatureNode Serialize
      
      * add FeatureNode Serialize
      
      * get_feat_node
      
      * avoid local rpc
      
      * fix get_node_feat
      
      * fix get_node_feat
      
      * remove log
      
      * get_node_feat return  py:bytes
      
      * merge develop with graph_engine
      
      * fix threadpool.h head
      
      * fix
      
      * fix typo
      
      * resolve conflict
      
      * fix conflict
      
      * recover lost content
      
      * fix pybind of FeatureNode
      
      * recover cmake
      
      * recover tools
      
      * resolve conflict
      
      * resolve linking problem
      
      * code style
      
      * change test_server port
      
      * fix code problems
      
      * remove shard_num config
      
      * remove redundent threads
      
      * optimize start server
      
      * remove logs
      
      * fix code problems by reviewers' suggestions
      
      * move graph files into a folder
      
      * code style change
      
      * remove graph operations from base table
      
      * optimize get_feat function of graph engine
      
      * fix long long count problem
      
      * remove redandunt graph files
      
      * remove unused shell
      
      * recover dropout_op_pass.h
      
      * fix potential stack overflow when request number is too large & node add & node clear & node remove
      
      * when sample k is larger than neigbor num, return directly
      
      * using random seed generator of paddle to speed up
      
      * fix bug of random sample k
      
      * fix code style
      
      * fix code style
      
      * add remove graph to fleet_py.cc
      
      * fix blocking_queue problem
      
      * fix style
      
      * fix
      
      * recover capacity check
      
      * add remove graph node; add set_feature
      
      * add remove graph node; add set_feature
      
      * add remove graph node; add set_feature
      
      * add remove graph node; add set_feature
      
      * fix distributed op combining problems
      
      * optimize
      
      * remove logs
      
      * fix MultiSlotDataGenerator error
      
      * cache for graph engine
      
      * fix type compare error
      
      * more test&fix thread terminating problem
      
      * remove header
      
      * change time interval of shrink
      
      * use cache when sample nodes
      
      * remove unused function
      
      * change unique_ptr to shared_ptr
      
      * simplify cache template
      
      * cache api on client
      
      * fix
      
      * reduce sample threads when cache is not used
      
      * reduce cache memory
      Co-authored-by: NHuang Zhengjie <270018958@qq.com>
      Co-authored-by: NWeiyue Su <weiyue.su@gmail.com>
      Co-authored-by: Nsuweiyue <suweiyue@baidu.com>
      Co-authored-by: Nluobin06 <luobin06@baidu.com>
      Co-authored-by: Nliweibin02 <liweibin02@baidu.com>
      Co-authored-by: Ntangwei12 <tangwei12@baidu.com>
      f584d378
    • C
      infershape to infermeta (#37107) · 0fc9919b
      Chen Weihang 提交于
      0fc9919b
    • C
      fix test_scale_op skipped test (#37153) · ca7f1cd2
      Chen Weihang 提交于
      ca7f1cd2
    • S
      block showincudes (#37071) · d7d22640
      Sing_chan 提交于
      d7d22640
    • Y
      2c7870e0
    • W
      [fleet_executor] Add interceptor ping pong test (#37143) · 742378f4
      WangXi 提交于
      742378f4
    • J
      add fetch to black list (#37123) · 63c8c8c2
      JingZhuangzhuang 提交于
      63c8c8c2
    • H
      Fix Paddle-CINN CI (#37145) · e8ce3311
      Huihuang Zheng 提交于
      Fix Paddle-CINN CI
      e8ce3311
    • Z
      brpc_ps_client upgrade (#36943) · bd79ae8a
      zhaocaibei123 提交于
      * test
      
      * rm test
      
      * add memory_sparse_table and brpc communication upgrade dependency
      
      * fix
      
      * add dense optimizer & fix dump bug & add some strategy fields
      
      * fix
      
      * fix
      
      * remove thread_pool thread_queue
      
      * add memory sparse table
      
      * update memory sparse table
      
      * update memory sparse table
      
      * update cmake
      
      * upgrade brpc_ps_client
      
      * remove show/click_const in ctr_accessor
      
      * fix deconstructor
      bd79ae8a
    • Z
      [PTen] Adjust the param of full_like API in pten (#37088) · abd4ab9c
      zyfncg 提交于
      * adjust the param of full_like api  in pten
      
      * adjust the code format
      
      * adjust the code format
      
      * adjust the code format
      abd4ab9c
    • L
      Refine new executor (#37074) · 1fe4513c
      Leo Chen 提交于
      * split declaration and implementation
      
      * remove initdevices
      
      * refine VariableMetaInfo
      
      * add ut
      
      * fix compile
      1fe4513c
    • Z
      [heterps]fix ut for heter_pipeline_trainer.cc (#37136) · 0a92c857
      zmx 提交于
      * fix ut. test=develop
      
      * fix ut. test=develop
      0a92c857
    • W
      [Paddle-Inference] fix_qkv_plugin: fix half scale (#37096) · 36154ba9
      Wangzheee 提交于
      * fix_qkv_plugin: half_scale
      
      * [Paddle-Inference] fix_qkv_plugin: fix half scale
      36154ba9
    • F
      [CPU-PSLIB] Fix bug for consistency insepection of op's embedding name and... · 9574bcd7
      Fan Zhang 提交于
      [CPU-PSLIB] Fix bug for consistency insepection of op's embedding name and sparse table name in config_fleet.py (#36753)
      
      * [CPU-PSLIB] Fix bug for consistency insepection of op's embedding name and sparse table name in config_fleet.py
      
      * [CPU-PSLIB] Fix bug for consistency insepection of op's embedding name and sparse table name in config_fleet.py
      9574bcd7
    • adjust the COLUMNS=128; (#37120) · 4d536678
      石晓伟 提交于
      4d536678
    • A
      [NPU] fix fill_constant and test_memcpy_op_npu (#37144) · 9396f286
      Aganlengzi 提交于
      9396f286
    • Z
      [AutoParallel] Add AutoConvert (#36958) · 1773afd7
      zhaoyingli 提交于
      * add AutoConvert
      
      * add unitest
      
      * amend merge&slice
      
      * amend default dist_attr
      
      * update doc&improve coverage
      
      * add interface dist_context
      
      * tiny modify
      1773afd7
    • Y
      [Pten]Refactor the Elementwise_add Kernel (#37043) · c1310343
      YuanRisheng 提交于
      * elementwise_add kernel refactor
      
      * fix compile bugs in elementwise_add refactor
      
      * fix compile bugs when run in npu/xpu
      
      * fix bugs when run unit test
      
      * fix bugs when run ci-windows
      
      * modify code as recommended
      
      * code format adjust
      
      * fix bugs when run ci
      
      * fix compile bug when run in ci-windwos
      c1310343
    • Y
  2. 11 11月, 2021 19 次提交
    • C
      Update readme 2.2 (#37148) · 778a3630
      Chen Long 提交于
      * update readme test=document_fix
      
      * update readme;test=document_fix
      778a3630
    • Z
      a41447f0
    • zhouweiwei2014's avatar
      remove repeated linalg in __all__ (#37117) · 357425d8
      zhouweiwei2014 提交于
      357425d8
    • W
      [Bug fixes] Add default arg to enhance varbase ClearGradient func (#36837) · 63f5c2d4
      Weilong Wu 提交于
      * Add default arg to enhance varbase ClearGradient func
      
      * Removed default arg, use a Flag to enhance varbase ClearGradient func
      
      * Renamed Flags to FLAGS_real_release
      
      * Use default arg to enhance varbase ClearGradient func and expose two func to set/get gradient isEmpty
      
      * Removed DECLARE_bool statement
      
      * Polished Code
      63f5c2d4
    • H
      Add test property RUN_TYPE=CINN (#37114) · 7a0cc0a9
      Huihuang Zheng 提交于
      Add test property RUN_TYPE=CINN to CINN unit tests. It will restrict Paddle-CINN CI to run these unit tests only.
      7a0cc0a9
    • W
      8cdd5564
    • T
      add where/where_index/masked_select for kunlun (#37053) · f5e7b02a
      TTerror 提交于
      * add where/where_index/masked_select for kunlun
      
      * fix where/where_index
      
      * update where/masked_select
      f5e7b02a
    • J
      Added softplus + activation oneDNN fuse pass (#36657) · a346c4dc
      jakpiase 提交于
      * added softplus + activation fuse plass
      
      * minor change
      
      * implemented reviewer suggestion
      
      * minor fix
      
      * minor fix
      
      * added scale_out parameter
      
      * minor fix
      
      * fix for iScan CI
      
      * conditionally disabled logs
      
      * refactored pass builder
      a346c4dc
    • X
      fleet support elastic scale up/down (#36684) · 6af531b7
      xiayanming 提交于
      * fleet support elastic train
      
      * fleet support elastic train
      
      * support elastic
      
      * add unittest
      
      * fix unitest bug
      
      * fix unittest bug
      
      * fix unittest bug
      
      * fix unittest coverage
      
      * fix unittest coverage
      
      * fix unittest coverage
      
      * fix unittest coverage
      
      * fix unittest coverage
      
      * fix elastic bug
      
      * fix ci fail
      
      * fix ci fail
      
      * fix elastic bug
      
      * fix elastic bug
      
      * fix joint debugging bug
      
      * fix joint debugging bug
      
      * fix windows ci failed
      
      * fix windows ci failed
      6af531b7
    • Z
      Add macro required by CINN. (#37066) · 9a9345fa
      Zhen Wang 提交于
      * Add macro required by CINN.
      
      * Remove CMAKE_BUILD_TYPE form cinn.cmake.
      9a9345fa
    • Z
      [Heterps]Refactor Heter Pipeline Parameter Server (#36845) · a2da1efa
      zmx 提交于
      * change username
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * update
      
      * update
      
      * update unittests
      
      * fix
      
      * update
      
      * fix
      
      * update
      
      * fix
      
      * fix
      
      * fix
      
      * update
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update send_and_recv op. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * update. test=develop
      
      * fix. test=develop
      
      * fix. test=develop
      
      * fix. test=develop
      
      * fix. test=develop
      
      * fix ut. test=develop
      
      * fix unit. notest,test=coverage
      
      * fix ut. notest, test=coverage
      
      * update. notest,test=coverage
      
      * fix ut. notest, test=coverage
      
      * fix ut. notest, test=coverage
      
      * fix. notest, test=coverage
      
      * fix. notest, test=coverage
      
      * fix ut. notest, test=coverage
      
      * fix ut. notest, test=coverage
      
      * fix ut. notest, test=coverage
      
      * fix ut. notest, test=coverage
      
      * add func. notest, test=coverage
      
      * fix ut. notest, test=coverage
      
      * fix. test=develop
      
      * fix. test=develop
      a2da1efa
    • W
      [New features] Support VarBase to expose func (#36965) · 52645667
      Weilong Wu 提交于
      * Expose func for varbase
      
      * Expose func for varbase and enhance varbase init func
      
      * Change func name and add test case for _CopyGradientWith
      
      * Rename func
      
      * Add test cases to increase coverage
      
      * Refine the logic of _to func
      
      * Replace numel() with _numel(), Add test code
      52645667
    • W
      op_teller: add all convert_op to int8 (#37099) · 1580eae2
      Wangzheee 提交于
      1580eae2
    • S
      reduce sample threads (#37098) · 1ecaa793
      seemingwang 提交于
      * graph engine demo
      
      * upload unsaved changes
      
      * fix dependency error
      
      * fix shard_num problem
      
      * py client
      
      * remove lock and graph-type
      
      * add load direct graph
      
      * add load direct graph
      
      * add load direct graph
      
      * batch random_sample
      
      * batch_sample_k
      
      * fix num_nodes size
      
      * batch brpc
      
      * batch brpc
      
      * add test
      
      * add test
      
      * add load_nodes; change add_node function
      
      * change sample return type to pair
      
      * resolve conflict
      
      * resolved conflict
      
      * resolved conflict
      
      * separate server and client
      
      * merge pair type
      
      * fix
      
      * resolved conflict
      
      * fixed segment fault; high-level VLOG for load edges and load nodes
      
      * random_sample return 0
      
      * rm useless loop
      
      * test:load edge
      
      * fix ret -1
      
      * test: rm sample
      
      * rm sample
      
      * random_sample return future
      
      * random_sample return int
      
      * test fake node
      
      * fixed here
      
      * memory leak
      
      * remove test code
      
      * fix return problem
      
      * add common_graph_table
      
      * random sample node &test & change data-structure from linkedList to vector
      
      * add common_graph_table
      
      * sample with srand
      
      * add node_types
      
      * optimize nodes sample
      
      * recover test
      
      * random sample
      
      * destruct weighted sampler
      
      * GraphEdgeBlob
      
      * WeightedGraphEdgeBlob to GraphEdgeBlob
      
      * WeightedGraphEdgeBlob to GraphEdgeBlob
      
      * pybind sample nodes api
      
      * pull nodes with step
      
      * fixed pull_graph_list bug; add test for pull_graph_list by step
      
      * add graph table;name
      
      * add graph table;name
      
      * add pybind
      
      * add pybind
      
      * add FeatureNode
      
      * add FeatureNode
      
      * add FeatureNode Serialize
      
      * add FeatureNode Serialize
      
      * get_feat_node
      
      * avoid local rpc
      
      * fix get_node_feat
      
      * fix get_node_feat
      
      * remove log
      
      * get_node_feat return  py:bytes
      
      * merge develop with graph_engine
      
      * fix threadpool.h head
      
      * fix
      
      * fix typo
      
      * resolve conflict
      
      * fix conflict
      
      * recover lost content
      
      * fix pybind of FeatureNode
      
      * recover cmake
      
      * recover tools
      
      * resolve conflict
      
      * resolve linking problem
      
      * code style
      
      * change test_server port
      
      * fix code problems
      
      * remove shard_num config
      
      * remove redundent threads
      
      * optimize start server
      
      * remove logs
      
      * fix code problems by reviewers' suggestions
      
      * move graph files into a folder
      
      * code style change
      
      * remove graph operations from base table
      
      * optimize get_feat function of graph engine
      
      * fix long long count problem
      
      * remove redandunt graph files
      
      * remove unused shell
      
      * recover dropout_op_pass.h
      
      * fix potential stack overflow when request number is too large & node add & node clear & node remove
      
      * when sample k is larger than neigbor num, return directly
      
      * using random seed generator of paddle to speed up
      
      * fix bug of random sample k
      
      * fix code style
      
      * fix code style
      
      * add remove graph to fleet_py.cc
      
      * fix blocking_queue problem
      
      * fix style
      
      * fix
      
      * recover capacity check
      
      * add remove graph node; add set_feature
      
      * add remove graph node; add set_feature
      
      * add remove graph node; add set_feature
      
      * add remove graph node; add set_feature
      
      * fix distributed op combining problems
      
      * optimize
      
      * remove logs
      
      * fix MultiSlotDataGenerator error
      
      * cache for graph engine
      
      * fix type compare error
      
      * more test&fix thread terminating problem
      
      * remove header
      
      * change time interval of shrink
      
      * use cache when sample nodes
      
      * remove unused function
      
      * change unique_ptr to shared_ptr
      
      * simplify cache template
      
      * cache api on client
      
      * fix
      
      * reduce sample threads when cache is not used
      Co-authored-by: NHuang Zhengjie <270018958@qq.com>
      Co-authored-by: NWeiyue Su <weiyue.su@gmail.com>
      Co-authored-by: Nsuweiyue <suweiyue@baidu.com>
      Co-authored-by: Nluobin06 <luobin06@baidu.com>
      Co-authored-by: Nliweibin02 <liweibin02@baidu.com>
      Co-authored-by: Ntangwei12 <tangwei12@baidu.com>
      1ecaa793
    • L
      Get global cluster information (#37084) · 31673a92
      LiYuRio 提交于
      31673a92
    • W
      update ut (#37089) · 6c183a8e
      Wilber 提交于
      6c183a8e
    • X
    • W
      fix 2 bug: 1.skip lodtensorarray; 2.delete feed op (#37090) · d5df6bdf
      wanghuancoder 提交于
      * fix 2 bug: 1.skip lodtensorarray; 2.delete feed op, test=develop
      
      * program clone, test=develop
      d5df6bdf
    • N
      [PaddlePaddle Hackathon] add WideResNet (#36952) · 8395f573
      Nyakku Shigure 提交于
      * add wide resnet
      * update pretrained weights link
      8395f573