• S
    reduce sample threads (#37098) · 1ecaa793
    seemingwang 提交于
    * graph engine demo
    
    * upload unsaved changes
    
    * fix dependency error
    
    * fix shard_num problem
    
    * py client
    
    * remove lock and graph-type
    
    * add load direct graph
    
    * add load direct graph
    
    * add load direct graph
    
    * batch random_sample
    
    * batch_sample_k
    
    * fix num_nodes size
    
    * batch brpc
    
    * batch brpc
    
    * add test
    
    * add test
    
    * add load_nodes; change add_node function
    
    * change sample return type to pair
    
    * resolve conflict
    
    * resolved conflict
    
    * resolved conflict
    
    * separate server and client
    
    * merge pair type
    
    * fix
    
    * resolved conflict
    
    * fixed segment fault; high-level VLOG for load edges and load nodes
    
    * random_sample return 0
    
    * rm useless loop
    
    * test:load edge
    
    * fix ret -1
    
    * test: rm sample
    
    * rm sample
    
    * random_sample return future
    
    * random_sample return int
    
    * test fake node
    
    * fixed here
    
    * memory leak
    
    * remove test code
    
    * fix return problem
    
    * add common_graph_table
    
    * random sample node &test & change data-structure from linkedList to vector
    
    * add common_graph_table
    
    * sample with srand
    
    * add node_types
    
    * optimize nodes sample
    
    * recover test
    
    * random sample
    
    * destruct weighted sampler
    
    * GraphEdgeBlob
    
    * WeightedGraphEdgeBlob to GraphEdgeBlob
    
    * WeightedGraphEdgeBlob to GraphEdgeBlob
    
    * pybind sample nodes api
    
    * pull nodes with step
    
    * fixed pull_graph_list bug; add test for pull_graph_list by step
    
    * add graph table;name
    
    * add graph table;name
    
    * add pybind
    
    * add pybind
    
    * add FeatureNode
    
    * add FeatureNode
    
    * add FeatureNode Serialize
    
    * add FeatureNode Serialize
    
    * get_feat_node
    
    * avoid local rpc
    
    * fix get_node_feat
    
    * fix get_node_feat
    
    * remove log
    
    * get_node_feat return  py:bytes
    
    * merge develop with graph_engine
    
    * fix threadpool.h head
    
    * fix
    
    * fix typo
    
    * resolve conflict
    
    * fix conflict
    
    * recover lost content
    
    * fix pybind of FeatureNode
    
    * recover cmake
    
    * recover tools
    
    * resolve conflict
    
    * resolve linking problem
    
    * code style
    
    * change test_server port
    
    * fix code problems
    
    * remove shard_num config
    
    * remove redundent threads
    
    * optimize start server
    
    * remove logs
    
    * fix code problems by reviewers' suggestions
    
    * move graph files into a folder
    
    * code style change
    
    * remove graph operations from base table
    
    * optimize get_feat function of graph engine
    
    * fix long long count problem
    
    * remove redandunt graph files
    
    * remove unused shell
    
    * recover dropout_op_pass.h
    
    * fix potential stack overflow when request number is too large & node add & node clear & node remove
    
    * when sample k is larger than neigbor num, return directly
    
    * using random seed generator of paddle to speed up
    
    * fix bug of random sample k
    
    * fix code style
    
    * fix code style
    
    * add remove graph to fleet_py.cc
    
    * fix blocking_queue problem
    
    * fix style
    
    * fix
    
    * recover capacity check
    
    * add remove graph node; add set_feature
    
    * add remove graph node; add set_feature
    
    * add remove graph node; add set_feature
    
    * add remove graph node; add set_feature
    
    * fix distributed op combining problems
    
    * optimize
    
    * remove logs
    
    * fix MultiSlotDataGenerator error
    
    * cache for graph engine
    
    * fix type compare error
    
    * more test&fix thread terminating problem
    
    * remove header
    
    * change time interval of shrink
    
    * use cache when sample nodes
    
    * remove unused function
    
    * change unique_ptr to shared_ptr
    
    * simplify cache template
    
    * cache api on client
    
    * fix
    
    * reduce sample threads when cache is not used
    Co-authored-by: NHuang Zhengjie <270018958@qq.com>
    Co-authored-by: NWeiyue Su <weiyue.su@gmail.com>
    Co-authored-by: Nsuweiyue <suweiyue@baidu.com>
    Co-authored-by: Nluobin06 <luobin06@baidu.com>
    Co-authored-by: Nliweibin02 <liweibin02@baidu.com>
    Co-authored-by: Ntangwei12 <tangwei12@baidu.com>
    1ecaa793
graph_node_test.cc 26.2 KB