• X
    cherry-pick1.6 fix cache table bug, add save_paddle_inference_model, fix hdfs util bug (#21339) · 072eb5b6
    xujiaqi01 提交于
    * fix cache table bug, add save_paddle_inference_model, fix hdfs util bug (#21052)
    
    * fix cache table bug
    * add save_paddle_inference_model
    * fix hdfs util bug
    * test=develop
    
    * fix several sparse table issuses (#20686)
    
    * no longer need to define all embedding layers (no one less) of all slots in each program. make trainer_param repeated in ps.proto.
    * add find_distributed_lookup_table_grads instead of hard code GRAD
    * support embedding stop gradient. push sparse has error before fix this.* 
    * fix fill sparse, skip slots which do not have embedding. each slot's embedding in a sparse table should be used in all training programs before fix this.
    * fix pull sparse, skip slots which do not have embedding.
    * fix collect feasign label info, skip slots which do not have embedding.
    * support when there are multi sparse tables in one or multi training programs, each program can pull/push its own related sparse tables instead of all sparse tables.
    * test=develop
    
    * add copy table (#21086)
    
    * copy some feasigns and corresponding embeddings from one sparse table to another
    * copy all feasigns and corresponding embeddings from one sparse table to another
    * copy all dense params from one table to another
    * copy some local vars to other local vars
    
    * fix fs_client_param bug (#21212)
    
    * fix fs_client_param bug, user can set this config through fleet_desc_file or fleet config
    * test=develop
    
    * fix fleet util bug (#21254)
    
    * fix fleet util bug in save paddle inference model
    * test=develop
    072eb5b6
fleet_util.py 59.7 KB