• L
    [Inference] Make share_external_data supports bf16 and bool; fix while_op... · c65ef07c
    lzy 提交于
    [Inference] Make share_external_data supports bf16 and bool; fix while_op cache_inference_while_scope when using fleet_executor. (#56055)
    
    * 1. make share_external_data supports bf16 and bool; 2. don't drop_kids when cache_inference_while_scope
    
    * fix FLAGS_cache_inference_while_scope
    
    * add unitest
    
    * add unitest
    
    * skip unitest when cudnn_version < 8100
    
    * skip test share_external_data_bf16 when CUDA_ARCH < 80
    c65ef07c
inference_api.cc 52.1 KB