• Q
    Support sync batch norm. (#16121) · 8ad672a2
    qingqing01 提交于
    * Support Sync Batch Norm.
    * Note, do not enable it in one device.
    
    Usage:
    
    build_strategy = fluid.BuildStrategy()
    build_strategy.sync_batch_norm = True
    binary = fluid.compiler.CompiledProgram(tp).with_data_parallel(
            loss_name=loss_mean.name,
            build_strategy=build_strategy)
    8ad672a2
sync_batch_norm_op.cu 17.1 KB