We don’t need to change any other code, just simply encapsulate the policy. Please refer to dizoo/atari/config/serial/spaceinvaders/spaceinvaders_dqn_config_multi_gpu_dp.py
For DP, the runnable script demo is demonstrated as follows.
-CUDA_VISIBLE_DEVICES=0,1 python -u spaceinvaders_dqn_main_multi_gpu_ddp.py
+CUDA_VISIBLE_DEVICES=0,1 python -u spaceinvaders_dqn_config_multi_gpu_ddp.py
or (on cluster managed by Slurm)
-srun -p PARTITION_NAME --mpi=pmi2 --gres=gpu:2 -n1 --ntasks-per-node=1 python -u spaceinvaders_dqn_main_multi_gpu_ddp.py
+srun -p PARTITION_NAME --mpi=pmi2 --gres=gpu:2 -n1 --ntasks-per-node=1 python -u spaceinvaders_dqn_config_multi_gpu_ddp.py
@@ -306,17 +306,17 @@ DI-engine achieves this with allreduce operator in learner and evaluator, and on
Tip
-The whole example is located in dizoo/atari/entry/spaceinvaders_dqn_main_multi_gpu_ddp.py
+The whole example is located in dizoo/atari/entry/spaceinvaders_dqn_config_multi_gpu_ddp.py
Execute launch shell script
For DDP, the runnable script demo is demonstrated as follows.
-CUDA_VISIBLE_DEVICES=0,1 python -m torch.distributed.launch --nnodes=1 --node_rank=0 --nproc_per_node=2 spaceinvaders_dqn_main_multi_gpu_ddp.py
+CUDA_VISIBLE_DEVICES=0,1 python -m torch.distributed.launch --nnodes=1 --node_rank=0 --nproc_per_node=2 spaceinvaders_dqn_config_multi_gpu_ddp.py
Or on cluster managed by Slurm
-srun -p PARTITION_NAME --mpi=pmi2 --gres=gpu:2 -n2 --ntasks-per-node=2 python -u spaceinvaders_dqn_main_multi_gpu_ddp.py
+srun -p PARTITION_NAME --mpi=pmi2 --gres=gpu:2 -n2 --ntasks-per-node=2 python -u spaceinvaders_dqn_config_multi_gpu_ddp.py
diff --git a/searchindex.js b/searchindex.js
index 0fc2701477597f377516d61356aeb2096d20c78e..61482efc655804fd35fda620caa309efc322ae0f 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({docnames:["api_doc/config/config","api_doc/config/index","api_doc/env/env","api_doc/env/env_manager","api_doc/env/env_wrappers","api_doc/env/index","api_doc/index","api_doc/interaction/base/app","api_doc/interaction/base/common","api_doc/interaction/base/index","api_doc/interaction/base/network","api_doc/interaction/base/threading","api_doc/interaction/exception/base","api_doc/interaction/exception/index","api_doc/interaction/exception/master","api_doc/interaction/exception/slave","api_doc/interaction/index","api_doc/interaction/master/connection","api_doc/interaction/master/index","api_doc/interaction/master/master","api_doc/interaction/master/task","api_doc/interaction/slave/action","api_doc/interaction/slave/index","api_doc/interaction/slave/slave","api_doc/league/index","api_doc/league/league","api_doc/league/payoff","api_doc/league/player","api_doc/model/common/encoder","api_doc/model/common/head","api_doc/model/common/index","api_doc/model/common/utils","api_doc/model/index","api_doc/model/template/QAC","api_doc/model/template/VAC","api_doc/model/template/coma","api_doc/model/template/index","api_doc/model/template/q_learning","api_doc/model/template/qmix","api_doc/policy/a2c","api_doc/policy/collaq","api_doc/policy/coma","api_doc/policy/ddpg","api_doc/policy/dqn","api_doc/policy/index","api_doc/policy/ppg","api_doc/policy/qmix","api_doc/policy/r2d2","api_doc/policy/rainbow","api_doc/reward_model/base_reward_estimate","api_doc/reward_model/gail_irl_model","api_doc/reward_model/index","api_doc/reward_model/pdeil_irl_model","api_doc/reward_model/pwil_irl_model","api_doc/reward_model/red_irl_model","api_doc/rl_utils/a2c","api_doc/rl_utils/adder","api_doc/rl_utils/coma","api_doc/rl_utils/exploration","api_doc/rl_utils/gae","api_doc/rl_utils/index","api_doc/rl_utils/isw","api_doc/rl_utils/ppo","api_doc/rl_utils/td","api_doc/rl_utils/upgo","api_doc/rl_utils/value_rescale","api_doc/rl_utils/vtrace","api_doc/torch_utils/checkpoint_helper","api_doc/torch_utils/data_helper","api_doc/torch_utils/distribution","api_doc/torch_utils/index","api_doc/torch_utils/metric","api_doc/torch_utils/nn_test_helper","api_doc/torch_utils/optimizer_helper","api_doc/torch_utils/torch_utils_loss","api_doc/torch_utils/torch_utils_network","api_doc/utils/collection_helper","api_doc/utils/compression_helper","api_doc/utils/data/collate_fn","api_doc/utils/data/dataloader","api_doc/utils/data/index","api_doc/utils/data/structure","api_doc/utils/default_helper","api_doc/utils/design_helper","api_doc/utils/file_helper","api_doc/utils/import_helper","api_doc/utils/index","api_doc/utils/k8s_helper","api_doc/utils/lock_helper","api_doc/utils/log_helper","api_doc/utils/pytorch_ddp_dist_helper","api_doc/utils/segment_tree","api_doc/utils/system_helper","api_doc/utils/time_helper","api_doc/worker/collector/base_serial_collector","api_doc/worker/collector/base_serial_evaluator","api_doc/worker/collector/comm","api_doc/worker/collector/episode_serial_collector","api_doc/worker/collector/index","api_doc/worker/collector/sample_serial_collector","api_doc/worker/coordinator/comm_coordinator","api_doc/worker/coordinator/commander","api_doc/worker/coordinator/coordinator","api_doc/worker/coordinator/index","api_doc/worker/coordinator/resource_manager","api_doc/worker/learner/comm_learner","api_doc/worker/learner/index","api_doc/worker/learner/learner","api_doc/worker/replay_buffer/buffer","api_doc/worker/replay_buffer/index","architecture/index","architecture/interaction/index","architecture/interaction/models","architecture/interaction/processes","architecture/loader/advantage","architecture/loader/calculation","architecture/loader/index","best_practice/IL","best_practice/IRL","best_practice/customization1_dynamic_update_step","best_practice/env_wrapper","best_practice/episode_buffer","best_practice/index","best_practice/learner_log","best_practice/model_wrapper","best_practice/multi_buffer","best_practice/multi_discrete","best_practice/multi_gpu_example","best_practice/nstep_td","best_practice/priority","best_practice/random_collect_size","best_practice/random_seed","best_practice/registry","best_practice/rnn","best_practice/training_generated_folders","env_tutorial/atari","env_tutorial/bsuite","env_tutorial/index","env_tutorial/overcooked","faq/index","faq/index_en","feature/algorithm_overview_en","feature/autolog_overview","feature/collector_overview","feature/collector_overview_en","feature/dataloader_overview","feature/env_manager_overview","feature/env_manager_overview_en","feature/env_overview","feature/env_overview_en","feature/hpc_rl_overview","feature/hpc_rl_overview_en","feature/index","feature/interaction_overview","feature/interaction_overview_en","feature/league_overview_en","feature/learner_overview","feature/learner_overview_en","feature/loader_overview","feature/loader_overview_en","feature/model_overview_en","feature/orchestrator_overview_en","feature/policy_overview_en","feature/replay_buffer_overview_en","feature/wrapper_hook_overview","feature/wrapper_hook_overview_en","guide/code_comment_en","guide/doc_contribution_en","guide/git_guide","guide/git_guide_en","guide/index","hands_on/a2c","hands_on/acer","hands_on/alphago","hands_on/atoc","hands_on/c51_qrdqn_iqn","hands_on/collaq","hands_on/coma","hands_on/ddpg","hands_on/dqn","hands_on/gail","hands_on/impala","hands_on/index","hands_on/mcts","hands_on/ppg","hands_on/ppo","hands_on/qmix","hands_on/rainbow","hands_on/rnd","hands_on/sac","hands_on/sqil","hands_on/sqn","hands_on/td3","hands_on/vpn","index","installation/index","intro_rl/basic","intro_rl/basic_en","intro_rl/index","key_concept/index","quick_start/index","quick_start/tb_demo","tutorial_dev/index"],envversion:{"sphinx.domains.c":2,"sphinx.domains.changeset":1,"sphinx.domains.citation":1,"sphinx.domains.cpp":4,"sphinx.domains.index":1,"sphinx.domains.javascript":2,"sphinx.domains.math":2,"sphinx.domains.python":3,"sphinx.domains.rst":2,"sphinx.domains.std":2,"sphinx.ext.viewcode":1,sphinx:56},filenames:["api_doc/config/config.rst","api_doc/config/index.rst","api_doc/env/env.rst","api_doc/env/env_manager.rst","api_doc/env/env_wrappers.rst","api_doc/env/index.rst","api_doc/index.rst","api_doc/interaction/base/app.rst","api_doc/interaction/base/common.rst","api_doc/interaction/base/index.rst","api_doc/interaction/base/network.rst","api_doc/interaction/base/threading.rst","api_doc/interaction/exception/base.rst","api_doc/interaction/exception/index.rst","api_doc/interaction/exception/master.rst","api_doc/interaction/exception/slave.rst","api_doc/interaction/index.rst","api_doc/interaction/master/connection.rst","api_doc/interaction/master/index.rst","api_doc/interaction/master/master.rst","api_doc/interaction/master/task.rst","api_doc/interaction/slave/action.rst","api_doc/interaction/slave/index.rst","api_doc/interaction/slave/slave.rst","api_doc/league/index.rst","api_doc/league/league.rst","api_doc/league/payoff.rst","api_doc/league/player.rst","api_doc/model/common/encoder.rst","api_doc/model/common/head.rst","api_doc/model/common/index.rst","api_doc/model/common/utils.rst","api_doc/model/index.rst","api_doc/model/template/QAC.rst","api_doc/model/template/VAC.rst","api_doc/model/template/coma.rst","api_doc/model/template/index.rst","api_doc/model/template/q_learning.rst","api_doc/model/template/qmix.rst","api_doc/policy/a2c.rst","api_doc/policy/collaq.rst","api_doc/policy/coma.rst","api_doc/policy/ddpg.rst","api_doc/policy/dqn.rst","api_doc/policy/index.rst","api_doc/policy/ppg.rst","api_doc/policy/qmix.rst","api_doc/policy/r2d2.rst","api_doc/policy/rainbow.rst","api_doc/reward_model/base_reward_estimate.rst","api_doc/reward_model/gail_irl_model.rst","api_doc/reward_model/index.rst","api_doc/reward_model/pdeil_irl_model.rst","api_doc/reward_model/pwil_irl_model.rst","api_doc/reward_model/red_irl_model.rst","api_doc/rl_utils/a2c.rst","api_doc/rl_utils/adder.rst","api_doc/rl_utils/coma.rst","api_doc/rl_utils/exploration.rst","api_doc/rl_utils/gae.rst","api_doc/rl_utils/index.rst","api_doc/rl_utils/isw.rst","api_doc/rl_utils/ppo.rst","api_doc/rl_utils/td.rst","api_doc/rl_utils/upgo.rst","api_doc/rl_utils/value_rescale.rst","api_doc/rl_utils/vtrace.rst","api_doc/torch_utils/checkpoint_helper.rst","api_doc/torch_utils/data_helper.rst","api_doc/torch_utils/distribution.rst","api_doc/torch_utils/index.rst","api_doc/torch_utils/metric.rst","api_doc/torch_utils/nn_test_helper.rst","api_doc/torch_utils/optimizer_helper.rst","api_doc/torch_utils/torch_utils_loss.rst","api_doc/torch_utils/torch_utils_network.rst","api_doc/utils/collection_helper.rst","api_doc/utils/compression_helper.rst","api_doc/utils/data/collate_fn.rst","api_doc/utils/data/dataloader.rst","api_doc/utils/data/index.rst","api_doc/utils/data/structure.rst","api_doc/utils/default_helper.rst","api_doc/utils/design_helper.rst","api_doc/utils/file_helper.rst","api_doc/utils/import_helper.rst","api_doc/utils/index.rst","api_doc/utils/k8s_helper.rst","api_doc/utils/lock_helper.rst","api_doc/utils/log_helper.rst","api_doc/utils/pytorch_ddp_dist_helper.rst","api_doc/utils/segment_tree.rst","api_doc/utils/system_helper.rst","api_doc/utils/time_helper.rst","api_doc/worker/collector/base_serial_collector.rst","api_doc/worker/collector/base_serial_evaluator.rst","api_doc/worker/collector/comm.rst","api_doc/worker/collector/episode_serial_collector.rst","api_doc/worker/collector/index.rst","api_doc/worker/collector/sample_serial_collector.rst","api_doc/worker/coordinator/comm_coordinator.rst","api_doc/worker/coordinator/commander.rst","api_doc/worker/coordinator/coordinator.rst","api_doc/worker/coordinator/index.rst","api_doc/worker/coordinator/resource_manager.rst","api_doc/worker/learner/comm_learner.rst","api_doc/worker/learner/index.rst","api_doc/worker/learner/learner.rst","api_doc/worker/replay_buffer/buffer.rst","api_doc/worker/replay_buffer/index.rst","architecture/index.rst","architecture/interaction/index.rst","architecture/interaction/models.rst","architecture/interaction/processes.rst","architecture/loader/advantage.rst","architecture/loader/calculation.rst","architecture/loader/index.rst","best_practice/IL.rst","best_practice/IRL.rst","best_practice/customization1_dynamic_update_step.rst","best_practice/env_wrapper.rst","best_practice/episode_buffer.rst","best_practice/index.rst","best_practice/learner_log.rst","best_practice/model_wrapper.rst","best_practice/multi_buffer.rst","best_practice/multi_discrete.rst","best_practice/multi_gpu_example.rst","best_practice/nstep_td.rst","best_practice/priority.rst","best_practice/random_collect_size.rst","best_practice/random_seed.rst","best_practice/registry.rst","best_practice/rnn.rst","best_practice/training_generated_folders.rst","env_tutorial/atari.rst","env_tutorial/bsuite.rst","env_tutorial/index.rst","env_tutorial/overcooked.rst","faq/index.rst","faq/index_en.rst","feature/algorithm_overview_en.rst","feature/autolog_overview.rst","feature/collector_overview.rst","feature/collector_overview_en.rst","feature/dataloader_overview.rst","feature/env_manager_overview.rst","feature/env_manager_overview_en.rst","feature/env_overview.rst","feature/env_overview_en.rst","feature/hpc_rl_overview.rst","feature/hpc_rl_overview_en.rst","feature/index.rst","feature/interaction_overview.rst","feature/interaction_overview_en.rst","feature/league_overview_en.rst","feature/learner_overview.rst","feature/learner_overview_en.rst","feature/loader_overview.rst","feature/loader_overview_en.rst","feature/model_overview_en.rst","feature/orchestrator_overview_en.rst","feature/policy_overview_en.rst","feature/replay_buffer_overview_en.rst","feature/wrapper_hook_overview.rst","feature/wrapper_hook_overview_en.rst","guide/code_comment_en.rst","guide/doc_contribution_en.rst","guide/git_guide.rst","guide/git_guide_en.rst","guide/index.rst","hands_on/a2c.rst","hands_on/acer.rst","hands_on/alphago.rst","hands_on/atoc.rst","hands_on/c51_qrdqn_iqn.rst","hands_on/collaq.rst","hands_on/coma.rst","hands_on/ddpg.rst","hands_on/dqn.rst","hands_on/gail.rst","hands_on/impala.rst","hands_on/index.rst","hands_on/mcts.rst","hands_on/ppg.rst","hands_on/ppo.rst","hands_on/qmix.rst","hands_on/rainbow.rst","hands_on/rnd.rst","hands_on/sac.rst","hands_on/sqil.rst","hands_on/sqn.rst","hands_on/td3.rst","hands_on/vpn.rst","index.rst","installation/index.rst","intro_rl/basic.rst","intro_rl/basic_en.rst","intro_rl/index.rst","key_concept/index.rst","quick_start/index.rst","quick_start/tb_demo.rst","tutorial_dev/index.rst"],objects:{"ding.config":{Config:[0,0,1,""]},"ding.config.Config":{__init__:[0,1,1,""],_file_to_dict:[0,1,1,""],file_to_dict:[0,1,1,""]},"ding.config.config":{compile_config:[0,2,1,""],compile_config_parallel:[0,2,1,""],read_config:[0,2,1,""],read_config_yaml:[0,2,1,""],save_config:[0,2,1,""],save_config_py:[0,2,1,""],save_config_yaml:[0,2,1,""]},"ding.envs.env.base_env":{BaseEnv:[2,0,1,""],get_env_cls:[2,2,1,""],get_vec_env_setting:[2,2,1,""]},"ding.envs.env.base_env.BaseEnv":{__init__:[2,1,1,""],close:[2,1,1,""],create_collector_env_cfg:[2,1,1,""],create_evaluator_env_cfg:[2,1,1,""],enable_save_replay:[2,1,1,""],info:[2,1,1,""],reset:[2,1,1,""],step:[2,1,1,""]},"ding.envs.env_manager.base_env_manager":{BaseEnvManager:[3,0,1,""],create_env_manager:[3,2,1,""],get_env_manager_cls:[3,2,1,""]},"ding.envs.env_manager.base_env_manager.BaseEnvManager":{close:[3,1,1,""],enable_save_replay:[3,1,1,""],env_info:[3,1,1,""],launch:[3,1,1,""],ready_obs:[3,3,1,""],reset:[3,1,1,""],seed:[3,1,1,""],step:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager":{AsyncSubprocessEnvManager:[3,0,1,""],ShmBuffer:[3,0,1,""],ShmBufferContainer:[3,0,1,""],SyncSubprocessEnvManager:[3,0,1,""]},"ding.envs.env_manager.subprocess_env_manager.AsyncSubprocessEnvManager":{close:[3,1,1,""],enable_save_replay:[3,1,1,""],env_info:[3,1,1,""],launch:[3,1,1,""],ready_obs:[3,3,1,""],reset:[3,1,1,""],seed:[3,1,1,""],step:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager.ShmBuffer":{fill:[3,1,1,""],get:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager.ShmBufferContainer":{fill:[3,1,1,""],get:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager.SyncSubprocessEnvManager":{close:[3,1,1,""],enable_save_replay:[3,1,1,""],env_info:[3,1,1,""],launch:[3,1,1,""],ready_obs:[3,3,1,""],reset:[3,1,1,""],seed:[3,1,1,""],step:[3,1,1,""]},"ding.envs.env_wrappers":{ClipRewardEnv:[4,0,1,""],EpisodicLifeEnv:[4,0,1,""],FireResetEnv:[4,0,1,""],FrameStack:[4,0,1,""],MaxAndSkipEnv:[4,0,1,""],NoopResetEnv:[4,0,1,""],ObsNormEnv:[4,0,1,""],ObsTransposeWrapper:[4,0,1,""],RamWrapper:[4,0,1,""],RewardNormEnv:[4,0,1,""],RunningMeanStd:[4,0,1,""],ScaledFloatFrame:[4,0,1,""],WarpFrame:[4,0,1,""],update_shape:[4,4,0,"-"]},"ding.envs.env_wrappers.ClipRewardEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reward:[4,1,1,""]},"ding.envs.env_wrappers.EpisodicLifeEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.FireResetEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""]},"ding.envs.env_wrappers.FrameStack":{__init__:[4,1,1,""],_get_ob:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.MaxAndSkipEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.NoopResetEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""]},"ding.envs.env_wrappers.ObsNormEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.ObsTransposeWrapper":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""]},"ding.envs.env_wrappers.RamWrapper":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.RewardNormEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],reward:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.RunningMeanStd":{__init__:[4,1,1,""],mean:[4,3,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],std:[4,3,1,""],update:[4,1,1,""]},"ding.envs.env_wrappers.ScaledFloatFrame":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""]},"ding.envs.env_wrappers.WarpFrame":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""]},"ding.interaction.base.common":{ControllableContext:[8,0,1,""],ControllableService:[8,0,1,""],default_func:[8,2,1,""],random_token:[8,2,1,""],translate_dict_func:[8,2,1,""]},"ding.interaction.base.common.ControllableContext":{__enter__:[8,1,1,""],__exit__:[8,1,1,""],close:[8,1,1,""],start:[8,1,1,""]},"ding.interaction.base.common.ControllableService":{__enter__:[8,1,1,""],__exit__:[8,1,1,""],close:[8,1,1,""],join:[8,1,1,""],shutdown:[8,1,1,""],start:[8,1,1,""]},"ding.interaction.base.threading":{DblEvent:[11,0,1,""]},"ding.interaction.base.threading.DblEvent":{__init__:[11,1,1,""],close:[11,1,1,""],is_close:[11,1,1,""],is_open:[11,1,1,""],open:[11,1,1,""],wait_for_close:[11,1,1,""],wait_for_open:[11,1,1,""]},"ding.interaction.exception.base":{ResponseException:[12,0,1,""],_IResponseInformation:[12,0,1,""]},"ding.interaction.exception.base.ResponseException":{__init__:[12,1,1,""],code:[12,3,1,""],data:[12,3,1,""],message:[12,3,1,""],status_code:[12,3,1,""],success:[12,3,1,""]},"ding.interaction.exception.base._IResponseInformation":{code:[12,3,1,""],data:[12,3,1,""],message:[12,3,1,""],success:[12,3,1,""]},"ding.interaction.exception.master":{MasterChannelInvalid:[14,0,1,""],MasterChannelNotGiven:[14,0,1,""],MasterErrorCode:[14,5,1,""],MasterMasterTokenInvalid:[14,0,1,""],MasterMasterTokenNotGiven:[14,0,1,""],MasterResponseException:[14,0,1,""],MasterSelfTokenInvalid:[14,0,1,""],MasterSelfTokenNotGiven:[14,0,1,""],MasterSlaveTokenInvalid:[14,0,1,""],MasterSlaveTokenNotGiven:[14,0,1,""],MasterSuccess:[14,0,1,""],MasterSystemShuttingDown:[14,0,1,""],MasterTaskDataInvalid:[14,0,1,""],get_master_exception_by_error:[14,2,1,""],get_master_exception_class_by_error_code:[14,2,1,""]},"ding.interaction.exception.master.MasterChannelInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterChannelNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterErrorCode":{CHANNEL_INVALID:[14,6,1,""],CHANNEL_NOT_GIVEN:[14,6,1,""],MASTER_TOKEN_INVALID:[14,6,1,""],MASTER_TOKEN_NOT_GIVEN:[14,6,1,""],SELF_TOKEN_INVALID:[14,6,1,""],SELF_TOKEN_NOT_GIVEN:[14,6,1,""],SLAVE_TOKEN_INVALID:[14,6,1,""],SLAVE_TOKEN_NOT_GIVEN:[14,6,1,""],SUCCESS:[14,6,1,""],SYSTEM_SHUTTING_DOWN:[14,6,1,""],TASK_DATA_INVALID:[14,6,1,""]},"ding.interaction.exception.master.MasterMasterTokenInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterMasterTokenNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterResponseException":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSelfTokenInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSelfTokenNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSlaveTokenInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSlaveTokenNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSuccess":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSystemShuttingDown":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterTaskDataInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.slave":{SlaveChannelInvalid:[15,0,1,""],SlaveChannelNotFound:[15,0,1,""],SlaveErrorCode:[15,5,1,""],SlaveMasterTokenInvalid:[15,0,1,""],SlaveMasterTokenNotFound:[15,0,1,""],SlaveResponseException:[15,0,1,""],SlaveSelfTokenInvalid:[15,0,1,""],SlaveSelfTokenNotFound:[15,0,1,""],SlaveSlaveAlreadyConnected:[15,0,1,""],SlaveSlaveConnectionRefused:[15,0,1,""],SlaveSlaveDisconnectionRefused:[15,0,1,""],SlaveSlaveNotConnected:[15,0,1,""],SlaveSuccess:[15,0,1,""],SlaveSystemShuttingDown:[15,0,1,""],SlaveTaskAlreadyExist:[15,0,1,""],SlaveTaskRefused:[15,0,1,""],get_slave_exception_by_error:[15,2,1,""],get_slave_exception_class_by_error_code:[15,2,1,""]},"ding.interaction.exception.slave.SlaveChannelInvalid":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveChannelNotFound":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveErrorCode":{CHANNEL_INVALID:[15,6,1,""],CHANNEL_NOT_FOUND:[15,6,1,""],MASTER_TOKEN_INVALID:[15,6,1,""],MASTER_TOKEN_NOT_FOUND:[15,6,1,""],SELF_TOKEN_INVALID:[15,6,1,""],SELF_TOKEN_NOT_FOUND:[15,6,1,""],SLAVE_ALREADY_CONNECTED:[15,6,1,""],SLAVE_CONNECTION_REFUSED:[15,6,1,""],SLAVE_DISCONNECTION_REFUSED:[15,6,1,""],SLAVE_NOT_CONNECTED:[15,6,1,""],SUCCESS:[15,6,1,""],SYSTEM_SHUTTING_DOWN:[15,6,1,""],TASK_ALREADY_EXIST:[15,6,1,""],TASK_REFUSED:[15,6,1,""]},"ding.interaction.exception.slave.SlaveMasterTokenInvalid":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveMasterTokenNotFound":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveResponseException":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSelfTokenInvalid":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSelfTokenNotFound":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveAlreadyConnected":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveConnectionRefused":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveDisconnectionRefused":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveNotConnected":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSuccess":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSystemShuttingDown":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveTaskAlreadyExist":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveTaskRefused":{__init__:[15,1,1,""]},"ding.interaction.master.connection":{SlaveConnection:[17,0,1,""],SlaveConnectionProxy:[17,0,1,""],_ISlaveConnection:[17,0,1,""]},"ding.interaction.master.connection.SlaveConnection":{__init__:[17,1,1,""],close:[17,1,1,""],connect:[17,1,1,""],disconnect:[17,1,1,""],is_connected:[17,3,1,""],new_task:[17,1,1,""],start:[17,1,1,""]},"ding.interaction.master.connection.SlaveConnectionProxy":{__init__:[17,1,1,""],close:[17,1,1,""],connect:[17,1,1,""],disconnect:[17,1,1,""],is_connected:[17,3,1,""],new_task:[17,1,1,""],start:[17,1,1,""]},"ding.interaction.master.connection._ISlaveConnection":{close:[17,1,1,""],connect:[17,1,1,""],disconnect:[17,1,1,""],new_task:[17,1,1,""],start:[17,1,1,""]},"ding.interaction.master.master":{Master:[19,0,1,""]},"ding.interaction.master.master.Master":{__contains__:[19,1,1,""],__delitem__:[19,1,1,""],__getitem__:[19,1,1,""],__init__:[19,1,1,""],_after_connect:[19,1,1,""],_after_disconnect:[19,1,1,""],_after_new_task:[19,1,1,""],_before_connect:[19,1,1,""],_before_disconnect:[19,1,1,""],_before_new_task:[19,1,1,""],_error_connect:[19,1,1,""],_error_disconnect:[19,1,1,""],_error_new_task:[19,1,1,""],join:[19,1,1,""],my_address:[19,3,1,""],new_connection:[19,1,1,""],ping:[19,1,1,""],shutdown:[19,1,1,""],start:[19,1,1,""]},"ding.interaction.master.task":{Task:[20,0,1,""],TaskResultType:[20,5,1,""],TaskStatus:[20,5,1,""]},"ding.interaction.master.task.Task":{__init__:[20,1,1,""],join:[20,1,1,""],on_complete:[20,1,1,""],on_fail:[20,1,1,""],result:[20,3,1,""],start:[20,1,1,""],status:[20,3,1,""],task:[20,3,1,""]},"ding.interaction.master.task.TaskResultType":{COMPLETED:[20,6,1,""],FAILED:[20,6,1,""]},"ding.interaction.master.task.TaskStatus":{COMPLETED:[20,6,1,""],FAILED:[20,6,1,""],IDLE:[20,6,1,""],STARTED:[20,6,1,""],STARTING:[20,6,1,""],START_FAILED:[20,6,1,""]},"ding.interaction.slave.action":{ConnectionRefuse:[21,0,1,""],DisconnectionRefuse:[21,0,1,""],TaskFail:[21,0,1,""],TaskRefuse:[21,0,1,""]},"ding.interaction.slave.action.ConnectionRefuse":{__init__:[21,1,1,""]},"ding.interaction.slave.action.DisconnectionRefuse":{__init__:[21,1,1,""]},"ding.interaction.slave.action.TaskFail":{__init__:[21,1,1,""],result:[21,3,1,""]},"ding.interaction.slave.action.TaskRefuse":{__init__:[21,1,1,""]},"ding.interaction.slave.slave":{Slave:[23,0,1,""]},"ding.interaction.slave.slave.Slave":{__init__:[23,1,1,""],_before_connection:[23,1,1,""],_before_disconnection:[23,1,1,""],_before_task:[23,1,1,""],_lost_connection:[23,1,1,""],_process_task:[23,1,1,""],join:[23,1,1,""],ping:[23,1,1,""],shutdown:[23,1,1,""],start:[23,1,1,""]},"ding.league.base_league":{BaseLeague:[25,0,1,""],create_league:[25,4,0,"-"]},"ding.league.base_league.BaseLeague":{finish_job:[25,1,1,""],get_job_info:[25,1,1,""],judge_snapshot:[25,1,1,""],save_checkpoint:[25,1,1,""],update_active_player:[25,1,1,""]},"ding.league.one_vs_one_league":{OneVsOneLeague:[25,0,1,""]},"ding.league.one_vs_one_league.OneVsOneLeague":{finish_job:[25,1,1,""],get_job_info:[25,1,1,""],judge_snapshot:[25,1,1,""],save_checkpoint:[25,1,1,""],update_active_player:[25,1,1,""]},"ding.league.player":{ActivePlayer:[27,0,1,""],HistoricalPlayer:[27,0,1,""],NaiveSpPlayer:[27,0,1,""],Player:[27,0,1,""],create_player:[27,4,0,"-"]},"ding.league.player.ActivePlayer":{__init__:[27,1,1,""],increment_eval_difficulty:[27,1,1,""]},"ding.league.player.HistoricalPlayer":{__init__:[27,1,1,""]},"ding.league.player.NaiveSpPlayer":{get_job:[27,1,1,""],increment_eval_difficulty:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.league.player.Player":{__init__:[27,1,1,""]},"ding.league.shared_payoff":{BattleRecordDict:[26,0,1,""],BattleSharedPayoff:[26,0,1,""],create_payoff:[26,4,0,"-"]},"ding.league.shared_payoff.BattleRecordDict":{__mul__:[26,1,1,""]},"ding.league.shared_payoff.BattleSharedPayoff":{__getitem__:[26,1,1,""],add_player:[26,1,1,""],get_key:[26,1,1,""],update:[26,1,1,""]},"ding.league.starcraft_player":{LeagueExploiter:[27,0,1,""],MainExploiter:[27,0,1,""],MainPlayer:[27,0,1,""]},"ding.league.starcraft_player.LeagueExploiter":{get_job:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.league.starcraft_player.MainExploiter":{get_job:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.league.starcraft_player.MainPlayer":{get_job:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.model.common.encoder":{ConvEncoder:[28,0,1,""],FCEncoder:[28,0,1,""],StructEncoder:[28,0,1,""]},"ding.model.common.encoder.ConvEncoder":{__init__:[28,1,1,""],_get_flatten_size:[28,1,1,""],forward:[28,1,1,""]},"ding.model.common.encoder.FCEncoder":{__init__:[28,1,1,""],forward:[28,1,1,""]},"ding.model.common.encoder.StructEncoder":{__init__:[28,1,1,""]},"ding.model.common.head":{DiscreteHead:[29,0,1,""],DistributionHead:[29,0,1,""],DuelingHead:[29,0,1,""],MultiHead:[29,0,1,""],QRDQNHead:[29,0,1,""],QuantileHead:[29,0,1,""],RainbowHead:[29,0,1,""],RegressionHead:[29,0,1,""],ReparameterizationHead:[29,0,1,""]},"ding.model.common.head.DiscreteHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.DistributionHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.DuelingHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.MultiHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.QRDQNHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.QuantileHead":{__init__:[29,1,1,""],forward:[29,1,1,""],quantile_net:[29,1,1,""]},"ding.model.common.head.RainbowHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.RegressionHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.ReparameterizationHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.utils":{create_model:[31,2,1,""]},"ding.model.template":{QAC:[33,0,1,""],VAC:[34,0,1,""]},"ding.model.template.QAC":{__init__:[33,1,1,""],compute_actor:[33,1,1,""],compute_critic:[33,1,1,""],forward:[33,1,1,""]},"ding.model.template.VAC":{__init__:[34,1,1,""],compute_actor:[34,1,1,""],compute_actor_critic:[34,1,1,""],compute_critic:[34,1,1,""],forward:[34,1,1,""]},"ding.model.template.coma":{COMA:[35,0,1,""],COMAActorNetwork:[35,0,1,""],COMACriticNetwork:[35,0,1,""]},"ding.model.template.coma.COMA":{__init__:[35,1,1,""],forward:[35,1,1,""]},"ding.model.template.coma.COMAActorNetwork":{__init__:[35,1,1,""],forward:[35,1,1,""]},"ding.model.template.coma.COMACriticNetwork":{__init__:[35,1,1,""],_preprocess_data:[35,1,1,""],forward:[35,1,1,""]},"ding.model.template.q_learning":{C51DQN:[37,0,1,""],DQN:[37,0,1,""],IQN:[37,0,1,""],QRDQN:[37,0,1,""],RainbowDQN:[37,0,1,"id0"]},"ding.model.template.q_learning.C51DQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.DQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.IQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.QRDQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.RainbowDQN":{__init__:[37,1,1,"id1"],forward:[37,1,1,"id2"]},"ding.model.template.qac":{QAC:[178,0,1,""]},"ding.model.template.qac.QAC":{__init__:[178,1,1,""],compute_actor:[178,1,1,""],compute_critic:[178,1,1,""],forward:[178,1,1,""]},"ding.model.template.qmix":{CollaQ:[38,0,1,""],CollaQMultiHeadAttention:[38,0,1,""],CollaQSMACAttentionModule:[38,0,1,""],Mixer:[38,0,1,""],QMix:[38,0,1,""]},"ding.model.template.qmix.CollaQ":{__init__:[38,1,1,""],_setup_global_encoder:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.CollaQMultiHeadAttention":{__init__:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.CollaQSMACAttentionModule":{__init__:[38,1,1,""],_cut_obs:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.Mixer":{__init__:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.QMix":{__init__:[38,1,1,""],_setup_global_encoder:[38,1,1,""],forward:[38,1,1,""]},"ding.policy.a2c":{A2CPolicy:[39,0,1,""]},"ding.policy.a2c.A2CPolicy":{_forward_collect:[39,1,1,""],_forward_eval:[39,1,1,""],_forward_learn:[39,1,1,""],_get_train_sample:[39,1,1,""],_init_collect:[39,1,1,""],_init_eval:[39,1,1,""],_init_learn:[39,1,1,""],_process_transition:[39,1,1,""]},"ding.policy.acer":{ACERPolicy:[172,0,1,""]},"ding.policy.collaq":{CollaQPolicy:[40,0,1,""]},"ding.policy.collaq.CollaQPolicy":{_data_preprocess_learn:[40,1,1,""],_forward_collect:[40,1,1,""],_forward_eval:[40,1,1,""],_forward_learn:[40,1,1,""],_get_train_sample:[40,1,1,""],_init_collect:[40,1,1,""],_init_eval:[40,1,1,""],_init_learn:[40,1,1,""],_load_state_dict_learn:[40,1,1,""],_process_transition:[40,1,1,""],_reset_collect:[40,1,1,""],_reset_eval:[40,1,1,""],_reset_learn:[40,1,1,""],_state_dict_learn:[40,1,1,""],default_model:[40,1,1,""]},"ding.policy.coma":{COMAPolicy:[41,0,1,""]},"ding.policy.coma.COMAPolicy":{_data_preprocess_learn:[41,1,1,""],_forward_collect:[41,1,1,""],_forward_eval:[41,1,1,""],_forward_learn:[41,1,1,""],_get_train_sample:[41,1,1,""],_init_collect:[41,1,1,""],_init_eval:[41,1,1,""],_init_learn:[41,1,1,""],_monitor_vars_learn:[41,1,1,""],_process_transition:[41,1,1,""],default_model:[41,1,1,""]},"ding.policy.ddpg":{DDPGPolicy:[42,0,1,""]},"ding.policy.ddpg.DDPGPolicy":{_forward_collect:[42,1,1,""],_forward_eval:[42,1,1,""],_forward_learn:[42,1,1,""],_init_collect:[42,1,1,""],_init_eval:[42,1,1,""],_init_learn:[42,1,1,""],_process_transition:[42,1,1,""]},"ding.policy.dqn":{DQNPolicy:[43,0,1,""]},"ding.policy.dqn.DQNPolicy":{_forward_collect:[43,1,1,""],_forward_eval:[43,1,1,""],_forward_learn:[43,1,1,""],_get_train_sample:[43,1,1,""],_init_collect:[43,1,1,""],_init_eval:[43,1,1,""],_init_learn:[43,1,1,""],_load_state_dict_learn:[43,1,1,""],_process_transition:[43,1,1,""],_state_dict_learn:[43,1,1,""],default_model:[43,1,1,""]},"ding.policy.impala":{IMPALAPolicy:[181,0,1,""]},"ding.policy.ppg":{PPGPolicy:[45,0,1,""]},"ding.policy.ppg.PPGPolicy":{_data_preprocess_learn:[45,1,1,""],_forward_collect:[45,1,1,""],_forward_eval:[45,1,1,""],_forward_learn:[45,1,1,""],_get_batch_size:[45,1,1,""],_get_train_sample:[45,1,1,""],_init_collect:[45,1,1,""],_init_eval:[45,1,1,""],_init_learn:[45,1,1,""],_load_state_dict_learn:[45,1,1,""],_monitor_vars_learn:[45,1,1,""],_process_transition:[45,1,1,""],_state_dict_learn:[45,1,1,""],default_model:[45,1,1,""],learn_aux:[45,1,1,""]},"ding.policy.ppo":{PPOPolicy:[185,0,1,""]},"ding.policy.qmix":{QMIXPolicy:[46,0,1,""]},"ding.policy.qmix.QMIXPolicy":{_data_preprocess_learn:[46,1,1,""],_forward_collect:[46,1,1,""],_forward_eval:[46,1,1,""],_forward_learn:[46,1,1,""],_get_train_sample:[46,1,1,""],_init_collect:[46,1,1,""],_init_eval:[46,1,1,""],_init_learn:[46,1,1,""],_load_state_dict_learn:[46,1,1,""],_process_transition:[46,1,1,""],_reset_collect:[46,1,1,""],_reset_eval:[46,1,1,""],_reset_learn:[46,1,1,""],_state_dict_learn:[46,1,1,""],default_model:[46,1,1,""]},"ding.policy.r2d2":{R2D2Policy:[47,0,1,""]},"ding.policy.r2d2.R2D2Policy":{_forward_collect:[47,1,1,""],_forward_eval:[47,1,1,""],_forward_learn:[47,1,1,""],_init_collect:[47,1,1,""],_init_eval:[47,1,1,""],_init_learn:[47,1,1,""],_process_transition:[47,1,1,""]},"ding.policy.rainbow":{RainbowDQNPolicy:[48,0,1,""]},"ding.policy.rainbow.RainbowDQNPolicy":{_forward_collect:[48,1,1,""],_forward_learn:[48,1,1,""],_get_train_sample:[48,1,1,""],_init_collect:[48,1,1,""],_init_learn:[48,1,1,""]},"ding.policy.sac":{SACPolicy:[189,0,1,""]},"ding.policy.sql":{SQLPolicy:[190,0,1,""]},"ding.policy.td3":{TD3Policy:[192,0,1,""]},"ding.reward_model.base_reward_model":{BaseRewardModel:[49,0,1,""],create_reward_model:[49,4,0,"-"]},"ding.reward_model.base_reward_model.BaseRewardModel":{clear_data:[49,1,1,""],collect_data:[49,1,1,""],estimate:[49,1,1,""],load_expert_data:[49,1,1,""],train:[49,1,1,""]},"ding.reward_model.gail_irl_model":{BaseRewardModel:[50,0,1,""]},"ding.reward_model.gail_irl_model.BaseRewardModel":{__init__:[50,1,1,""],clear_data:[50,1,1,""],collect_data:[50,1,1,""],estimate:[50,1,1,""],load_expert_data:[50,1,1,""],train:[50,1,1,""]},"ding.reward_model.pdeil_irl_model":{PdeilRewardModel:[52,0,1,""]},"ding.reward_model.pdeil_irl_model.PdeilRewardModel":{__init__:[52,1,1,""],clear_data:[52,1,1,""],collect_data:[52,1,1,""],estimate:[52,1,1,""],load_expert_data:[52,1,1,""],train:[52,1,1,""]},"ding.reward_model.pwil_irl_model":{PwilRewardModel:[53,0,1,""],collect_state_action_pairs:[53,4,0,"-"]},"ding.reward_model.pwil_irl_model.PwilRewardModel":{__init__:[53,1,1,""],_get_action_distance:[53,1,1,""],_get_state_distance:[53,1,1,""],clear_data:[53,1,1,""],collect_data:[53,1,1,""],estimate:[53,1,1,""],load_expert_data:[53,1,1,""],train:[53,1,1,""]},"ding.reward_model.red_irl_model":{RedRewardModel:[54,0,1,""]},"ding.reward_model.red_irl_model.RedRewardModel":{__init__:[54,1,1,""],clear_data:[54,1,1,""],collect_data:[54,1,1,""],estimate:[54,1,1,""],load_expert_data:[54,1,1,""],train:[54,1,1,""]},"ding.rl_utils.a2c":{a2c_error:[55,4,0,"-"]},"ding.rl_utils.adder":{Adder:[56,0,1,""]},"ding.rl_utils.adder.Adder":{get_gae:[56,1,1,""],get_gae_with_default_last_value:[56,1,1,""],get_nstep_return_data:[56,1,1,""],get_train_sample:[56,1,1,""]},"ding.rl_utils.coma":{coma_error:[57,4,0,"-"]},"ding.rl_utils.exploration":{BaseNoise:[58,0,1,""],GaussianNoise:[58,0,1,""],OUNoise:[58,0,1,""],create_noise_generator:[58,4,0,"-"],get_epsilon_greedy_fn:[58,4,0,"-"]},"ding.rl_utils.exploration.BaseNoise":{__call__:[58,1,1,""],__init__:[58,1,1,""]},"ding.rl_utils.exploration.GaussianNoise":{__call__:[58,1,1,""],__init__:[58,1,1,""]},"ding.rl_utils.exploration.OUNoise":{__call__:[58,1,1,""],__init__:[58,1,1,""],reset:[58,1,1,""]},"ding.rl_utils.gae":{gae:[59,4,0,"-"]},"ding.rl_utils.isw":{compute_importance_weights:[61,4,0,"-"]},"ding.rl_utils.ppo":{ppo_error:[62,4,0,"-"]},"ding.rl_utils.td":{dist_nstep_td_error:[63,4,0,"-"],generalized_lambda_returns:[63,4,0,"-"],multistep_forward_view:[63,4,0,"-"],q_nstep_td_error:[63,4,0,"-"],q_nstep_td_error_with_rescale:[63,4,0,"-"],td_lambda_error:[63,4,0,"-"]},"ding.rl_utils.upgo":{upgo_loss:[64,4,0,"-"],upgo_returns:[64,4,0,"-"]},"ding.rl_utils.value_rescale":{value_inv_transform:[65,4,0,"-"],value_transform:[65,4,0,"-"]},"ding.rl_utils.vtrace":{vtrace_error:[66,4,0,"-"]},"ding.torch_utils.checkpoint_helper":{CheckpointHelper:[67,0,1,""],CountVar:[67,0,1,""],auto_checkpoint:[67,4,0,"-"],build_checkpoint_helper:[67,4,0,"-"]},"ding.torch_utils.checkpoint_helper.CheckpointHelper":{load:[67,1,1,""],save:[67,1,1,""]},"ding.torch_utils.checkpoint_helper.CountVar":{add:[67,1,1,""],update:[67,1,1,""]},"ding.torch_utils.data_helper":{CudaFetcher:[68,0,1,""],build_log_buffer:[68,4,0,"-"],get_tensor_data:[68,4,0,"-"],same_shape:[68,4,0,"-"],tensor_to_list:[68,4,0,"-"],to_device:[68,4,0,"-"],to_dtype:[68,4,0,"-"],to_list:[68,4,0,"-"],to_ndarray:[68,4,0,"-"],to_tensor:[68,4,0,"-"]},"ding.torch_utils.data_helper.CudaFetcher":{close:[68,1,1,""],run:[68,1,1,""]},"ding.torch_utils.distribution":{CategoricalPd:[69,0,1,""],CategoricalPdPytorch:[69,0,1,""],Pd:[69,0,1,""]},"ding.torch_utils.distribution.CategoricalPd":{entropy:[69,1,1,""],mode:[69,1,1,""],neglogp:[69,1,1,""],noise_mode:[69,1,1,""],sample:[69,1,1,""],update_logits:[69,1,1,""]},"ding.torch_utils.distribution.CategoricalPdPytorch":{entropy:[69,1,1,""],mode:[69,1,1,""],neglogp:[69,1,1,""],sample:[69,1,1,""],update_logits:[69,1,1,""]},"ding.torch_utils.distribution.Pd":{entropy:[69,1,1,""],mode:[69,1,1,""],neglogp:[69,1,1,""],noise_mode:[69,1,1,""],sample:[69,1,1,""]},"ding.torch_utils.loss.cross_entropy_loss":{LabelSmoothCELoss:[74,0,1,""],SoftFocalLoss:[74,0,1,""],build_ce_criterion:[74,4,0,"-"]},"ding.torch_utils.loss.cross_entropy_loss.LabelSmoothCELoss":{forward:[74,1,1,""]},"ding.torch_utils.loss.cross_entropy_loss.SoftFocalLoss":{forward:[74,1,1,""]},"ding.torch_utils.loss.multi_logits_loss":{MultiLogitsLoss:[74,0,1,""]},"ding.torch_utils.loss.multi_logits_loss.MultiLogitsLoss":{forward:[74,1,1,""]},"ding.torch_utils.metric":{hamming_distance:[71,4,0,"-"],levenshtein_distance:[71,4,0,"-"]},"ding.torch_utils.network.activation":{GLU:[75,0,1,""],build_activation:[75,4,0,"-"]},"ding.torch_utils.network.activation.GLU":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module":{BilinearUpsample:[75,0,1,""],ChannelShuffle:[75,0,1,""],MLP:[75,4,0,"-"],NearestUpsample:[75,0,1,""],NoiseLinearLayer:[75,0,1,""],binary_encode:[75,4,0,"-"],conv1d_block:[75,4,0,"-"],conv2d_block:[75,4,0,"-"],deconv2d_block:[75,4,0,"-"],fc_block:[75,4,0,"-"],noise_block:[75,4,0,"-"],one_hot:[75,4,0,"-"],sequential_pack:[75,4,0,"-"],weight_init_:[75,4,0,"-"]},"ding.torch_utils.network.nn_module.BilinearUpsample":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module.ChannelShuffle":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module.NearestUpsample":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module.NoiseLinearLayer":{forward:[75,1,1,""],reset_noise:[75,1,1,""],reset_parameters:[75,1,1,""]},"ding.torch_utils.network.normalization":{build_normalization:[75,4,0,"-"]},"ding.torch_utils.network.res_block":{ResBlock:[75,0,1,""],ResFCBlock:[75,0,1,""]},"ding.torch_utils.network.res_block.ResBlock":{forward:[75,1,1,""]},"ding.torch_utils.network.res_block.ResFCBlock":{forward:[75,1,1,""]},"ding.torch_utils.network.rnn":{LSTM:[75,0,1,""],LSTMForwardWrapper:[75,0,1,""],PytorchLSTM:[75,0,1,""],get_lstm:[75,4,0,"-"]},"ding.torch_utils.network.rnn.LSTM":{forward:[75,1,1,""]},"ding.torch_utils.network.rnn.LSTMForwardWrapper":{_after_forward:[75,1,1,""],_before_forward:[75,1,1,""]},"ding.torch_utils.network.rnn.PytorchLSTM":{forward:[75,1,1,""]},"ding.torch_utils.network.scatter_connection":{ScatterConnection:[75,0,1,""]},"ding.torch_utils.network.scatter_connection.ScatterConnection":{forward:[75,1,1,""]},"ding.torch_utils.network.soft_argmax":{SoftArgmax:[75,0,1,""]},"ding.torch_utils.network.soft_argmax.SoftArgmax":{forward:[75,1,1,""]},"ding.torch_utils.network.transformer":{Attention:[75,0,1,""],Transformer:[75,0,1,""],TransformerLayer:[75,0,1,""]},"ding.torch_utils.network.transformer.Attention":{forward:[75,1,1,""],split:[75,1,1,""]},"ding.torch_utils.network.transformer.Transformer":{forward:[75,1,1,""]},"ding.torch_utils.network.transformer.TransformerLayer":{forward:[75,1,1,""]},"ding.torch_utils.nn_test_helper":{is_differentiable:[72,4,0,"-"]},"ding.torch_utils.optimizer_helper":{Adam:[73,0,1,""],RMSprop:[73,0,1,""]},"ding.torch_utils.optimizer_helper.Adam":{step:[73,1,1,""]},"ding.torch_utils.optimizer_helper.RMSprop":{step:[73,1,1,""]},"ding.utils.collection_helper":{iter_mapping:[76,4,0,"-"]},"ding.utils.compression_helper":{dummy_compressor:[77,4,0,"-"],dummy_decompressor:[77,4,0,"-"],get_data_compressor:[77,4,0,"-"],get_data_decompressor:[77,4,0,"-"],lz4_data_compressor:[77,4,0,"-"],lz4_data_decompressor:[77,4,0,"-"],zlib_data_compressor:[77,4,0,"-"],zlib_data_decompressor:[77,4,0,"-"]},"ding.utils.data.collate_fn":{default_collate:[78,4,0,"-"],default_decollate:[78,4,0,"-"],diff_shape_collate:[78,4,0,"-"],timestep_collate:[78,4,0,"-"]},"ding.utils.data.dataloader":{AsyncDataLoader:[79,0,1,""]},"ding.utils.data.dataloader.AsyncDataLoader":{__init__:[79,1,1,""],__iter__:[79,1,1,""],__next__:[79,1,1,""],close:[79,1,1,""]},"ding.utils.data.structure.cache":{Cache:[81,0,1,""]},"ding.utils.data.structure.cache.Cache":{__init__:[81,1,1,""],close:[81,1,1,""],get_cached_data_iter:[81,1,1,""],push_data:[81,1,1,""],run:[81,1,1,""]},"ding.utils.default_helper":{LimitedSpaceContainer:[82,0,1,""],deep_merge_dicts:[82,4,0,"-"],deep_update:[82,4,0,"-"],default_get:[82,4,0,"-"],dicts_to_lists:[82,4,0,"-"],error_wrapper:[82,4,0,"-"],flatten_dict:[82,4,0,"-"],list_split:[82,4,0,"-"],lists_to_dicts:[82,4,0,"-"],override:[82,4,0,"-"],set_pkg_seed:[82,4,0,"-"],squeeze:[82,4,0,"-"]},"ding.utils.default_helper.LimitedSpaceContainer":{__init__:[82,1,1,""],acquire_space:[82,1,1,""],decrease_space:[82,1,1,""],get_residual_space:[82,1,1,""],increase_space:[82,1,1,""],release_space:[82,1,1,""]},"ding.utils.design_helper":{SingletonMetaclass:[83,0,1,""]},"ding.utils.design_helper.SingletonMetaclass":{__call__:[83,1,1,""]},"ding.utils.file_helper":{read_file:[84,4,0,"-"],read_from_ceph:[84,4,0,"-"],read_from_file:[84,4,0,"-"],read_from_mc:[84,4,0,"-"],read_from_path:[84,4,0,"-"],read_from_redis:[84,4,0,"-"],read_from_rediscluster:[84,4,0,"-"],remove_file:[84,4,0,"-"],save_file:[84,4,0,"-"],save_file_ceph:[84,4,0,"-"],save_file_redis:[84,4,0,"-"],save_file_rediscluster:[84,4,0,"-"]},"ding.utils.import_helper":{import_module:[85,4,0,"-"],try_import_ceph:[85,4,0,"-"],try_import_link:[85,4,0,"-"],try_import_mc:[85,4,0,"-"],try_import_redis:[85,4,0,"-"],try_import_rediscluster:[85,4,0,"-"]},"ding.utils.k8s_helper":{get_operator_server_kwargs:[87,4,0,"-"]},"ding.utils.lock_helper":{LockContext:[88,0,1,""],get_rw_file_lock:[88,4,0,"-"]},"ding.utils.lock_helper.LockContext":{__enter__:[88,1,1,""],__exit__:[88,1,1,""],__init__:[88,1,1,""]},"ding.utils.log_helper":{LoggerFactory:[89,4,0,"-"],build_logger:[89,4,0,"-"],pretty_print:[89,4,0,"-"]},"ding.utils.log_helper.LoggerFactory":{create_logger:[89,2,1,""],get_tabulate_vars:[89,2,1,""]},"ding.utils.pytorch_ddp_dist_helper":{allreduce:[90,4,0,"-"],broadcast:[90,4,0,"-"],dist_finalize:[90,4,0,"-"],dist_init:[90,4,0,"-"],dist_mode:[90,4,0,"-"],error_wrapper:[90,4,0,"-"],get_group:[90,4,0,"-"],get_rank:[90,4,0,"-"],get_world_size:[90,4,0,"-"]},"ding.utils.segment_tree":{MinSegmentTree:[91,0,1,""],SegmentTree:[91,0,1,""],SumSegmentTree:[91,0,1,""]},"ding.utils.segment_tree.MinSegmentTree":{__getitem__:[91,1,1,""],__init__:[91,1,1,""],__setitem__:[91,1,1,""],reduce:[91,1,1,""]},"ding.utils.segment_tree.SegmentTree":{__getitem__:[91,1,1,""],__init__:[91,1,1,""],__setitem__:[91,1,1,""],reduce:[91,1,1,""]},"ding.utils.segment_tree.SumSegmentTree":{__getitem__:[91,1,1,""],__init__:[91,1,1,""],__setitem__:[91,1,1,""],find_prefixsum_idx:[91,1,1,""],reduce:[91,1,1,""]},"ding.utils.system_helper":{PropagatingThread:[92,0,1,""],find_free_port:[92,4,0,"-"],get_ip:[92,4,0,"-"],get_pid:[92,4,0,"-"],get_task_uid:[92,4,0,"-"]},"ding.utils.system_helper.PropagatingThread":{join:[92,1,1,""],run:[92,1,1,""]},"ding.utils.time_helper":{EasyTimer:[93,0,1,""],TimeWrapper:[93,0,1,""],TimeWrapperTime:[93,0,1,""],WatchDog:[93,0,1,""],build_time_helper:[93,4,0,"-"],get_cuda_time_wrapper:[93,4,0,"-"]},"ding.utils.time_helper.EasyTimer":{__enter__:[93,1,1,""],__exit__:[93,1,1,""],__init__:[93,1,1,""]},"ding.utils.time_helper.TimeWrapper":{end_time:[93,1,1,""],start_time:[93,1,1,""],wrapper:[93,1,1,""]},"ding.utils.time_helper.TimeWrapperTime":{end_time:[93,1,1,""],start_time:[93,1,1,""]},"ding.utils.time_helper.WatchDog":{__init__:[93,1,1,""],start:[93,1,1,""],stop:[93,1,1,""]},"ding.worker.collector.base_serial_collector":{CachePool:[94,0,1,""],ISerialCollector:[94,0,1,""],TrajBuffer:[94,0,1,""],create_serial_collector:[94,4,0,"-"],get_serial_collector_cls:[94,4,0,"-"],to_tensor_transitions:[94,4,0,"-"]},"ding.worker.collector.base_serial_collector.CachePool":{__getitem__:[94,1,1,""],__init__:[94,1,1,""],reset:[94,1,1,""],update:[94,1,1,""]},"ding.worker.collector.base_serial_collector.ISerialCollector":{collect:[94,1,1,""],default_config:[94,1,1,""],envstep:[94,3,1,""],reset:[94,1,1,""],reset_env:[94,1,1,""],reset_policy:[94,1,1,""]},"ding.worker.collector.base_serial_collector.TrajBuffer":{__init__:[94,1,1,""],append:[94,1,1,""]},"ding.worker.collector.base_serial_evaluator":{VectorEvalMonitor:[95,0,1,""]},"ding.worker.collector.base_serial_evaluator.VectorEvalMonitor":{__init__:[95,1,1,""],get_current_episode:[95,1,1,""],get_episode_info:[95,1,1,""],get_episode_reward:[95,1,1,""],get_latest_reward:[95,1,1,""],is_finished:[95,1,1,""],update_info:[95,1,1,""],update_reward:[95,1,1,""]},"ding.worker.collector.comm.base_comm_collector":{BaseCommCollector:[96,0,1,""],create_comm_collector:[96,4,0,"-"]},"ding.worker.collector.comm.base_comm_collector.BaseCommCollector":{__init__:[96,1,1,""],_create_collector:[96,1,1,""],close:[96,1,1,""],get_policy_update_info:[96,1,1,""],send_metadata:[96,1,1,""],send_stepdata:[96,1,1,""],start:[96,1,1,""]},"ding.worker.collector.comm.flask_fs_collector":{CollectorSlave:[96,0,1,""],FlaskFileSystemCollector:[96,0,1,""]},"ding.worker.collector.comm.flask_fs_collector.CollectorSlave":{__init__:[96,1,1,""],_process_task:[96,1,1,""]},"ding.worker.collector.comm.flask_fs_collector.FlaskFileSystemCollector":{__init__:[96,1,1,""],close:[96,1,1,""],deal_with_collector_data:[96,1,1,""],deal_with_collector_start:[96,1,1,""],deal_with_resource:[96,1,1,""],get_policy_update_info:[96,1,1,""],send_metadata:[96,1,1,""],send_stepdata:[96,1,1,""],start:[96,1,1,""]},"ding.worker.collector.comm.utils":{NaiveCollector:[96,0,1,""]},"ding.worker.collector.comm.utils.NaiveCollector":{_process_task:[96,1,1,""]},"ding.worker.coordinator.base_parallel_commander":{BaseCommander:[101,0,1,""],NaiveCommander:[101,0,1,""],create_parallel_commander:[101,4,0,"-"]},"ding.worker.coordinator.base_parallel_commander.NaiveCommander":{__init__:[101,1,1,""],finish_collector_task:[101,1,1,""],finish_learner_task:[101,1,1,""],get_collector_task:[101,1,1,""],get_learner_task:[101,1,1,""],notify_fail_collector_task:[101,1,1,""],notify_fail_learner_task:[101,1,1,""]},"ding.worker.coordinator.base_serial_commander":{BaseSerialCommander:[101,0,1,""]},"ding.worker.coordinator.base_serial_commander.BaseSerialCommander":{__init__:[101,1,1,""],step:[101,1,1,""]},"ding.worker.coordinator.comm_coordinator":{CommCoordinator:[100,0,1,""]},"ding.worker.coordinator.comm_coordinator.CommCoordinator":{__del__:[100,1,1,""],__init__:[100,1,1,""],close:[100,1,1,""],send_collector_task:[100,1,1,""],send_learner_task:[100,1,1,""],start:[100,1,1,""]},"ding.worker.coordinator.coordinator":{Coordinator:[102,0,1,""],TaskState:[102,0,1,""]},"ding.worker.coordinator.coordinator.Coordinator":{__del__:[102,1,1,""],__init__:[102,1,1,""],close:[102,1,1,""],deal_with_collector_finish_task:[102,1,1,""],deal_with_collector_send_data:[102,1,1,""],deal_with_learner_finish_task:[102,1,1,""],deal_with_learner_get_data:[102,1,1,""],deal_with_learner_send_info:[102,1,1,""],error:[102,1,1,""],info:[102,1,1,""],load_state_dict:[102,1,1,""],start:[102,1,1,""],state_dict:[102,1,1,""],system_shutdown_flag:[102,3,1,""]},"ding.worker.coordinator.coordinator.TaskState":{__init__:[102,1,1,""]},"ding.worker.coordinator.resource_manager":{NaiveResourceManager:[104,0,1,""]},"ding.worker.coordinator.resource_manager.NaiveResourceManager":{__init__:[104,1,1,""],assign_collector:[104,1,1,""],assign_learner:[104,1,1,""],update:[104,1,1,""]},"ding.worker.coordinator.solo_parallel_commander":{SoloCommander:[101,0,1,""]},"ding.worker.coordinator.solo_parallel_commander.SoloCommander":{__init__:[101,1,1,""],finish_collector_task:[101,1,1,""],finish_learner_task:[101,1,1,""],get_collector_task:[101,1,1,""],get_learner_task:[101,1,1,""],notify_fail_collector_task:[101,1,1,""],notify_fail_learner_task:[101,1,1,""]},"ding.worker.learner.base_learner":{BaseLearner:[107,0,1,""],create_learner:[107,4,0,"-"]},"ding.worker.learner.base_learner.BaseLearner":{__init__:[107,1,1,""],_setup_hook:[107,1,1,""],_setup_wrapper:[107,1,1,""],call_hook:[107,1,1,""],close:[107,1,1,""],register_hook:[107,1,1,""],save_checkpoint:[107,1,1,""],setup_dataloader:[107,1,1,""],train:[107,1,1,""]},"ding.worker.learner.comm.base_comm_learner":{BaseCommLearner:[105,0,1,""],create_comm_learner:[105,4,0,"-"]},"ding.worker.learner.comm.base_comm_learner.BaseCommLearner":{__init__:[105,1,1,""],close:[105,1,1,""],get_data:[105,1,1,""],send_learn_info:[105,1,1,""],send_policy:[105,1,1,""],start:[105,1,1,""]},"ding.worker.learner.comm.flask_fs_learner":{FlaskFileSystemLearner:[105,0,1,""]},"ding.worker.learner.comm.flask_fs_learner.FlaskFileSystemLearner":{__init__:[105,1,1,""],close:[105,1,1,""],get_data:[105,1,1,""],send_learn_info:[105,1,1,""],send_policy:[105,1,1,""],start:[105,1,1,""]},"ding.worker.learner.learner_hook":{Hook:[107,0,1,""],LearnerHook:[107,0,1,""],LoadCkptHook:[107,0,1,""],LogReduceHook:[107,0,1,""],LogShowHook:[107,0,1,""],SaveCkptHook:[107,0,1,""],build_learner_hook_by_cfg:[107,4,0,"-"],merge_hooks:[107,4,0,"-"],register_learner_hook:[107,4,0,"-"]},"ding.worker.learner.learner_hook.Hook":{__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LearnerHook":{__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LoadCkptHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LogReduceHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LogShowHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.SaveCkptHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.replay_buffer.advanced_buffer":{AdvancedReplayBuffer:[108,0,1,""]},"ding.worker.replay_buffer.advanced_buffer.AdvancedReplayBuffer":{clear:[108,1,1,""],close:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],start:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.base_buffer":{IBuffer:[108,0,1,""],create_buffer:[108,4,0,"-"],get_buffer_cls:[108,4,0,"-"]},"ding.worker.replay_buffer.base_buffer.IBuffer":{clear:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.episode_buffer":{EpisodeReplayBuffer:[108,0,1,""]},"ding.worker.replay_buffer.episode_buffer.EpisodeReplayBuffer":{__init__:[108,1,1,""],clear:[108,1,1,""],close:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],start:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.naive_buffer":{NaiveReplayBuffer:[108,0,1,""]},"ding.worker.replay_buffer.naive_buffer.NaiveReplayBuffer":{clear:[108,1,1,""],close:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],start:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.utils":{PeriodicThruputMonitor:[108,0,1,""],SampledDataAttrMonitor:[108,0,1,""],UsedDataRemover:[108,0,1,""]},"ding.worker.replay_buffer.utils.UsedDataRemover":{add_used_data:[108,1,1,""],close:[108,1,1,""],start:[108,1,1,""]}},objnames:{"0":["py","class","Python class"],"1":["py","method","Python method"],"2":["py","function","Python function"],"3":["py","property","Python property"],"4":["py","module","Python module"],"5":["py","enum","Python enum"],"6":["py","attribute","Python attribute"]},objtypes:{"0":"py:class","1":"py:method","2":"py:function","3":"py:property","4":"py:module","5":"py:enum","6":"py:attribute"},terms:{"0":[0,4,8,12,17,19,20,23,26,27,29,33,34,38,40,41,42,43,45,46,47,48,55,56,57,58,59,62,63,64,66,68,71,73,74,75,78,79,81,82,90,91,93,107,114,115,117,120,123,126,127,128,129,130,131,133,134,135,136,138,141,142,143,144,145,146,147,150,151,153,154,155,156,158,159,161,162,163,166,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,193,195,196,197,199,200],"00":145,"0000":145,"0001":[4,135,145],"000100":[150,151],"0008":145,"001":[40,41,43,46,47,73,136,162,176,177,179,186],"001000":134,"0014312267303466797":[150,151],"0024187564849853516":[150,151],"002432107925415039":[150,151],"0024328231811523438":[150,151],"0024368762969970703":[150,151],"0034339427947998047":[150,151],"004":[143,144],"005":[42,143,144,145,178,189,192],"0067":145,"007":187,"0072":[34,171,181,185],"008":[143,144],"008758":[150,151],"008813":[150,151],"009722":[150,151],"01":[41,45,58,73,143,144,145,146,147,177,184],"01083":75,"011":173,"01224":172,"01290":189,"01561":[66,181],"01783":[55,171],"02":[143,144],"020":193,"0201":[34,171,181,185],"02275":177,"02298":187,"0235":[34,171,181,185],"02438":59,"0252":[34,171,181,185],"0295":145,"02971":[42,178],"03":[143,144],"03051":193,"03497":193,"0370":[33,178,192],"03762":75,"03852":180,"04":195,"04043":[174,176,177,186],"04416":184,"04678":53,"04931":183,"05":[48,135,143,144,145,175,187],"05296":186,"06":[29,188],"06347":[62,185],"0645836e":[150,151],"06580924987792969":[150,151],"0658106803894043":[150,151],"06581401824951172":[150,151],"06583261489868164":[150,151],"06686019897460938":[150,151],"06700":187,"06750":54,"06805300712585449":[150,151],"06887":175,"06923":175,"07":[143,144,150,151,188],"0773":[33,178,192],"07733":174,"08":[73,143,144,190],"08165":190,"08265":193,"08531":176,"09":[143,144],"0917":[33,178,192],"0927":145,"09477":192,"09729":62,"098996":134,"09936":180,"0i":176,"1":[4,8,17,19,20,23,26,27,28,29,33,34,37,40,41,42,43,45,46,47,48,56,58,59,62,63,64,65,66,68,71,74,75,76,78,79,81,82,91,93,107,114,115,118,120,122,126,127,128,130,131,133,134,135,136,138,141,142,143,144,145,146,147,149,150,151,152,153,154,156,157,158,159,162,166,167,168,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,195,196,197,199],"10":[29,37,41,42,43,45,47,48,82,108,114,115,123,125,135,136,142,143,144,151,158,159,172,173,175,177,178,179,184,187,189,192,193,195,199],"100":[43,47,73,82,118,125,131,151,154,158,159,162,164,165,179,188,199],"1000":[125,131,135,188],"10000":[42,43,117,136,162,178,179,189,192,199],"100000":[135,199],"1001":141,"10044":175,"1007":173,"100\u500d\u7684\u901f\u5ea6\u63d0\u5347":150,"100kb":147,"1017":190,"10201":141,"1024":[75,150,151],"1025":141,"1038":[173,193],"105u":[150,151],"10600":141,"10635":174,"10906u":[150,151],"10979u":[150,151],"10gi":161,"10h":141,"10m":[135,141],"11":[8,41,42,43,45,47,48,115,141,142,143,144,145,158,159,175,177,178,179,184,187,188,189,192,199],"11000":141,"11095u":[150,151],"11108":190,"1110u":[150,151],"112":[143,144],"113733u":[150,151],"11485":[46,186],"1149592":190,"1150u":[150,151],"11520":141,"11719":141,"12":[43,45,47,48,63,95,115,158,159,175,179,184,187,189,190,192,199],"120":166,"1200":141,"12000":141,"12139":141,"12230u":[150,151],"123":145,"1230":141,"1248u":[150,151],"126":145,"127":[17,20,153,154],"12729":185,"128":[4,28,29,34,35,37,43,47,75,134,135,136,145,150,151,171,175,179,181,185,187,200],"12894":188,"12894v1":188,"12950":190,"13":[43,45,47,143,144,145,150,151,179,184,189],"130":[143,144],"13015bbca192_750418_logg":134,"130u":[150,151],"1312":179,"13350u":[150,151],"13367u":[150,151],"13421u":[150,151],"13446":177,"136":145,"1364u":[150,151],"1370":141,"13705u":[150,151],"1388":190,"13h":141,"14":[43,45,47,143,144,179,184,189],"1401":141,"14247":141,"1459":141,"1479":190,"149":145,"1493":141,"1496df45":134,"14990":141,"15":[19,27,43,45,47,58,143,144,145,178,179,184],"15000":135,"1506":59,"1509":[42,178],"153":145,"153392":190,"155":190,"15510u":[150,151],"15520":141,"15627":141,"157":[143,144],"15730u":[150,151],"15780":141,"16":[8,43,47,76,145,150,151,161,179,195],"160":135,"1602":[55,171],"1611":[172,180],"162":145,"1620u":[150,151],"16245":141,"1626453528":134,"1626453748":134,"1626453750":134,"1626453752":134,"16331":141,"1639":[33,178,192],"1655u":[150,151],"1665":190,"1670":141,"16775":141,"1683":190,"1699":[158,159],"16gv100":151,"16mb":145,"17":[43,145,179],"1700":141,"17013":141,"1702":190,"1706":[75,177,186],"1707":[62,75,175,185,193],"1710":[175,187],"1750":190,"176":[143,144],"17866":141,"18":[43,63,143,144,145,150,151,179,195],"1800":141,"1801":189,"1802":[66,181,192],"1803":[46,186],"1805":174,"1806":175,"1807":180,"1810":188,"18355u":[150,151],"1850":141,"1880":141,"18906":141,"19":[43,143,144,145,179],"1902":[174,176,177,186],"19034":141,"1905":[54,190],"1911":[174,193],"1912":62,"19120u":[150,151],"19286u":[150,151],"195":199,"1950":141,"197":190,"1_t":177,"1e":[29,42,62,73,126,178,188,189,192],"1e10":138,"1e8":[190,200],"1m":[141,150,151],"1s":[146,147],"1st":53,"1step":[41,177],"1v1":155,"2":[8,11,19,23,28,29,33,37,40,41,42,43,45,46,47,48,53,58,62,63,65,73,74,75,76,78,82,91,108,114,115,126,127,128,130,133,134,135,136,138,141,142,143,144,145,149,150,151,152,153,154,155,157,158,159,160,167,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,195,196,197,199,201],"20":[40,46,89,123,135,136,141,145,164,165,176,186,190,195],"200":190,"2000":[130,141],"20000":[136,141],"2000u":[150,151],"2005":185,"2006":53,"2007":187,"2009":184,"2010":176,"2011":173,"2013":179,"2015":178,"2016":[171,172,173,180],"2017":[173,175,177,185,186,187,193],"2018":[174,175,177,180,181,186,188,189,192],"2019":[174,176,177,186,190,193],"2020":[176,184,185,187,188],"2021":[177,183],"203":173,"2032u":[150,151],"20363":141,"2037u":[150,151],"204073u":[150,151],"2044":145,"2047u":[150,151],"204976u":[150,151],"2082":141,"20distribut":69,"20m":188,"210":135,"2103":183,"2104":177,"2143u":[150,151],"2153u":[150,151],"2197":141,"22":[142,143,144],"2229":141,"2274u":[150,151],"22h":161,"23":114,"230":173,"2300":141,"233":[20,21,153,154,158,159],"2333":[17,20],"235u":[150,151],"238":190,"23900":190,"2390608":190,"2396":141,"2399u":[150,151],"24":8,"240":4,"240u":[150,151],"246u":[150,151],"247700":190,"247u":[150,151],"24h":141,"25":[27,76,143,144,158,159],"25000":[42,178,189,192],"250000":135,"253u":[150,151],"254u":[150,151],"256":[75,150,151,189],"25769":[150,151],"257u":[150,151],"2592":[143,144],"25m":141,"26":[138,145],"2609":141,"261u":[150,151],"264u":[150,151],"265u":[150,151],"266u":[150,151],"2682144":190,"269u":[150,151],"27":[115,143,144,145],"276":145,"277":190,"278250":190,"2796":145,"2860":141,"28h":141,"29":[143,144,180],"2906u":[150,151],"29383u":[150,151],"296":145,"2976":[143,144],"2c07ac22512a16715cc759f0072be43a5d12ae45":63,"2d":[75,135,195],"2e8879e3":134,"2e9":27,"2ep":65,"2h":141,"2m":141,"2nd":53,"3":[8,23,27,29,33,37,38,40,41,42,43,45,46,47,48,58,75,76,78,82,108,114,115,119,126,127,128,130,132,133,134,135,136,138,141,143,144,145,149,150,151,152,153,154,156,157,158,159,162,171,172,173,175,176,177,178,179,181,184,186,187,188,189,192,195,196,197,199,201,202],"30":[4,120,135,143,144,195],"300":[143,144],"3000":[143,144],"30000":161,"309u":[150,151],"31":[143,144,145],"3100":141,"310u":[150,151],"311":[143,144],"311u":[150,151],"3120":141,"31376":190,"314":117,"32":[28,29,37,38,115,125,135,145,172,175,176,179,181],"32085405":75,"32436":190,"325u":[150,151],"328u":[150,151],"329":145,"32g":[150,151],"32gv100":[150,151],"33":142,"3350":145,"34":145,"3472":141,"34879333":75,"35":[27,143,144,145,191],"354":173,"3581":141,"35856":190,"3589":141,"359":173,"36":145,"3607f1428aaa_907961":134,"3620":141,"368u":[150,151],"36u":[150,151],"3700":141,"3880":141,"3882":141,"388u":[150,151],"3898u":[150,151],"389u":[150,151],"38h":141,"39":[143,144,145],"393u":[150,151],"394u":[150,151],"39693u":[150,151],"3980":141,"3982":[141,145],"3e":189,"3h":141,"3s5z":[141,199],"4":[4,29,33,34,37,42,43,47,48,68,75,76,78,82,96,114,115,120,126,127,129,133,134,135,138,141,143,144,145,146,147,149,150,151,152,158,159,171,172,175,178,179,181,183,185,187,188,189,192,193,199,201],"40":145,"400":138,"4000":[135,141],"407":[143,144],"40k":188,"40kb":145,"41":145,"420u":[150,151],"422u":[150,151],"423u":[150,151],"424u":[150,151],"4250":141,"426298":[150,151],"4388":141,"44":[143,144],"45":[143,144],"4525":[139,140],"4565":180,"4570":141,"4573":180,"459u":[150,151],"463u":[150,151],"467":[143,144],"47":[143,144],"474u":[150,151],"480u":[150,151],"482":190,"4890b4c5":134,"49":[143,144,145],"4923":145,"4927":141,"4955":145,"4a1b":134,"4a1d":134,"4c94":134,"4e29":134,"4e9":27,"4eabd5218e3d0da5e7aafcbf48ea0df2daded1bddf0b8724fde1569aa78f24a7":8,"4ebb":134,"4ep":65,"4f38":134,"4h":141,"5":[8,17,19,23,26,27,29,40,41,42,43,45,46,47,48,62,73,75,76,95,115,118,126,135,136,138,141,143,144,145,149,150,151,152,153,154,155,158,159,172,175,176,177,178,179,181,184,186,187,188,189,192,199,200],"50":[143,144,145,155,190],"500":135,"5007":141,"5087":145,"50969u":[150,151],"51":[29,37,48,143,144,145,175,187],"5116":141,"512":[135,150,151],"5179u":[150,151],"519":[143,144],"51923u":[150,151],"5198u":[150,151],"52":[143,144,145],"520":[143,144],"5208":141,"5214u":[150,151],"5219":145,"5274":145,"5319":141,"53805":190,"54":[143,144],"5429u":[150,151],"545":[143,144],"5489":141,"55":[8,141,143,144],"550":173,"555":[143,144],"559u":[150,151],"56":145,"5602":179,"561u":[150,151],"5652u":[150,151],"5653u":[150,151],"5677u":[150,151],"567u":[150,151],"57":[135,187],"5700":141,"571u":[150,151],"577":[143,144],"5784":141,"58":145,"5850":141,"5860u":[150,151],"5890u":[150,151],"59":145,"5930u":[150,151],"5940u":[150,151],"5h":141,"5kb":145,"5m":141,"6":[8,37,40,41,42,43,45,46,47,48,115,126,127,129,133,135,138,141,143,144,145,149,150,151,152,172,173,175,176,177,178,179,181,184,186,187,188,189,192,195,199],"60":[143,144,145,146,147],"61":[143,144,173],"6127":145,"62":[143,144,145],"622":141,"627":141,"62810u":[150,151],"63":[143,144],"64":[8,28,29,33,34,35,37,38,43,47,114,118,134,136,143,144,145,150,151,162,171,175,178,179,181,185,187,192,200],"64mb":145,"65":[143,144],"65850u":[150,151],"66":161,"67":[143,144,145],"692":141,"69232":141,"693":195,"693664":190,"6h":141,"6m":141,"7":[40,41,42,43,45,46,47,48,115,133,141,143,144,145,158,159,172,175,176,177,178,179,181,184,186,187,189,192,195],"70":[27,143,144,145],"703":[143,144],"71":[143,144],"72":145,"7235":19,"7236":[17,19,23],"73":[143,144],"7307":141,"7335":145,"74":[143,144],"7403":145,"7441":145,"749u":[150,151],"7530":145,"755":141,"75f9fa602388_614285_logg":134,"76":[141,145],"765848":190,"77":[143,144],"7703":145,"776u":[150,151],"7968":141,"7h":141,"7m":151,"7ms\u964d\u4f4e\u52308":150,"8":[37,40,41,42,43,45,46,47,48,62,63,75,115,126,135,136,141,143,144,145,151,156,158,159,161,162,166,171,172,175,176,177,178,179,184,186,187,189,192,195,200],"80":[143,144,145,161],"80000":190,"8080":[153,154],"8088":[153,154],"81":145,"812":141,"81368019":93,"8142":145,"82":[143,144,145],"8200":141,"82da":134,"82u":[150,151],"83016":190,"8311u":[150,151],"83u":[150,151],"84":[4,37,127,135,143,144,179,199],"840":141,"8421":145,"845367u":[150,151],"84x84":[4,120],"852u":[150,151],"861429u":[150,151],"8645":145,"88":[143,144],"8815":134,"8825":145,"8843":145,"8858":134,"8929":[158,159],"8af5":134,"8af829f03845_711157_logg":134,"8d50":134,"8m":[150,151],"8s":161,"8x8":188,"9":[40,41,42,43,45,47,48,63,73,76,141,145,151,172,175,176,177,178,179,184,187,189,192],"90":[143,144],"900u":[150,151],"9124":145,"92":[143,144],"9258":173,"9268":145,"93":[143,144],"9365":145,"938":141,"9381":145,"94":[143,144],"944":141,"9451":134,"9496":141,"95":[43,45,47,48,66,136,162,175,179,181,184,187,188],"9525":145,"95u":[150,151],"96":[135,188],"960":141,"9625":145,"9670":145,"9684":145,"97":[43,48,59,128,136,162,175,179,187,200],"9750":141,"98":[143,144],"98873u":[150,151],"989":141,"99":[40,41,45,46,56,59,73,135,176,177,181,184,186,188],"990":141,"997":47,"999":[43,47,48,73,175,179,187,188],"9h":141,"\u015bwiechowski":183,"\u03b8":188,"\u03b8_":188,"\u4e00\u4e2a\u7b80\u5355\u7684\u4f8b\u5b50":153,"\u4e00\u4e2a\u7b80\u5355\u7684demo":142,"\u4e00\u4e9b\u8f83\u590d\u6742\u7684\u60c5\u5f62\u53ef\u4ee5\u4f7f\u7528":168,"\u4e00\u5b9a\u662f\u5b8c\u6210\u4e86":146,"\u4e00\u5f8b\u4f7f\u7528":148,"\u4e00\u65e6coordinator\u53d1\u6765\u4efb\u52a1":156,"\u4e00\u6837":146,"\u4e00\u6b21\u5b9e\u9a8c\u5305\u62ec50\u6b21\u6570\u636e\u5904\u7406":145,"\u4e00\u6b65\u6240\u9700\u7684\u65f6\u95f4":143,"\u4e00\u79cd\u662f\u901a\u8fc7\u5b66\u5230\u7684model\u751f\u6210\u4e00\u4e9b\u4eff\u771f\u8f68\u8ff9":196,"\u4e00\u79cd\u7ecf\u5178\u7684\u65b9\u6cd5\u662f":196,"\u4e00\u822c\u4f7f\u7528\u8005\u5ffd\u7565\u5373\u53ef":139,"\u4e00\u822c\u5305\u62ec":148,"\u4e00\u822c\u5305\u62ec\u7ef4\u5ea6":148,"\u4e00\u822c\u5728\u73af\u5883\u5f00\u59cb\u5b9e\u9645\u8fd0\u884c\u524d\u8c03\u7528":148,"\u4e00\u822c\u5c06\u73af\u5883\u4e2d\u6240\u6709\u6709\u6548\u52a8\u4f5c":196,"\u4e00\u822c\u5efa\u8bae\u628a\u65b0\u7684\u4ee3\u7801\u5e93\u653e\u5230\u5404\u81ea\u7684\u5c0f\u7ec4":168,"\u4e00\u822c\u60c5\u51b5\u4e0b\u4e5f":168,"\u4e00\u822c\u6765\u8bf4":[146,164],"\u4e00\u822c\u7684\u73af\u5883\u4f1a\u4f7f\u7528\u5b9e\u503c\u5411\u91cf":196,"\u4e00\u822c\u7684\u8fd0\u884c\u5373\u53ef\u5b8c\u6210":153,"\u4e00\u822c\u8868\u793a\u4e3a":196,"\u4e00\u822c\u9700\u8981\u5728":148,"\u4e00\u822c\u975e\u5f00\u53d1\u8005\u65e0\u9700\u6307\u5b9a\u8be5\u9009\u9879":139,"\u4e00\u8282":168,"\u4e00\u8fb9\u53bb\u8bad\u7ec3actor\u7f51\u7edc":196,"\u4e09\u4e2a\u65b9\u6cd5hook\u4e2d\u9700\u8981\u7528\u5230\u7684\u65b9\u6cd5":156,"\u4e09\u8005\u7684\u6570\u636e\u8bfb\u53d6\u901f\u5ea6\u53ca\u6574\u4f53\u8bad\u7ec3\u6548\u7387\u4e3a":145,"\u4e0a":[143,158],"\u4e0a\u4e00\u4e2a":145,"\u4e0a\u56fe\u5373\u5c55\u793a\u4e86coordinator\u548ccomm":156,"\u4e0a\u7684\u6240\u6709\u51fd\u6570\u5c06\u4f1a\u88ab\u8c03\u7528":164,"\u4e0a\u7684\u8fd0\u884c\u7ed3\u679c\u5982\u4e0b":150,"\u4e0b":[150,168,196],"\u4e0b\u4ee5\u65b9\u4fbf\u67e5\u770b":164,"\u4e0b\u662f\u5426\u5171\u4eab\u6a21\u578b\u672c\u8eab":164,"\u4e0b\u7684":168,"\u4e0b\u9762\u7684\u4ee3\u7801\u63d0\u4f9b\u4e86\u4e00\u4e2a\u7b80\u5355\u6837\u4f8b":139,"\u4e0b\u9762\u7684\u7ae0\u8282\u6211\u4eec\u4f1a\u66f4\u8be6\u7ec6\u5730\u4ecb\u7ecd\u5f3a\u5316\u5b66\u4e60\u4e2d\u5b66\u4e60\u7b56\u7565\u7684\u65b9\u6cd5":196,"\u4e0d\u4f1a\u8fd4\u56de\u5b50\u73af\u5883\u7684":146,"\u4e0d\u4f20\u5165\u53c2\u6570\u65f6\u9ed8\u8ba4":146,"\u4e0d\u5229\u4e8e\u521d\u5b66\u8005\u4e0a\u624b\u7b49\u539f\u56e0":164,"\u4e0d\u540c\u6216\u65b0\u589e\u7684\u5c5e\u6027":146,"\u4e0d\u540c\u6216\u65b0\u589e\u7684\u65b9\u6cd5":146,"\u4e0d\u540c\u7684\u73af\u5883\u4e2d\u53ef\u80fd\u5b58\u5728\u5176\u4ed6\u96be\u4ee5\u5904\u7406\u7684\u5956\u52b1\u51fd\u6570":196,"\u4e0d\u540c\u7684\u73af\u5883\u6240\u5141\u8bb8\u7684\u52a8\u4f5c\u7a7a\u95f4\u4e0d\u540c":196,"\u4e0d\u5b9c\u5728\u8282\u70b9\u4e0a\u5206\u6563\u7b97\u529b":153,"\u4e0d\u662ftypeerror":158,"\u4e0d\u7136\u901a\u8fc7\u629b\u51fa":153,"\u4e0d\u8981\u628a\u4e0d\u5b8c\u6574\u7684":168,"\u4e0d\u8981\u628a\u4efb\u4f55\u4e0e\u9879\u76ee\u5b9e\u73b0\u65e0\u5173\u7684\u6587\u4ef6\u7b7e\u5165":168,"\u4e0d\u8981\u76f4\u63a5\u4f7f\u75280\u6216\u7f3a\u7701\u7b49\u5bb9\u6613\u78b0\u649e\u7684\u503c":153,"\u4e0d\u8981\u76f4\u63a5\u4f7f\u7528master\u7c7b\u521b\u5efamaster\u7aef":153,"\u4e0d\u8981\u76f4\u63a5\u4f7f\u7528slave\u7c7b\u521b\u5efaslave\u7aef":153,"\u4e0d\u96be\u53d1\u73b0":145,"\u4e0e":[143,145,148,156,158],"\u4e0e\u4e4b\u7c7b\u4f3c\u7684\u4e5f\u6709\u7c7b\u4f3c\u51e0\u4e2a\u4efb\u52a1\u6a21\u5f0f":153,"\u4e0e\u4f7f\u7528":164,"\u4e0e\u503c\u51fd\u6570\u7684\u65b9\u6cd5\u76f8\u6bd4":196,"\u4e0e\u57fa\u4e8e\u503c\u51fd\u6570\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u4e0d\u540c":196,"\u4e0e\u76d1\u7763\u5b66\u4e60":196,"\u4e0eslave\u7c7b\u4f3c":153,"\u4e14":145,"\u4e14\u4e3a\u8fd9\u4e2aissu":168,"\u4e14\u4e3a\u8fd9\u4e2aissue\u6253\u4e0a\u76f8\u5e94label":168,"\u4e14\u4fdd\u7559\u539f\u503c":158,"\u4e14\u5728\u5927\u89c4\u6a21\u73af\u5883\u6216\u957f":143,"\u4e14\u5728\u9700\u8981\u7684\u65f6\u5019\u5b9e\u73b0\u8bf8\u5982":153,"\u4e14\u5efa\u8bae\u5b9e\u73b0":153,"\u4e14\u6ee1\u8db3":196,"\u4e14\u968f\u7740\u73af\u5883\u89c4\u6a21\u4e0e\u6570\u636e\u6d41\u538b\u529b\u7684\u589e\u5927":145,"\u4e14\u9700\u8981\u65b9\u4fbf\u4e1a\u52a1\u5c42\u8c03\u5ea6\u7ba1\u7406\u7684\u5b9e\u9645\u9700\u6c42":153,"\u4e24\u4e2a\u6846\u67b6\u4e2d":143,"\u4e24\u4e2a\u7c7b\u6784\u6210\u5b8c\u6574\u7684\u73af\u5883\u5143\u7d20":148,"\u4e24\u4e2a\u90e8\u5206\u7684\u4e0d\u540c\u4e5f\u9020\u6210\u4e86\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u533a\u522b":196,"\u4e24\u79cd\u60c5\u51b5":156,"\u4e24\u8005\u533a\u522b\u662f\u4ec0\u4e48":196,"\u4e2a\u73af\u5883":143,"\u4e2a\u8bad\u7ec3\u6837\u672c":143,"\u4e2d":[139,145,148,156,164],"\u4e2d\u4f1a\u5728comm":156,"\u4e2d\u4f1a\u6839\u636e":148,"\u4e2d\u4f7f\u7528":164,"\u4e2d\u4f7f\u7528\u7684":164,"\u4e2d\u4f7f\u7528\u81ea\u5b9a\u4e49\u7684":164,"\u4e2d\u53d6\u51fa\u6570\u636e":156,"\u4e2d\u53d6\u51fa\u6570\u636e\u8bf7\u6c42":156,"\u4e2d\u53ea\u5bf9\u5e38\u7528\u7684":164,"\u4e2d\u53ea\u7ef4\u62a4\u901a\u7528\u7684\u72b6\u6001\u53d8\u91cf":148,"\u4e2d\u5b50\u73af\u5883\u7684":146,"\u4e2d\u5b50\u73af\u5883\u7684\u6570\u91cf":146,"\u4e2d\u5b9a\u4e49\u7684":164,"\u4e2d\u5b9e\u73b0":164,"\u4e2d\u5b9e\u73b0\u9759\u6001\u51fd\u6570":148,"\u4e2d\u6307\u5b9a":146,"\u4e2d\u6307\u5b9a\u6700\u5927":146,"\u4e2d\u6307\u5b9a\u7684":146,"\u4e2d\u6709\u4e86\u6570\u636e\u4fe1\u606f":156,"\u4e2d\u7528\u5230":164,"\u4e2d\u7684":[143,145,148],"\u4e2d\u7684\u4efb\u610f\u53d8\u91cf\u8fdb\u884c\u64cd\u4f5c":164,"\u4e2d\u7684\u6570\u636e\u4ece":145,"\u4e2d\u7684\u6587\u4ef6\u65f6":168,"\u4e2d\u7684\u952e\u5bf9\u5e94\u7684\u5b50\u73af\u5883":146,"\u4e2d\u76f4\u63a5\u5bf9":164,"\u4e2d\u7ee7\u7eed\u5bfb\u627e":164,"\u4e2d\u83b7\u53d6\u4e00\u4e2a\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5e76\u6267\u884c":145,"\u4e2d\u83b7\u53d6\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5e76\u6267\u884c":145,"\u4e2d\u83b7\u53d6\u8bad\u7ec3\u4fe1\u606f":156,"\u4e2d\u8bbe\u7f6e":150,"\u4e2d\u8fd4\u56de":148,"\u4e2d\u8fd4\u56de\u4e0a\u8ff0hook":156,"\u4e2d\u8fd9\u4e9b\u53c2\u6570\u7684\u8bbe\u7f6e\u548c\u9ed8\u8ba4\u503c\u5982\u4e0b":146,"\u4e32\u884c\u6ca1\u6709":156,"\u4e32\u884cpipelin":156,"\u4e3a\u4e00\u6279\u6570\u636e\u6570\u91cf":145,"\u4e3a\u4e00\u79cd\u65b9\u4fbf\u6613\u7528\u4e14\u6613\u914d\u7f6e\u7684\u65e5\u5fd7\u67b6\u6784":142,"\u4e3a\u4e86\u63d0\u5347\u6027\u80fd":150,"\u4e3a\u4e86\u65b9\u4fbf\u5730\u5bf9\u73af\u5883\u7c7b\u7684\u8f93\u5165\u8f93\u51fa\u505a\u4e00\u4e9b\u64cd\u4f5c\u6216\u8005\u9002\u914d":164,"\u4e3a\u4e86\u65b9\u4fbf\u5bf9\u4efb\u52a1\u903b\u8f91\u7684\u5b9e\u73b0":153,"\u4e3a\u4e86\u65b9\u4fbf\u5bf9\u529f\u80fd\u7684\u6269\u5c55":153,"\u4e3a\u4e86\u66f4\u597d\u5730\u7406\u89e3\u5404\u79cd\u5f3a\u5316\u5b66\u4e60\u7684\u65b9\u6cd5":196,"\u4e3a\u4e86\u66f4\u8be6\u7ec6\u5730\u4ecb\u7ecd\u5f3a\u5316\u5b66\u4e60\u7684\u7406\u8bba\u7ec6\u8282\u4e0e\u6280\u672f":196,"\u4e3a\u4e86\u907f\u514d\u6b67\u4e49":158,"\u4e3a\u4ec0\u4e48\u8981\u4f7f\u7528replai":196,"\u4e3a\u4f8b":156,"\u4e3a\u4fdd\u6301fork\u4ee3\u7801\u5e93\u548c\u539f\u4ee3\u7801\u5e93\u540c\u6b65":168,"\u4e3a\u5176\u589e\u52a0\u65b0\u7684\u5b57\u6bb5":148,"\u4e3a\u52a8\u4f5c\u52a0\u4e0a\u6307\u5b9a\u79cd\u7c7b":164,"\u4e3a\u56de\u62a5\u51fd\u6570":196,"\u4e3a\u5c06\u4e00\u6279\u6570\u636e\u5206\u5272\u5f00\u540e\u7684\u4e00\u5757\u6570\u636e\u6570\u91cf":145,"\u4e3a\u5df2\u7ecf\u6ce8\u518c\u7684\u4efb\u610f":164,"\u4e3a\u5e76\u884c\u8bad\u7ec3\u8bbe\u7f6edataload":156,"\u4e3a\u6027\u80fd\u8bc4\u6d4b\u521b\u5efa\u76f8\u5e94\u7684\u73af\u5883\u914d\u7f6e\u6587\u4ef6":148,"\u4e3a\u6298\u6263\u56e0\u5b50":196,"\u4e3a\u6570\u636e\u6536\u96c6\u521b\u5efa\u76f8\u5e94\u7684\u73af\u5883\u914d\u7f6e\u6587\u4ef6":148,"\u4e3a\u65b9\u4fbf\u7ba1\u7406\u5404\u5b50\u73af\u5883\u7684\u72b6\u6001\u5e76\u4fbf\u4e8e":146,"\u4e3a\u6709\u9650\u7684\u52a8\u4f5c\u96c6":196,"\u4e3a\u6709\u9650\u7684\u72b6\u6001\u96c6":196,"\u4e3a\u72b6\u6001\u8f6c\u79fb\u6982\u7387":196,"\u4e3a\u73af\u5883\u8fdb\u7a0b\u53d1\u9001\u52a8\u4f5c\u547d\u4ee4":146,"\u4e3a\u9632\u6b62\u6709\u4e9b\u5b50\u73af\u5883\u56e0\u8fde\u63a5\u95ee\u9898\u77ed\u6682\u5730\u62a5\u9519":146,"\u4e3b\u6253\u901a\u7528\u6027":142,"\u4e3b\u8981\u5206\u4e3a\u5982\u4e0b\u51e0\u4e2a\u5b50\u6a21\u5757":156,"\u4e3b\u8981\u662f\u5728":164,"\u4e3b\u8981\u662f\u9488\u5bf9di":150,"\u4e3b\u8981\u8868\u73b0\u4e3a\u8ba1\u65f6\u76f8\u5173\u7684":164,"\u4e3e\u4f8b\u5982\u4e0b":153,"\u4e4b\u524d":164,"\u4e4b\u540e":[164,168],"\u4e4b\u540e\u4f1a\u81ea\u52a8":146,"\u4e4b\u5916":143,"\u4e4b\u95f4\u7684\u987a\u5e8f":145,"\u4e58\u4ee5":143,"\u4e5f\u5373\u7b2c\u4e00\u5f20\u987a\u5e8f\u56fe\u4e2d\u88ab\u7565\u53bb\u7684\u90e8\u5206":156,"\u4e5f\u53ef\u4ee5\u5bf9\u4e0d\u540c\u7684\u7b56\u7565\u7a7a\u95f4\u4e2d\u627e\u5230\u6700\u4f18\u7b56\u7565":196,"\u4e5f\u53ef\u4ee5\u628a\u8fd9\u4e9b\u505a\u5230\u4e00\u534a\u7684":168,"\u4e5f\u53ef\u4ee5\u7406\u89e3\u4e3a":145,"\u4e5f\u53ef\u4f9b\u66f4\u8fdb\u4e00\u6b65\u7684\u5c01\u88c5":142,"\u4e5f\u53ef\u5b9a\u4e49\u76f8\u5e94\u7684\u529f\u80fd\u7c7b":153,"\u4e5f\u5c06\u6309\u7167\u4ece\u4e0a\u81f3\u4e0b\u7684\u987a\u5e8f\u5c55\u793a\u4e09\u4e2a":145,"\u4e5f\u5c31\u662f\u8ba1\u7b97\u5f97\u5230\u52a8\u4f5c\u4e0a\u7b56\u7565\u68af\u5ea6":196,"\u4e5f\u5e76\u975e":145,"\u4e5f\u5fc5\u987b\u7b49\u5f85":145,"\u4e5f\u662f\u5173\u952e\u6240\u5728":142,"\u4e5f\u662f\u6700\u5e38\u89c1\u7684\u5e38\u89c1\u6a21\u578b":196,"\u4e5f\u66f4\u5efa\u8bae\u5404\u4f4d\u4f7f\u7528\u8005\u5145\u5206\u5229\u7528\u8fd9\u4e00\u7279\u6027":158,"\u4e5f\u8bb8\u8981\u82b1\u8d39\u76f8\u5f53\u7684\u7cbe\u529b":164,"\u4e5f\u9075\u5faa":148,"\u4e86":164,"\u4e86\u5f85\u4f18\u5316\u7684\u7b56\u7565\u9501\u51b3\u5b9a\u7684\u51b3\u7b56\u5e8f\u5217\u8f68\u8ff9":196,"\u4e8c\u8fdb\u5236\u5e93\u6587\u4ef6\u7b49":168,"\u4e92\u76f8\u72ec\u7acb":148,"\u4e94\u90e8\u5206":148,"\u4ea4\u7531learner":156,"\u4ea4\u7ed9\u7528\u6237\u5728":164,"\u4ea4\u901a":196,"\u4ec0\u4e48\u662fexplor":196,"\u4ec0\u4e48\u662fmodel":196,"\u4ec0\u4e48\u662fon":196,"\u4ec0\u4e48\u662fonlin":196,"\u4ec0\u4e48\u662fvalu":196,"\u4ec5\u4ec5\u9700\u8981\u7ecf\u9a8c\u5c31\u53ef\u4ee5\u6c42\u89e3\u6700\u4f18\u7b56\u7565":196,"\u4ec5\u4fdd\u7559expire\u65f6\u95f4\u5185\u7684\u6570\u636e":142,"\u4ec5\u5305\u542b\u4e3a\u7406\u89e3\u540e\u8ff0\u5de5\u4f5c\u6d41\u7a0b\u6240\u5fc5\u987b\u7684\u90e8\u5206":156,"\u4ec5\u5b9a\u4e49\u540d\u5b57name\u548c\u4f18\u5148\u5ea6prior":156,"\u4ec5\u652f\u6301mse":150,"\u4ece":[145,156],"\u4ece\u4ee3\u7801\u53ef\u4ee5\u770b\u51fa":164,"\u4ece\u65b0\u5f00\u59cb\u521b\u5efa\u4e00\u4e2a\u4ed3\u5e93":168,"\u4ece\u667a\u80fd\u4f53\u63a5\u6536\u5230\u6570\u636e\u7684\u5904\u7406\u51fd\u6570":148,"\u4ece\u786c\u76d8\u8bfb\u53d6\u8bad\u7ec3\u6570\u636e\u81f3\u5185\u5b58":145,"\u4ece\u800c\u53ef\u4ee5\u5bf9\u65b0\u7684\u6837\u672c\u8fdb\u884c\u9884\u6d4b":196,"\u4ece\u800c\u5b9e\u73b0\u5feb\u901f\u4fee\u6539\u4ee3\u7801\u7684\u529f\u80fd":164,"\u4ece\u800c\u5f97\u5230\u76f8\u5e94\u7684":148,"\u4ece\u800c\u63d0\u9ad8\u4e86data":196,"\u4ece\u800c\u9020\u6210\u4e0d\u53ef\u9884\u671f\u7684\u7ed3\u679c":153,"\u4ece\u800c\u964d\u4f4e\u52a0\u901f\u6bd4":150,"\u4ed3\u5e93\u5185\u4ee5\u9632\u6b62\u5de5\u4f5c\u4e22\u5931":168,"\u4ee3\u7801\u4f5c\u8005\u53ef\u4ee5\u5728\u4e00\u6bb5\u4ee3\u7801\u4e2d\u7684\u4efb\u610f\u4f4d\u7f6e\u66b4\u9732\u51fa\u94a9\u5b50":164,"\u4ee3\u7801\u5408\u5e76\u6210\u529f\u540e":168,"\u4ee3\u7801\u7ed3\u6784":156,"\u4ee5\u4e0a\u4e09\u4e2a\u65f6\u95f4\u5747\u4f1a\u5728\u539f\u503c\u7684":143,"\u4ee5\u4e0b\u4e3a\u4e00\u4e2a":146,"\u4ee5\u4e0b\u53ea\u5217\u51fa\u4e0e":146,"\u4ee5\u4e0b\u662f\u4e00\u4e9b\u5177\u4f53\u7684\u7b80\u5355\u4f8b\u5b50":158,"\u4ee5\u4e0b\u662f\u4e0a\u8ff0\u65e5\u5fd7\u6a21\u578b\u7684\u8c03\u7528\u4f8b\u5b50":142,"\u4ee5\u4e0b\u6d41\u7a0b\u53ef\u4ee5\u7406\u89e3\u4e3a\u4e00\u6761\u6570\u636e\u4ece\u78c1\u76d8\u6587\u4ef6\u5230":145,"\u4ee5\u4e0b\u7b80\u79f0":145,"\u4ee5\u4f5c\u4e3abaselin":145,"\u4ee5\u4f9b\u53c2\u8003":196,"\u4ee5\u4fbf\u63d0\u524d\u7ec8\u6b62\u8fd0\u884c":146,"\u4ee5\u4fdd\u8bc1\u76f8\u5173\u529f\u80fd\u80fd\u591f\u6b63\u5e38\u8fdb\u884c":164,"\u4ee5\u53ca":[150,164],"\u4ee5\u53ca\u5404\u79cd\u6570\u636e\u6d41\u538b\u529b\u4e0b":145,"\u4ee5\u53ca\u5982\u4f55\u5229\u7528\u8f68\u8ff9\u6570\u636e\u6765\u66f4\u65b0\u5b66\u4e60\u76ee\u6807\u4e24\u4e2a\u90e8\u5206":196,"\u4ee5\u53ca\u5f53\u524d\u7684\u5956\u52b1\u6709\u5173":196,"\u4ee5\u53ca\u667a\u80fd\u4f53\u91c7\u53d6\u7684\u7b56\u7565":196,"\u4ee5\u53ca\u76f8\u5173\u6570\u636e\u5b57\u6bb5":142,"\u4ee5\u5b9e\u73b0\u5bf9":164,"\u4ee5\u5b9e\u73b0\u7cbe\u786e\u6355\u6349\u548c\u5904\u7406\u95ee\u9898":153,"\u4ee5\u786e\u4fdd\u5f53\u53d1\u751f\u8bef\u8fde\u7684\u65f6\u5019\u53ef\u4ee5\u7acb\u523b\u5f97\u5230\u53cd\u9988":153,"\u4ee5\u7ee7\u7eed\u8fd0\u884c":146,"\u4ee5\u8fbe\u5230\u5728\u4e00\u4e2a\u6bd4\u8f83\u957f\u671f\u7684\u65f6\u95f4\u6bb5\u5185\u5e73\u5747\u83b7\u5f97\u7684\u53cd\u9988\u6700\u597d":196,"\u4ee5\u8fdb\u7a0b\u95f4\u901a\u4fe1\u7684\u65b9\u5f0f\u5bf9\u73af\u5883\u8fdb\u884c\u7ba1\u7406\u548c\u8fd0\u884c":146,"\u4ee5\u907f\u514d\u6f5c\u5728\u7684\u7cfb\u7edf\u7ea7":168,"\u4ee5\u907f\u514d\u7cfb\u7edf\u4f7f\u7528\u9884\u671f\u5916\u7684\u8fd0\u7b97\u91cd\u8f7d":158,"\u4ee5\u9632\u5176\u4ed6\u540c\u4e8b\u8e29\u96f7":168,"\u4efb\u4f55\u4e00\u4e2a\u8f83\u5927\u7684\u4ee3\u7801\u6539\u52a8\u6216\u529f\u80fd\u66f4\u65b0":168,"\u4efb\u52a1":143,"\u4f18\u52bf\u66f4\u52a0\u660e\u663e":145,"\u4f18\u70b9":196,"\u4f1a":146,"\u4f1a\u4f18\u5148\u8c03\u7528":164,"\u4f1a\u5230\u4e0b\u4e00\u5c42\u7684":164,"\u4f1a\u53d1\u9001":156,"\u4f1a\u5728\u66f4\u4e0a\u4e00\u5c42\u53bb\u5bfb\u627e":164,"\u4f1a\u5728\u73af\u5883\u7ba1\u7406\u5668\u4e2d\u5f00\u542f":143,"\u4f1a\u5b58\u5728\u4e00\u5b9a\u7684\u6570\u503c\u7cbe\u5ea6\u6ce2\u52a8":150,"\u4f1a\u5bf9\u73b0\u6709\u5927\u91cf\u8282\u70b9\u8fdb\u884c\u8fde\u63a5":153,"\u4f1a\u88ab\u6807\u8bb0\u4e3a":146,"\u4f20\u5165":146,"\u4f20\u5165\u8bad\u7ec3\u6570\u636e":156,"\u4f20\u7edfdp\u7684\u4f5c\u7528\u6709\u9650":196,"\u4f20\u9012":158,"\u4f2a\u5e76\u884c":146,"\u4f46\u4f5c\u4e3a\u53c2\u6570\u4f20\u9012\u7ed9learner":156,"\u4f46\u5728\u5e76\u884cpipeline\u4e2d\u5e94\u5f53\u5b9e\u4f8b\u5316comm":156,"\u4f46\u57fa\u672c\u4e0d\u5f71\u54cd\u5e38\u89c4\u8bad\u7ec3":150,"\u4f46\u5982\u679c\u4f7f\u7528\u590d\u6570\u53ef\u4ee5\u4f7f\u67d0\u5c40\u90e8\u4ee3\u7801\u5757\u903b\u8f91\u66f4\u6e05\u6670":148,"\u4f46\u5bf9\u4e8e\u5e76\u884cpipeline\u6765\u8bf4":156,"\u4f46\u662f":168,"\u4f46\u662f\u5bf9\u4e8e\u5f3a\u5316\u5b66\u4e60\u95ee\u9898":196,"\u4f46\u662f\u6536\u655b\u901f\u5ea6\u4e0e\u7a33\u5b9a\u6027\u4e0d\u5982on":196,"\u4f46\u662fexploration\u592a\u591a":196,"\u4f46\u6ce8\u610f\u5fc5\u987b\u5305\u542b\u4e0a\u8ff0\u4e94\u4e2a\u5b57\u6bb5":148,"\u4f46\u8981\u6ce8\u610f":150,"\u4f46\u8fd8\u6709\u4e00\u4e9b\u95ee\u9898\u5c1a\u672a\u89e3\u51b3":156,"\u4f46learner\u7684\u521b\u5efa\u662f\u5728comm":156,"\u4f4d\u7f6e\u6dfb\u52a0\u4e86\u540d\u79f0\u4e3a":164,"\u4f4e\u81f31":145,"\u4f5c\u4e3a\u52a8\u4f5c":164,"\u4f7f\u5956\u52b1\u6700\u5927\u5316":196,"\u4f7f\u5f97\u4ee3\u7801\u66f4\u52a0\u4f18\u7f8e":158,"\u4f7f\u5f97\u5728\u957f":143,"\u4f7f\u5f97\u6536\u76ca\u6700\u5927":196,"\u4f7f\u5f97\u73af\u5883\u7684\u8c03\u7528\u66f4\u4e3a\u7b80\u5355\u6613\u61c2":148,"\u4f7f\u5f97\u7c7b\u53ef\u4ee5\u901a\u8fc7":153,"\u4f7f\u5f97\u8bad\u7ec3\u66f4\u52a0\u7a33\u5b9a":196,"\u4f7f\u73af\u5883\u53ef\u4ee5\u4fdd\u5b58\u8fd0\u884c\u8fc7\u7a0b\u4e3a\u89c6\u9891\u6587\u4ef6":148,"\u4f7f\u7528":[150,164,168],"\u4f7f\u7528\u53c2\u8003\u4e0b\u4e00\u8282":164,"\u4f7f\u7528\u5e76\u884c\u7684\u65b9\u5f0f\u8fd0\u884c\u591a\u4e2a\u73af\u5883\u7684\u7ba1\u7406\u5668":146,"\u4f7f\u7528\u5faa\u73af\u4e32\u884c\u7684\u65b9\u5f0f\u8fd0\u884c\u591a\u4e2a\u73af\u5883\u7684\u7ba1\u7406\u5668":146,"\u4f7f\u7528\u65b0\u7248\u672c\u65f6":150,"\u4f7f\u7528\u76f8\u540c\u7684\u8fdb\u7a0b\u6570":145,"\u4f7f\u7528\u8005\u53ef\u4ee5\u901a\u8fc7di":150,"\u4f7f\u7528\u88c5\u9970\u6a21\u5f0f\u5b9e\u73b0":148,"\u4f7f\u7528gpu\u8fdb\u884c\u6570\u636e\u63a8\u65ad":145,"\u4f7f\u7528shared_memory\u65f6":146,"\u4f8b\u5982":[148,150,158,164,168,196],"\u4f8b\u5982\u5728\u5904\u4e8e\u5171\u540c\u5185\u7f51\u7684100\u53f0gpu\u670d\u52a1\u5668\u4e0a\u8fd0\u884c\u4e00\u4e2a\u5177\u5907\u89c4\u6a21\u7684\u8bad\u7ec3\u4efb\u52a1":153,"\u4f8b\u5982\u5728\u81ea\u5df1\u7684\u5de5\u4f5c\u673a":153,"\u4f8b\u5982\u5728\u914d\u5907gpu\u7684\u9ad8\u914d\u5de5\u4f5c\u7ad9":153,"\u4f8b\u5982\u5f53\u6620\u5c04\u5173\u7cfb\u6709\u91cd\u53e0\u65f6":150,"\u4f8b\u5982\u6253\u5f00\u5176\u4ed6\u6a21\u62df\u5668\u5ba2\u6237\u7aef":148,"\u4f8b\u5982\u73af\u5883\u4e2d\u667a\u80fd\u4f53\u7684\u6570\u91cf":148,"\u4f8b\u5982\u8bad\u7ec3\u7684\u6a21\u578b\u6587\u4ef6":168,"\u4f8b\u5982\u8bbe\u7acbstart":153,"\u4f8b\u5982\u8fd0\u884c\u8be5\u76ee\u5f55\u4e0b\u7684test_ga":150,"\u4f8b\u5982dns\u6545\u969c":153,"\u4f9bloggedmodel\u4f7f\u7528":142,"\u4f9d\u636e\u4e0d\u540c\u7684":146,"\u4f9d\u636e\u9700\u6c42\u5b9e\u73b0\u5176\u4e2d\u7684":164,"\u4f9d\u636e\u9700\u6c42\u5b9e\u73b0\u6240\u9700\u8981\u7684":164,"\u4f9d\u6b21":168,"\u4f9d\u6b21\u6253\u5370\u51faforward\u65b9\u6cd5\u8c03\u7528\u60c5\u51b5":[164,165],"\u4f9d\u7136\u7531base":156,"\u4fbf\u4e8e\u4f7f\u7528\u8005\u5bf9\u6570\u636e\u6536\u96c6\u548c\u6027\u80fd\u8bc4\u6d4b\u8bbe\u7f6e\u4e0d\u540c\u7684\u73af\u5883\u53c2\u6570":148,"\u4fbf\u4e8e\u8c03\u8bd5\u548c\u53ef\u89c6\u5316":148,"\u4fbf\u53ef\u4ee5\u901a\u8fc7":164,"\u4fbf\u56de\u5230\u4e86\u6d41\u7a0b2":156,"\u4fbf\u56de\u5230\u4e86\u6d41\u7a0b3":156,"\u4fdd\u5b58\u6a21\u578b":156,"\u4fdd\u5b58\u6a21\u578b\u5230\u68c0\u67e5\u70b9":164,"\u4fdd\u62a4\u548c":146,"\u4fdd\u6301\u8ffd\u8e2a\u539f\u59cb\u4ee3\u7801\u5e93\u7684":168,"\u4fdd\u6301\u957f\u671f\u5f85\u673a\u72b6\u6001":153,"\u4fe1\u606f\u7684\u8bbf\u95ee\u96c6\u4e2d\u5728":148,"\u4fee\u6539\u4e4b\u540e\u7684\u5404\u4e2a":148,"\u4fee\u6539\u73b0\u6709\u4ee3\u7801":168,"\u500d\u5de6\u53f3":143,"\u503c\u4e3a":148,"\u503c\u51fd\u6570\u53ef\u4ee5\u5229\u7528\u52a8\u6001\u89c4\u5212\u7684\u65b9\u6cd5\u5f97\u5230":196,"\u503c\u51fd\u6570\u65e0\u6cd5\u7528\u4e00\u5f20\u8868\u683c\u6765\u8868\u793a":196,"\u503c\u5f97\u6ce8\u610f\u7684\u662f":153,"\u503c\u5f97\u6ce8\u610f\u7684\u6709\u4ee5\u4e0b\u51e0\u70b9":153,"\u505a\u4e86\u5c01\u88c5":164,"\u5143\u7d20\u7c7b\u8be6\u7ec6\u4fe1\u606f":148,"\u5148\u5b66\u4e60\u4e00\u4e2a\u73af\u5883\u6a21\u578b":196,"\u5148\u901a\u8fc7\u67d0\u79cd\u7b56\u7565\u91c7\u6837\u5927\u91cf\u7684\u6570\u636e":196,"\u5168\u79f0\u662f":150,"\u5173\u4e8e":148,"\u5173\u4e8echannel":153,"\u5173\u95ed\u73af\u5883":146,"\u5173\u95ed\u76f8\u5e94\u7684":168,"\u5173\u95edcomm":156,"\u5176\u4e2d":[143,145,148,158,196],"\u5176\u4e2d\u524d\u8005\u4ee3\u8868\u9759\u6001\u4e0d\u53d8\u7684\u4fe1\u606f":148,"\u5176\u4e2d\u5c31\u5305\u542b\u4e86learner\u8bf7\u6c42\u7684":156,"\u5176\u4e2d\u67d0\u4e9b\u952e\u503c\u5bf9\u4f1a\u6709\u76f8\u5173\u4f9d\u8d56\u8981\u6c42":148,"\u5176\u4e2d\u6bcf\u4e00\u4e2a\u8fed\u4ee3\u5728\u83b7\u53d6\u6570\u636e\u540e":156,"\u5176\u4ed6\u540c\u4e8b\u4e5f\u53ef\u4ee5\u5728\u8be5mr\u4e0bcomment":168,"\u5176\u4ee3\u7801\u5fc5\u987b\u662f\u786e\u4fdd\u80fd\u591f":168,"\u5176\u4f20\u8f93\u6027\u80fd\u548c\u7a33\u5b9a\u6027\u5fc5\u7136\u8d85\u8fc7\u57fa\u4e8ehttp\u670d\u52a1\u7684interact":153,"\u5176\u4f59\u4e94\u7ec4":143,"\u5176\u5177\u4f53\u542b\u4e49\u5982\u4e0b":146,"\u5176\u5185\u7f6e\u8fc7\u671f\u673a\u5236":142,"\u5176\u521d\u59cb\u5316\u65f6\u9700\u63d0\u4f9b\u6bcf\u4e2a":146,"\u5176\u57fa\u672c\u7528\u6cd5\u4e3a\u7ee7\u627floggedmodel\u7c7b":142,"\u5176\u6301\u6709\u4e00\u4e2abase":156,"\u5176\u672c\u8d28\u662f\u5229\u7528master":156,"\u5176\u6982\u5ff5\u7c7b\u4f3c\u4e8e\u65e0\u7ebf\u7535\u9891\u9053":153,"\u5176\u7528\u6765\u652f\u6491\u4e00\u4e2a\u65e5\u5fd7\u6a21\u578b\u7684\u8bb0\u5f55\u65b9\u5f0f":142,"\u5176\u952e\u6307\u5b9a\u4e86\u9700\u8981\u8fd0\u884c":146,"\u5176master\u4e3acoordinator\u4e2d\u7684\u53d8\u91cfmast":156,"\u5177\u4f53\u5173\u7cfb\u7528\u4e0b\u56fe\u5c31\u80fd\u5f88\u597d\u89e3\u91ca":196,"\u5177\u4f53\u539f\u56e0\u53ca\u89e3\u51b3\u65b9\u6cd5\u5982\u4e0b":139,"\u5177\u4f53\u539f\u56e0\u53ef\u53c2\u89c1":139,"\u5177\u4f53\u5982\u4e0b":[150,164],"\u5177\u4f53\u5b9e\u73b0":148,"\u5177\u4f53\u6765\u8bf4":[142,153],"\u5177\u4f53\u7684\u5f00\u53d1\u8005\u9700\u8981\u505a\u597d\u672c\u5730\u7684\u4ee3\u7801\u98ce\u683c\u68c0\u67e5\u548c\u5355\u5143\u6d4b\u8bd5":168,"\u5177\u4f53\u7ec6\u8282\u53ef\u4ee5\u53c2\u8003":168,"\u5185\u5bb9\u4e3a\u73af\u5883\u7684":146,"\u5185\u90e8":143,"\u518d\u5230\u6700\u540e\u65ad\u5f00\u8fde\u63a5\u7684\u8fc7\u7a0b":156,"\u518d\u5230coordinator\u542f\u52a8comm":156,"\u518d\u5b66\u4e60\u4e00\u4e2a\u6a21\u578b\u6765\u6700\u5c0f\u5316\u8bef\u5dee":196,"\u518d\u5c06\u5176\u79fb\u52a8\u56de\u6765":139,"\u518d\u66f4\u65b0\u7b56\u7565":196,"\u518d\u6839\u636e\u503c\u51fd\u6570\u6539\u8fdb\u7b56\u7565":196,"\u518d\u6839\u636e\u5b66\u4e60\u5230\u7684\u73af\u5883\u6a21\u578b\u505a\u503c\u51fd\u6570":196,"\u518d\u7531comm":156,"\u51b2\u7a81\u89e3\u51b3\u540e":168,"\u51b3\u5b9a\u4e86\u667a\u80fd\u4f53\u9762\u5bf9\u4e0d\u540c\u7684\u73af\u5883\u72b6\u6001\u65f6\u91c7\u53d6\u7684\u52a8\u4f5c":196,"\u51cf\u4e8c":158,"\u51fd\u6570":164,"\u51fd\u6570\u4e2d":142,"\u51fd\u6570\u4ee5\u660e\u786e\u8eab\u4efd":158,"\u51fd\u6570\u53ef\u4ee5\u5c06\u4efb\u610f\u7c7b\u578b":158,"\u51fd\u6570\u53ef\u4ee5\u5c06loader\u7c7b\u578b\u8f6c\u4e3anorm":158,"\u51fd\u6570\u5c31\u662f\u7531\u6b64\u88ab\u521b\u9020\u51fa\u6765\u7684":164,"\u51fd\u6570\u6216\u8005\u504f\u51fd\u6570":146,"\u5206\u4e3a\u591a\u4e2a\u5b50\u4efb\u52a1":145,"\u5206\u522b\u4e3a":[145,164],"\u5206\u522b\u4e3a\u4efb\u52a1\u4e0b\u8fbe\u7aef\u548c\u4efb\u52a1\u6267\u884c\u7aef":153,"\u5206\u522b\u662f":[145,164],"\u5206\u522b\u7b80\u5199\u4e3a":143,"\u5206\u652f":168,"\u5206\u652f\u7684":168,"\u5206\u652f\u7684\u7a33\u5b9a\u6027":168,"\u5207\u5fcc\u6ee5\u7528\u7ee7\u627f":153,"\u5217\u8868":168,"\u5217\u8868\u5143\u7ec4":158,"\u5219":[145,148],"\u5219\u4ee5json\u683c\u5f0f\u8fd4\u56de\u4e24\u8005\u7684\u548c":153,"\u5219\u4f1a\u6839\u636e\u4f18\u5148\u7ea7\u5927\u5c0f\u6765\u987a\u5e8f\u6267\u884c":[164,165],"\u5219\u5728\u8be5\u7ebf\u7a0b\u4e2d\u5c06\u6570\u636e\u4ece":145,"\u5219\u5c06\u65b0\u4efb\u52a1\u52a0\u5165\u4efb\u52a1\u961f\u5217":153,"\u5219\u6267\u884c\u4efb\u52a1":153,"\u5219\u6267\u884c\u5982\u4e0b\u7684\u547d\u4ee4\u5373\u53ef\u5220\u9664":150,"\u5219\u628a\u4ee3\u7801\u4ed3\u5e93\u521b\u5efa\u5728\u81ea\u5df1\u7684\u7528\u6237\u540d\u4e0b":168,"\u5219\u62d2\u7edd\u65b0\u4efb\u52a1\u8bf7\u6c42":153,"\u5219\u62d2\u7edd\u8be5\u4efb\u52a1\u8bf7\u6c42":153,"\u5219\u76f4\u63a5\u653e\u7f6e\u5728":145,"\u5219\u8868\u660e\u8d8b\u5411\u4e8e":196,"\u5219\u8be5\u8fdb\u7a0b\u8d1f\u8d23\u6267\u884c\u6240\u6709\u7684\u6570\u636e\u8bfb\u53d6\u4efb\u52a1":145,"\u5219\u8bf4\u660e\u5b89\u88c5\u6210\u529f":150,"\u521b\u5efa\u65b0\u4ee3\u7801\u4ed3\u5e93":168,"\u521b\u5efabase":156,"\u521d\u59cb\u5316":[146,148,156],"\u521d\u59cb\u5316\u4e86":146,"\u521d\u59cb\u5316\u4f60\u7684\u4ee3\u7801\u4ed3\u5e93":168,"\u521d\u59cb\u5316\u540e\u5e76\u4e0d\u4f1a\u7acb\u5373\u5b9e\u4f8b\u5316\u6bcf\u4e2a\u73af\u5883":146,"\u521d\u59cb\u5316\u5b50\u73af\u5883\u72b6\u6001\u7ba1\u7406\u6240\u9700\u7684\u8d44\u6e90":146,"\u521d\u59cb\u5316\u6240\u6709\u5b50\u73af\u5883":146,"\u521d\u59cb\u5316\u8fd0\u884c\u6bcf\u4e2a\u5b50\u73af\u5883\u7684\u8fdb\u7a0b":146,"\u5224\u65ad":145,"\u5224\u65ad\u662f\u5426\u4e3aint\u6784\u6210\u7684list":158,"\u5224\u65ad\u662f\u5426\u5305\u542b2":158,"\u5224\u65ad\u662f\u5426\u5927\u4e8e1\u4e14\u4e0d\u5927\u4e8e10":158,"\u5224\u65adx":158,"\u5229\u7528\u6570\u636e\u8bad\u7ec3\u8fd9\u4e00\u8fc7\u7a0b":156,"\u5229\u7528\u7b56\u7565\u68af\u5ea6\u8fdb\u884c\u7b56\u7565\u51fd\u6570\u53c2\u6570\u7684\u66f4\u65b0":196,"\u5229\u7528\u7ebf\u6027\u6216\u975e\u7ebf\u6027\u51fd\u6570\u5bf9\u7b56\u7565\u8fdb\u884c\u8868\u793a":196,"\u5229\u7528epsilon\u8d2a\u5a6a\u7b56\u7565\u91c7\u6837\u52a8\u4f5c":164,"\u5230\u4e8c\u8005\u5efa\u7acb\u901a\u4fe1\u8fde\u63a5":156,"\u5230\u5b9e\u9645\u4efb\u52a1\u5206\u914d\u4e0e\u6267\u884c":156,"\u5230\u5efa\u7acb\u8fde\u63a5":156,"\u5230\u6700\u7ec8\u4e8c\u8005\u5173\u95ed\u901a\u4fe1\u8fde\u63a5\u7684\u6d41\u7a0b":156,"\u524d":168,"\u524d\u8f93\u5165\u4e0a\u4e00\u6b21\u8fed\u4ee3\u7684\u8f93\u51fa\u9690\u72b6\u6001":164,"\u529f\u80fd\u4e0a\u4ee3\u66ff\u5e38\u89c1\u73af\u5883\u4e2d\u7684":148,"\u529f\u80fd\u540c\u4e0a\u8bf4\u660e":148,"\u52a0\u4e00":158,"\u52a0\u901f\u8fd0\u884c":146,"\u52a1\u5fc5":168,"\u52a8\u4f5c\u7a7a\u95f4\u4e00\u822c\u4e3a\u5b9e\u503c\u5411\u91cf\u533a\u95f4":196,"\u52a8\u4f5c\u7a7a\u95f4\u4e0e\u8fde\u7eed":196,"\u52a8\u4f5c\u7a7a\u95f4\u53c8\u5206\u4e3a\u79bb\u6563":196,"\u52a8\u6001\u89c4\u5212":196,"\u52a8\u6001\u8c03\u6574\u81ea\u5df1\u63a5\u4e0b\u6765\u7684\u52a8\u4f5c":196,"\u5305\u542b\u4ee5\u4e0b\u8fdb\u7a0b\u6216\u7ebf\u7a0b":145,"\u5305\u542b\u591a\u4e2a":145,"\u5305\u542b\u6b63\u5728\u8fd0\u884c\u5176\u4ed6\u547d\u4ee4\u6216\u5df2\u7ecf\u5b8c\u6210":146,"\u5305\u62ec\u6a21\u578b\u66f4\u65b0":156,"\u5305\u62ecnorm":158,"\u533a\u95f4\u9a8c\u8bc1":158,"\u534f\u4f5c\u5f00\u53d1\u6d41\u7a0b\u7684\u5efa\u8bae":168,"\u5355\u4f4d":[143,145],"\u5355\u4f4d\u4e3a\u6b21":142,"\u5355\u4f4d\u4e3a\u79d2":142,"\u5355\u673a\u5206\u5e03\u5f0f":153,"\u5355\u673a\u8f7b\u578b":153,"\u5373":[148,196],"\u537350\u6b21\u8fed\u4ee3":145,"\u5373\u4e0d\u4f7f\u7528\u591a\u8fdb\u7a0b":145,"\u5373\u4e3a":153,"\u5373\u4ee5\u6b21\u6570\u4e3a\u5355\u4f4d\u7684\u65f6\u95f4":142,"\u5373\u4f1a\u81ea\u52a8\u542f\u7528hpc_rl\u76f8\u5173\u7b97\u5b50":150,"\u5373\u5224\u65ad\u8fd0\u884c\u73af\u5883\u662f\u5426\u5df2\u521b\u5efa":148,"\u5373\u53ef\u4ece\u4e2d\u91c7\u6837\u51fa\u6837\u672c\u4ee5\u66f4\u65b0\u6a21\u578b\u53c2\u6570":196,"\u5373\u53ef\u5b8c\u6210\u8fde\u63a5":153,"\u5373\u53ef\u5f00\u59cb\u4ee3\u7801\u5f00\u53d1":168,"\u5373\u540c\u4e00\u65f6\u523b\u5404\u8fdb\u7a0b":145,"\u5373\u548c":145,"\u5373\u5728":156,"\u5373\u5728\u5355\u4e2a\u5177\u5907\u6216\u4e0d\u5177\u5907gpu\u7684\u666e\u901a\u8ba1\u7b97\u673a\u4e0a\u8fdb\u884c\u8bad\u7ec3\u4efb\u52a1":153,"\u5373\u5728\u5355\u4e2a\u7b97\u529b\u8f83\u9ad8\u7684\u8ba1\u7b97\u673a\u6216\u96c6\u7fa4\u4e0a\u8fdb\u884c\u8bad\u7ec3\u4efb\u52a1":153,"\u5373\u5728\u591a\u4e2a\u8ba1\u7b97\u8282\u70b9\u4e0a\u8fdb\u884c\u534f\u540c\u8bad\u7ec3\u4efb\u52a1":153,"\u5373\u5b9e\u9645\u4efb\u52a1\u7684\u5206\u914d\u4e0e\u6267\u884c\u8fc7\u7a0b":156,"\u5373\u5f53\u67d0\u4e2a\u73af\u5883\u8fd0\u884c\u81f3":146,"\u5373\u65f6\u523bt\u7684\u771f\u5b9e\u56de\u62a5":196,"\u5373\u751f\u6210\u7684\u6570\u636e":196,"\u5373\u7cfb\u7edf\u65f6\u95f4":142,"\u5373\u88c5\u9970\u5668":164,"\u5373\u8c03\u7528":146,"\u5373\u91cd\u5199\u8be5\u65b9\u6cd5":148,"\u5373\u91cd\u5199\u8be5\u65b9\u6cd5\u7b49\u4ef7\u4e8e\u8c03\u7528\u7236\u7c7b\u7684\u8be5\u65b9\u6cd5\u4ee5\u53ca\u5b9e\u73b0\u81ea\u8eab\u9700\u8981\u68c0\u67e5\u7684\u90e8\u5206":148,"\u5373float":158,"\u5373slave\u8282\u70b9":153,"\u539f\u8ba1\u5212\u7528\u4e8e\u914d\u7f6e\u6570\u636e\u7684\u8f6c\u5316\u4e0e\u9a8c\u8bc1":158,"\u53bb\u6389\u8be5\u9009\u9879\u91cd\u65b0\u5b89\u88c5\u5373\u53ef":139,"\u53bb\u8c03\u7528":164,"\u53c2\u6570\u5168\u90e8\u5b58\u5728":153,"\u53c2\u6570\u5316\u7684\u7b56\u7565\u51fd\u6570":196,"\u53c2\u6570\u5316\u884c\u4e3a\u4ef7\u503c\u51fd\u6570":196,"\u53c2\u6570\u5982\u4e0b\u8868":143,"\u53c2\u6570\u65f6":146,"\u53c2\u7167":145,"\u53ca\u6bcf\u4e00\u4e2a\u8fed\u4ee3\u524d\u540e\u6267\u884c\u4e00\u4e9b\u51fd\u6570":156,"\u53cd\u5411\u4f20\u64ad":150,"\u53cd\u590d\u91cd\u65b0\u5206\u914d\u5185\u5b58\u4f1a\u9020\u6210\u4e00\u5b9a\u7684\u65f6\u95f4\u635f\u8017":150,"\u53d1\u751f\u5f02\u5e38\u7684\u5b50\u73af\u5883":146,"\u53d1\u9001":[145,146],"\u53d1\u9001\u4efb\u52a1":156,"\u53d1\u9001\u7ed9\u667a\u80fd\u4f53\u6570\u636e\u7684\u5904\u7406\u51fd\u6570":148,"\u53d6\u503c\u60c5\u51b5":148,"\u53d6\u51fa\u8bad\u7ec3\u4fe1\u606f":156,"\u53d6\u540e45\u6b21\u7684\u5e73\u5747\u503c\u4f5c\u4e3a\u5355\u6b21\u5b9e\u9a8c\u7ed3\u679c":145,"\u53d6\u5f97\u4e86\u6bd4\u80a9\u4eba\u7c7b\u751a\u81f3\u8d85\u8d8a\u4eba\u7c7b\u7684\u6210\u5c31":196,"\u53d8\u57fa":168,"\u53e6\u4e00\u79cd\u57fa\u4e8e\u4ef7\u503c\u51fd\u6570\u7684\u65b9\u6cd5\u5219\u4e0d\u4e00\u5b9a\u9700\u8981\u7b56\u7565\u51fd\u6570":196,"\u53e6\u4e00\u79cd\u65b9\u6cd5\u5219\u662f\u76f4\u63a5\u8fdb\u884c\u7b56\u7565\u7a7a\u95f4\u4e0a\u7684\u641c\u7d22":196,"\u53e6\u4e00\u79cd\u662f\u901a\u8fc7\u5b66\u5230\u7684model\u76f4\u63a5\u4f18\u5316\u7b56\u7565":196,"\u53ea\u53ef\u4ee5\u4ece\u6709\u9650\u6570\u91cf\u7684\u52a8\u4f5c\u4e2d\u8fdb\u884c\u9009\u62e9":196,"\u53ea\u662f\u4e00\u5c42":148,"\u53ea\u6709\u5728\u4e00\u6bb5\u8f68\u8ff9\u8fc7\u540e\u624d\u4f1a\u83b7\u53d6\u5956\u52b1":196,"\u53ea\u8981\u7ed9":146,"\u53ea\u8bbe\u7f6e\u53c2\u6570":148,"\u53ea\u9700\u8981\u7ee7\u627fbasetime\u5e76\u5b9e\u73b0tim":142,"\u53ef\u4ee5":168,"\u53ef\u4ee5\u4ece":156,"\u53ef\u4ee5\u4f20\u5165":146,"\u53ef\u4ee5\u4f7f\u7528\u6570\u636e\u4eff\u771f\u548c\u91c7\u6837\u6a21\u578b":196,"\u53ef\u4ee5\u50cf\u539f\u672c\u7684":164,"\u53ef\u4ee5\u5229\u7528\u8499\u7279\u5361\u6d1b\u7684\u65b9\u6cd5\u6216\u8005\u65f6\u95f4\u5dee\u5206\u7684\u65b9\u6cd5\u5f97\u5230":196,"\u53ef\u4ee5\u52a0\u901f\u4f20\u9012\u73af\u5883\u8fd4\u56de\u7684\u5927\u5411\u91cf\u6570\u636e":146,"\u53ef\u4ee5\u53c2\u8003\u4ee5\u4e0b\u987a\u5e8f\u56fe\u5e2e\u52a9\u7406\u89e3":156,"\u53ef\u4ee5\u53d1\u73b0":143,"\u53ef\u4ee5\u5728\u672c\u5730\u5c06\u539f\u4ee3\u7801\u5e93\u6dfb\u52a0\u81f3":168,"\u53ef\u4ee5\u5728\u672c\u5730\u6309\u7167\u81ea\u5df1\u7684\u5de5\u4f5c\u8282\u594f":168,"\u53ef\u4ee5\u5927\u5927\u7b80\u5316":146,"\u53ef\u4ee5\u5b9e\u73b0\u591a\u4e2a":146,"\u53ef\u4ee5\u5bf9":164,"\u53ef\u4ee5\u5e2e\u52a9\u6211\u4eec\u89e3\u51b3\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u4e2d\u6837\u672c\u6548\u7387\u7684\u95ee\u9898":196,"\u53ef\u4ee5\u5f97\u5230\u6700\u4f18\u72b6\u6001\u503c\u51fd\u6570\u4e0e\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u7684\u8d1d\u5c14\u66fc\u65b9\u7a0b":196,"\u53ef\u4ee5\u6307\u5b9a\u662f\u5426\u4f7f\u7528shared_memori":139,"\u53ef\u4ee5\u6309\u7167\u5982\u4e0b\u89c4\u5219\u5f97\u5230\u65b0\u7684model":164,"\u53ef\u4ee5\u63a5\u6536\u8bad\u7ec3\u6570\u636e":156,"\u53ef\u4ee5\u65b9\u4fbf\u5730\u5bf9\u51fd\u6570\u7684\u8f93\u5165\u8f93\u51fa\u8fdb\u884c\u64cd\u4f5c":164,"\u53ef\u4ee5\u662f\u6240\u9700\u8981\u4f7f\u7528\u7684\u4efb\u4f55":164,"\u53ef\u4ee5\u770b\u5230\u8bad\u7ec3\u65f6\u95f4\u4ece9":150,"\u53ef\u4ee5\u7b80\u5316\u4e3a":158,"\u53ef\u4ee5\u7b80\u5355\u5730\u7406\u89e3\u4e3a":164,"\u53ef\u4ee5\u7ba1\u7406\u591a\u4e2a\u76f8\u540c\u7c7b\u578b\u4e0d\u540c\u914d\u7f6e\u7684\u73af\u5883":146,"\u53ef\u4ee5\u8003\u8651\u91cd\u7528":158,"\u53ef\u4ee5\u81ea\u5df1\u5b9a\u4e49time\u7c7b":142,"\u53ef\u4ee5\u89c6\u4e3a\u5bf9\u4e0d\u540c\u5177\u4f53\u4e1a\u52a1\u7684\u4e00\u79cd\u6807\u8bc6":153,"\u53ef\u4ee5\u8ba1\u7b97\u6700\u4f18\u7684\u7b56\u7565":196,"\u53ef\u4ee5\u901a\u8fc7":164,"\u53ef\u4ee5\u901a\u8fc7\u5728\u94a9\u5b50\u5185\u4f7f\u5f97\u5916\u90e8\u51fd\u6570\u5728\u88ab\u8c03\u7528\u7684\u65f6\u5019":164,"\u53ef\u4ee5\u901a\u8fc7\u5982\u4e0b\u65b9\u5f0f\u6765\u6784\u5efa\u5c5e\u4e8e\u81ea\u5df1\u7684":153,"\u53ef\u4ee5\u901a\u8fc7\u5982\u4e0b\u7684\u65b9\u5f0f\u6765\u6784\u5efa\u5c5e\u4e8e\u81ea\u5df1\u7684":153,"\u53ef\u4ee5\u901a\u8fc7\u8f93\u5165\u547d\u4ee4\u7684\u65b9\u5f0f\u624b\u52a8\u5173\u95edcomm":156,"\u53ef\u4ee5\u907f\u514d\u9677\u5165\u65e0\u9650\u5faa\u73af":196,"\u53ef\u4f7f\u7528":168,"\u53ef\u5728":146,"\u53ef\u5728\u5165\u53e3\u7a0b\u5e8f\u6700\u5f00\u59cb\u5904\u52a0\u4e0a\u4e00\u884c\u4ee3\u7801":150,"\u53ef\u80fd\u4f1a\u51fa\u73b0\u67d0\u4e9b\u4e0d\u5339\u914d\u95ee\u9898":150,"\u53ef\u80fd\u4f1a\u975e\u5e38\u5927":143,"\u53ef\u88ab\u4e32\u884cpipeline\u6216":156,"\u53ef\u88ab\u5e76\u884cpipeline\u8c03\u7528":156,"\u53ef\u9009\u7c7b\u578b":158,"\u53ef\u901a\u8fc7":[146,150],"\u5404\u72b6\u6001\u95f4\u7684\u8f6c\u6362\u5173\u7cfb\u5982\u56fe\u793a":146,"\u540c":146,"\u540c\u65f6\u6211\u4eec\u8fd8\u53d1\u73b0":145,"\u540c\u65f6\u65b0\u5f00\u4e00\u4e2a":168,"\u540c\u65f6\u6b22\u8fce\u9605\u8bfb\u6e90\u4ee3\u7801":153,"\u540c\u65f6\u83b7\u53d6\u73af\u5883\u4e2d\u7684\u4fe1\u606f":146,"\u540c\u65f6\u8c03\u7528\u5404\u5b50\u73af\u5883\u7684":146,"\u540c\u65f6\u8fd0\u884c":146,"\u540c\u6b65":156,"\u540c\u6b65\u4e0a\u6e38\u4ee3\u7801":168,"\u540c\u7ec4\u4ed3\u5e93\u63a8\u8350\u7528\u65b0\u5206\u652f":168,"\u540c\u7ec4\u6210\u5458\u4f1a\u76f4\u63a5\u6709\u8bbf\u95ee\u548c\u7f16\u8f91\u7684\u6743\u9650":168,"\u540d\u79f0":164,"\u540e":145,"\u540e\u4fdd\u5b58\u8be5\u6b21\u7684\u8f93\u51fa\u9690\u72b6\u6001\u4e3a\u4e0b\u4e00\u6b21\u505a\u51c6\u5907":164,"\u540e\u7eed\u4f1a\u8003\u8651\u8fdb\u4e00\u6b65\u4ecb\u7ecd":153,"\u540e\u8005\u8d1f\u8d23\u8fd0\u884c\u65f6\u53d8\u5316\u7684\u4fe1\u606f":148,"\u5426\u5219":145,"\u5426\u5219\u5373\u4f7f\u6570\u636e\u8bfb\u53d6\u8fde\u63a5\u5b8c\u6bd5":145,"\u5426\u5219\u5c06\u5176\u901a\u8fc7\u7ba1\u9053\u53d1\u56de\u7ed9":145,"\u5426\u5219\u5c06\u5bfc\u81f4\u65e0\u6cd5\u6b63\u5e38\u5efa\u7acb\u8fde\u63a5":153,"\u5426\u5219\u8fd4\u56de":146,"\u5426\u5219comm":156,"\u547d\u4ee4":146,"\u547d\u4ee4\u7684\u5b50\u73af\u5883":146,"\u548c":[143,146,147,148,153,164,168],"\u548c\u4e8b\u4ef6":153,"\u548c\u56de\u62a5\u8003\u8651\u5728\u5185\u7684\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u79f0\u4e3a\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"\u548c\u63d0\u4f9b\u53ef\u80fd\u7684\u591a\u6001\u673a\u5236":148,"\u548c\u6700\u65b0\u8fd4\u56de\u7684":146,"\u548c\u8fd4\u56de\u7684":146,"\u56db\u90e8\u5206":148,"\u56de\u8c03\u51fd\u6570":156,"\u56de\u8c03\u51fd\u6570\u7531comm":156,"\u56e0\u4e3a\u4f7f\u7528\u52a8\u6001\u89c4\u5212\u9700\u8981\u5b8c\u5907\u7684\u73af\u5883\u6a21\u578b":196,"\u56e0\u4e3a\u5355\u673a\u5206\u5e03\u5f0f\u73af\u5883\u4e0b\u5b8c\u5168\u53ef\u4ee5\u901a\u8fc7fork\u5f00\u542f\u5b50\u8fdb\u7a0b\u7684\u65b9\u5f0f\u542f\u52a8\u5404\u7aef":153,"\u56e0\u4e3a\u5728\u591a\u673a\u73af\u5883\u4e0b\u5f00\u542ffork\u6216\u8005\u57fa\u4e8e\u8fdc\u7a0b\u542f\u52a8\u6765\u542f\u52a8\u8bad\u7ec3\u4efb\u52a1\u662f\u4e0d\u73b0\u5b9e\u7684":153,"\u56e0\u4e3a\u5b58\u5728\u521b\u5efa\u6a21\u578b\u5b9e\u4f8b\u4f46\u4e0d\u8fd0\u884c\u7684\u4f7f\u7528\u573a\u666f":148,"\u56e0\u4e3a\u76ee\u524d\u4ec5\u652f\u6301\u90e8\u5206\u8fd0\u884c\u73af\u5883":150,"\u56e0\u4e3a\u8fd9\u4e24\u4e2a\u7b97\u6cd5\u4e0d\u9700\u8981\u7b97\u6cd5\u5efa\u6a21\u5177\u4f53\u73af\u5883":196,"\u56e0\u4e3a\u8fd9\u4f1a\u5bfc\u81f4master":153,"\u56e0\u6b64":[153,196],"\u56e0\u6b64\u5229\u7528\u7b56\u7565\u6570\u636e\u4e5f\u53ef\u4ee5\u5b66\u4e60\u5230\u73af\u5883\u7684\u4fe1\u606f":196,"\u56e0\u6b64\u53ef\u4ee5\u5b89\u5168\u5730\u7ee7\u7eed\u8c03\u7528\u8fd9\u4e9b\u5b50\u73af\u5883\u7684":146,"\u56e0\u6b64\u5f3a\u5316\u5b66\u4e60\u4e2d":196,"\u56e0\u6b64\u63d0\u51fa\u4e86\u57fa\u4e8e\u7b56\u7565\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5":196,"\u56e0\u6b64\u9700\u8981\u77e5\u9053\u6570\u636e\u7684\u5177\u4f53\u5c3a\u5bf8":150,"\u56e0\u6b64offlin":196,"\u56e0\u800c\u5fc5\u987b\u57fa\u4e8einteraction\u6784\u5efa\u670d\u52a1\u4f53\u7cfb":153,"\u56f4\u68cb":196,"\u5728":[148,150,153,156,164],"\u572860":145,"\u5728\u4e00\u4e9b\u5e38\u89c1\u7684\u5f3a\u5316\u5b66\u4e60\u4efb\u52a1\u4e2d":148,"\u5728\u4e00\u4e9b\u60c5\u51b5\u4e0b":196,"\u5728\u4e0a\u9762\u505a\u4fee\u6539":168,"\u5728\u4e0d\u540c\u8f93\u5165\u5c3a\u5bf8\u4e0b\u5747\u670910":150,"\u5728\u4e32\u884c\u4e0e\u5e76\u884c\u4e24\u4e2a\u7248\u672c\u4e2d":156,"\u5728\u4e86\u8fd9\u91cc":156,"\u5728\u4ecb\u7ecdflaskfilesystemlearner\u524d":156,"\u5728\u4ee5\u4e0a\u7684model":196,"\u5728\u4f7f\u7528":146,"\u5728\u4f7f\u7528fork\u65b9\u5f0f\u65f6":168,"\u5728\u503c\u51fd\u6570\u7684\u65b9\u6cd5\u4e2d":196,"\u5728\u5185\u90e8\u5b9a\u4e49loggedvalue\u7684descriptor":142,"\u5728\u521b\u5efa\u597d\u4ee3\u7801\u4ed3\u5e93\u5e76":168,"\u5728\u521d\u59cb\u5316":164,"\u5728\u533b\u7597":196,"\u5728\u5404\u79cd\u89c4\u6a21\u7684\u73af\u5883\u4e0b":145,"\u5728\u5b8c\u6210\u4e86\u5bf9\u73af\u5883\u7684\u5efa\u6a21\u540e":196,"\u5728\u5b8c\u6210\u53d1\u8d77\u7684":168,"\u5728\u5b9e\u4f8b\u5185\u90e8\u6839\u636e\u8bad\u7ec3batch\u6837\u672c\u6570\u7ef4\u62a4\u5bf9\u5e94\u7684\u9690\u72b6\u6001":164,"\u5728\u5b9e\u9645\u4f7f\u7528\u7684\u65f6\u5019\u8bf7":153,"\u5728\u5e76\u884c\u8bad\u7ec3\u6a21\u5f0f\u4e2d":156,"\u5728\u5f00\u59cb\u5199\u4ee3\u7801\u4e4b\u524d":168,"\u5728\u5f3a\u5316\u5b66\u4e60\u4e2d":196,"\u5728\u6211\u4eec\u7684autolog\u4e2d":142,"\u5728\u67d0\u4e2a\u4f4d\u7f6e\u63d2\u5165\u4e00\u4e2a\u65b0\u7684\u65b9\u6cd5":164,"\u5728\u6b64\u4f4d\u7f6e\u6ce8\u518c\u7684":164,"\u5728\u6b64\u60c5\u51b5\u4e0b":164,"\u5728\u72b6\u6001":196,"\u5728\u73b0\u5b9e\u5e94\u7528\u4e2d":196,"\u5728\u7a0b\u5e8f\u4e2d":164,"\u5728\u7ed9\u5b9a\u4e00\u4e2amdp\u5b8c\u5907\u73af\u5883\u7684\u60c5\u51b5\u4e0b":196,"\u5728\u7f16\u8f91":168,"\u5728\u8bad\u7ec3\u4efb\u52a1\u7684\u6bcf\u4e2a":164,"\u5728\u8bad\u7ec3\u7a0b\u5e8f\u8fd0\u884c\u4e4b\u524d\u8bfb\u53d6\u68c0\u67e5\u70b9":164,"\u5728\u8bad\u7ec3\u7a0b\u5e8f\u8fd0\u884c\u5b8c\u5168\u4e4b\u540e\u4fdd\u5b58\u6a21\u578b":164,"\u5728\u8c03\u7528\u8fc7":146,"\u5728\u8fd9\u6837\u7684\u4e00\u4e2ademo\u4e2d":142,"\u5728\u8fdb\u884c\u6bcf\u4e00\u4e2a":168,"\u5728\u914d\u7f6e\u6587\u4ef6\u7684env\u5b57\u6bb5\u6dfb\u52a0manager\u5b57\u6bb5":139,"\u5728\u957f":143,"\u5728\u9759\u6001\u73af\u5883\u5143\u7d20\u63a5\u53e3\u57fa\u7840\u4e0a":148,"\u5728__regist":142,"\u5728coordinator\u53d1\u6765\u4efb\u52a1\u4e4b\u524d":156,"\u5728di":[153,164],"\u5728model":196,"\u5728mr\u6216issue\u91cc\u63cf\u8ff0\u4ee3\u7801\u6539\u52a8\u5bf9\u5e94\u7684\u5de5\u4f5c\u5185\u5bb9":168,"\u5728python\u7ec8\u7aef\u4e2d\u5982\u679c\u53ef\u4ee5\u6210\u529f":150,"\u5728qbert\u4e0a\u4f7f\u7528dqn\u7b97\u6cd5\u65f6":150,"\u5747\u5feb\u4e8e":143,"\u5747\u662f\u6765\u81ea":146,"\u5747\u7ee7\u627f\u81eabasetime\u7c7b":142,"\u5757":145,"\u57fa\u4e8e":153,"\u57fa\u4e8e\u4ef7\u503c\u51fd\u6570":196,"\u57fa\u4e8e\u8fd9\u4e2a\u6846\u67b6\u4e0b\u7684\u5404\u79cd\u7b97\u6cd5":196,"\u57fa\u4e8e\u9519\u8bef\u4ee3\u7801":153,"\u57fa\u672c\u4f7f\u7528\u65b9\u6cd5\u7684\u5c0f\u4f19\u4f34\u4eec\u4e00\u4e9b\u89c4\u8303":168,"\u57fa\u7840\u7ec4\u4ef6":158,"\u57fa\u7c7b\u5b9a\u4e49":156,"\u5904\u7406":168,"\u5904\u7406\u6210learner\u9700\u8981\u7684\u683c\u5f0f":156,"\u5904\u7406\u6570\u636e\u7684\u65f6\u95f4":145,"\u5904\u7406master\u53d1\u6765\u7684task":156,"\u5904\u7684\u671f\u671b\u503c":196,"\u5904\u83b7\u53d6\u5230\u6570\u636e\u6216\u6570\u636e\u4efb\u52a1":145,"\u590d\u6742\u73af\u5883\u6216\u5927\u6570\u91cf\u73af\u5883\u7684\u8fd0\u884c\u63a8\u8350\u91c7\u7528":146,"\u5916\u754c\u8bbe\u5b9a\u7684\u662f\u79cd\u5b50\u7684\u79cd\u5b50":148,"\u591a\u673a\u89c4\u6a21\u5316\u5206\u5e03\u5f0f":153,"\u591a\u8fdb\u7a0b":145,"\u591a\u8fdb\u7a0bmultiprocessing\u542f\u52a8\u7684\u4e0a\u4e0b\u6587":139,"\u5927\u5927\u7f29\u77ed\u4e86":145,"\u5956\u52b1\u51fd\u6570\u4e5f\u4f1a\u53d1\u751f\u53d8\u5316":196,"\u5956\u52b1\u51fd\u6570\u7531\u5f53\u524d\u7684\u72b6\u6001\u4e0e\u667a\u80fd\u4f53\u7684\u52a8\u4f5c\u51b3\u5b9a":196,"\u5982":139,"\u5982\u4f55\u4e0e\u5916\u754c\u901a\u4fe1\u7b49\u7b49":156,"\u5982\u52a0\u8f7d\u6a21\u578b":156,"\u5982\u5728atari\u6e38\u620f\u4e0esmac\u661f\u9645\u6e38\u620f\u4e2d\u4e3a\u79bb\u6563\u7684\u52a8\u4f5c\u7a7a\u95f4":196,"\u5982\u5b89\u88c5\u76ee\u5f55\u5728":150,"\u5982\u6570\u636e\u600e\u4e48\u83b7\u5f97":156,"\u5982\u65e0\u7279\u6b8a\u9700\u6c42\u53ef\u4ee5\u76f4\u63a5\u8c03\u7528":148,"\u5982\u6709\u9700\u8981":142,"\u5982\u679c":153,"\u5982\u679c\u4e0d\u52a0\u8fd8\u539f\u7684\u6548\u679c":158,"\u5982\u679c\u4e3a\u771f":148,"\u5982\u679c\u4f60\u8fd8\u4e0d\u719f\u6089":168,"\u5982\u679c\u4f7f\u7528\u8005\u4f9d\u7136\u60f3\u8981\u5728":148,"\u5982\u679c\u540c\u4e00\u4f4d\u7f6e\u88ab\u6ce8\u518c\u4e86\u591a\u4e2ahook":[164,165],"\u5982\u679c\u5728\u5f53\u524d\u5c42\u6ca1\u6709\u627e\u5230\u5bf9\u5e94\u7684\u51fd\u6570\u65b9\u6cd5":164,"\u5982\u679c\u5bf9":146,"\u5982\u679c\u5c06\u6a21\u578b\u7684\u521b\u5efa\u653e\u5728":148,"\u5982\u679c\u6211\u4eec\u53ef\u4ee5\u8ba1\u7b97\u51fa\u6bcf\u4e2a\u72b6\u6001\u6216\u8005\u91c7\u53d6\u67d0\u4e2a\u884c\u52a8\u4e4b\u540e\u6536\u76ca":196,"\u5982\u679c\u662f\u4fee\u590d":168,"\u5982\u679c\u662f\u53ef\u53d8\u8f93\u5165\u5c3a\u5bf8":150,"\u5982\u679c\u662f\u6253\u7b97\u6dfb\u52a0\u65b0\u529f\u80fd":168,"\u5982\u679c\u662f\u81ea\u5b9a\u4e49\u7684":164,"\u5982\u679c\u662f\u81ea\u5df1\u5f00\u53d1\u4f7f\u7528":168,"\u5982\u679c\u6709\u5219\u76f4\u63a5reset\u5df2\u6709\u73af\u5883":148,"\u5982\u679c\u6b63\u5728\u6267\u884c\u7684\u4efb\u52a1\u5df2\u7ecf\u8fbe\u5230\u6700\u5927\u6570\u91cf":153,"\u5982\u679c\u6ca1\u6709\u5219\u8fdb\u884c\u521b\u5efa\u518dreset":148,"\u5982\u679c\u6ca1\u6709\u5b9a\u4e49\u7684\u8bdd":164,"\u5982\u679c\u7528\u6237\u9700\u8981\u6dfb\u52a0\u65b0\u7684":148,"\u5982\u679c\u8981\u4e3amaster\u505a\u66f4\u591a\u529f\u80fd\u62d3\u5c55\u7684\u8bdd":153,"\u5982\u679c\u8981\u5f15\u5165\u8fd9\u4e9b\u6587\u4ef6":168,"\u5982\u679c\u9700\u8981\u4fee\u6539\u7684\u8bdd":164,"\u5982\u679c\u9700\u8981\u81ea\u5b9a\u4e49":148,"\u5982\u679cexploitation\u592a\u591a":196,"\u5982\u679cslave\u7aef\u7a7a\u95f2":153,"\u5982\u6b64\u4e00\u6765":164,"\u5982\u72b6\u6001\u7a7a\u95f4\u6216\u52a8\u4f5c\u7a7a\u95f4\u4e0d\u4e3a\u79bb\u6563\u7a7a\u95f4\u65f6":196,"\u5982\u7a00\u758f\u5956\u52b1":196,"\u5982\u8981\u4f7f\u7528\u5219\u5fc5\u987b\u6309\u7167":148,"\u5982\u9ad8\u65af":164,"\u5b50\u73af\u5883":146,"\u5b50\u7c7b\u53ef\u4ee5\u62d3\u5c55\u8be5\u65b9\u6cd5":148,"\u5b50\u7c7b\u53ef\u4ee5\u81ea\u5b9a\u4e49\u81ea\u5df1\u7684\u8be5\u53d8\u91cf":148,"\u5b50\u7c7b\u5fc5\u987b\u91cd\u5199\u5b9e\u73b0\u8be5\u65b9\u6cd5":156,"\u5b50\u7c7b\u9700\u7ee7\u627f\u91cd\u5199\u65b9\u6cd5":[148,156],"\u5b50\u8fdb\u7a0b\u4e4b\u95f4\u901a\u4fe1\u7684\u7b49\u5f85\u65f6\u95f4":146,"\u5b50\u8fdb\u7a0b\u95f4\u901a\u4fe1\u7684\u6700\u5927\u7b49\u5f85\u65f6\u95f4":146,"\u5b57\u5178":146,"\u5b57\u5178\u6620\u5c04":158,"\u5b57\u6bb5":158,"\u5b57\u6bb5\u6709\u4e00\u4e9b\u4f9d\u8d56\u5173\u7cfb":148,"\u5b57\u7b26\u4e32\u679a\u4e3e\u9a8c\u8bc1":158,"\u5b58\u5165":146,"\u5b58\u5728\u4f9d\u8d56\u4e8e\u51fd\u6570\u903c\u8fd1\u8d28\u91cf\u7684\u504f\u5dee":196,"\u5b58\u5728\u53c2\u6570\u590d\u6742":164,"\u5b83\u4ece":156,"\u5b89\u6392\u5e76\u8fd0\u884c\u8bad\u7ec3\u4efb\u52a1":153,"\u5b89\u88c5":150,"\u5b89\u88c5\u5728\u7528\u6237\u76ee\u5f55\u4e0b":139,"\u5b89\u88c5\u6210\u529f\u540e":150,"\u5b8c\u5168\u4e00\u81f4":164,"\u5b8c\u6210\u4e00\u4e2a\u65f6\u95f4\u6b65":146,"\u5b8c\u6210\u4e86":146,"\u5b8c\u6210\u540e":156,"\u5b8c\u6210\u5efa\u7acblearner\u7684\u5de5\u4f5c":156,"\u5b8c\u6210\u65b0\u7684\u8bad\u7ec3\u5de5\u4f5c":156,"\u5b8c\u6210\u672c\u5730\u5f00\u53d1\u4e4b\u540e":168,"\u5b98\u65b9\u7684\u63a8\u8350\u6559\u7a0b":168,"\u5b9a\u4e49":[146,148,196],"\u5b9a\u4e49\u4e00\u4e2a\u73af\u5883\u9700\u8981\u4ece\u73af\u5883\u7684\u8f93\u5165\u8f93\u51fa\u5165\u624b":148,"\u5b9a\u4e49\u4e86\u56db\u4e2a\u4f4d\u7f6e":164,"\u5b9a\u4e49\u4e86\u73af\u5883\u6bcf\u8fd0\u884c\u4e00\u6b65\u8fd4\u56de\u7684\u5185\u5bb9":148,"\u5b9a\u4e49\u4e86\u73af\u5883\u7684\u57fa\u672c\u4fe1\u606f":148,"\u5b9a\u4e49\u5982\u4e0b":153,"\u5b9a\u4e49\u81ea\u5df1\u7684":164,"\u5b9a\u65f6\u5c06\u5f53\u524d\u7b56\u7565\u53ca\u8bad\u7ec3\u4fe1\u606f\u53d1\u9001\u51fa\u53bb":156,"\u5b9e\u4f8b":146,"\u5b9e\u4f8b\u5316\u4e86\u5b50\u73af\u5883":146,"\u5b9e\u4f8b\u5316\u8c03\u7528\u63a5\u53e3":146,"\u5b9e\u4f8b\u5982\u4e0b":168,"\u5b9e\u578b":142,"\u5b9e\u73b0":148,"\u5b9e\u73b0\u5355\u4f8b\u6a21\u578b\u6240\u7528\u7684\u7c7b\u53d8\u91cf":148,"\u5b9e\u73b0\u5373\u53ef":148,"\u5b9e\u73b0\u7684":145,"\u5b9e\u73b0\u81ea\u8eab\u9700\u8981\u68c0\u67e5\u7684\u90e8\u5206":148,"\u5b9e\u9645\u4e0a\u5bf9\u4e8e\u5355\u673a\u8f7b\u578b\u6765\u8bf4":153,"\u5b9e\u9645\u4e0a\u5c31\u662f":164,"\u5b9e\u9645\u4e0a\u64cd\u4f5c\u4e2d":158,"\u5b9e\u9645\u4e0a\u6839\u636e\u76ee\u524d\u7684\u521d\u6b65\u8c03\u7814":153,"\u5b9e\u9645\u4e0a\u7684\u521d\u59cb\u5316\u65b9\u6cd5":148,"\u5b9e\u9645\u4f7f\u7528\u65f6\u8c03\u7528\u9759\u6001\u5143\u7d20\u7684\u76f8\u5e94\u65b9\u6cd5":148,"\u5b9e\u9a8c\u4e2d":145,"\u5b9e\u9a8c\u51c6\u5907":[143,145],"\u5b9e\u9a8c\u5f00\u59cb\u524d\u8dd1\u4e86\u4e00\u4e2a\u7eaf":143,"\u5b9e\u9a8c\u7ed3\u679c":[143,145],"\u5b9e\u9a8c\u91cd\u590d10\u6b21\u53d6\u5e73\u5747\u503c":145,"\u5bb9\u6613\u51fa\u73b0\u7ef4\u5ea6\u707e\u96be\u95ee\u9898":196,"\u5bb9\u6613\u5b66\u4e60\u5230\u5c40\u90e8\u6700\u4f18\u89e3":196,"\u5bf9":146,"\u5bf9\u4e8e":[156,164],"\u5bf9\u4e8e\u4e00\u4e2a\u73af\u5883\u7684\u5177\u4f53\u521b\u5efa":148,"\u5bf9\u4e8e\u4e00\u6bb5\u5c01\u88c5\u5f97\u8f83\u597d\u7684\u4ee3\u7801":164,"\u5bf9\u4e8e\u4f7f\u7528":164,"\u5bf9\u4e8e\u5355\u673a\u5206\u5e03\u5f0f\u800c\u8a00":153,"\u5bf9\u4e8e\u53c2\u6570":143,"\u5bf9\u4e8e\u5404\u7c7b\u7b97\u5b50":150,"\u5bf9\u4e8e\u6a21\u578b\u5df2\u77e5\u7684\u7cfb\u7edf":196,"\u5bf9\u4e8e\u6a21\u578b\u672a\u77e5\u7684\u7cfb\u7edf":196,"\u5bf9\u4e8e\u73af\u5883\u5185\u5404\u79cd\u5904\u7406\u51fd\u6570\u548c":148,"\u5bf9\u4e8e\u73af\u5883\u7ba1\u7406\u5668\u7684\u53c2\u6570":143,"\u5bf9\u4e8e\u73af\u5883\u8fd4\u56de\u7684":148,"\u5bf9\u4e8e\u7528\u6237\u81ea\u5b9a\u4e49\u7684":164,"\u5bf9\u4e8e\u8868\u683c\u578b\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5":196,"\u5bf9\u4e8e\u8be5\u4fe1\u606f\u7684\u5185\u5bb9\u6709":156,"\u5bf9\u4e8e\u8fd0\u884cdi":139,"\u5bf9\u4e8e\u90e8\u5206\u7b97\u5b50":150,"\u5bf9\u4e8einteraction\u800c\u8a00":153,"\u5bf9\u51fd\u6570\u8fdb\u884c\u5305\u88c5":164,"\u5bf9\u5956\u52b1\u51fd\u6570\u7684\u8bbe\u8ba1\u4e0e\u52a0\u5de5\u4e5f\u662f\u4e00\u4e2a\u91cd\u8981\u7684\u65b9\u5411":196,"\u5bf9\u5e94\u7684\u5f00\u53d1\u4efb\u52a1\u65f6":168,"\u5bf9\u5e94\u7684gitlab\u7f51\u9875\u4e0a\u76f4\u63a5\u8fdb\u884c\u64cd\u4f5c":168,"\u5bf9\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u6548\u679c\u6709\u5f88\u5927\u7684\u5f71\u54cd":196,"\u5bf9\u671f\u671b\u6536\u76ca":196,"\u5bf9\u672a\u6765\u7684\u4fe1\u5fc3":196,"\u5bf9\u67d0\u51e0\u4e2a\u73af\u5883\u8fdb\u884c\u64cd\u4f5c":146,"\u5bf9\u6bd4":143,"\u5bf9\u73b0\u6709\u4ee3\u7801\u7684\u4fee\u6539":168,"\u5bf9\u81ea\u5b9a\u4e49\u7684":164,"\u5bf9\u8c61":148,"\u5bf9\u8f93\u5165\u53c2\u6570\u505a\u5fc5\u8981\u7684":148,"\u5bf9\u8f93\u51fa":148,"\u5bf9\u9759\u6001\u5904\u7406\u51fd\u6570\u8fd4\u56de\u7684\u7ed3\u679c\u8fdb\u884c\u518d\u52a0\u5de5":148,"\u5bfb\u627e\u6700\u4f18\u7684\u53c2\u6570\u4f7f\u5f97\u5f3a\u5316\u5b66\u4e60\u7684\u76ee\u6807":196,"\u5bfb\u627e\u6700\u4f18\u7b56\u7565":196,"\u5c06":[145,146,164],"\u5c06\u4ed3\u5e93\u6839\u76ee\u5f55\u4e0b\u7684":139,"\u5c06\u52a8\u4f5c":196,"\u5c06\u6240\u6709\u7684":143,"\u5c06\u6536\u5230\u7684\u6570\u636e\u4fe1\u606f\u653e\u5165":156,"\u5c06\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u6839\u636e":145,"\u5c06\u65f6\u95f4\u7a97\u53e3\u5185\u7684\u6570\u636e\u53ca\u5176\u53d8\u5316\u60c5\u51b5\u8fdb\u884c\u4e86\u5b8c\u6574\u7684\u8bb0\u5f55":142,"\u5c06\u73af\u5883\u8fd0\u884c\u8d77\u6765":146,"\u5c06\u7b56\u7565\u5b58\u50a8\u6216\u53d1\u9001":156,"\u5c06\u81ea\u5df1\u7684\u56db\u4e2a\u51fd\u6570\u4f5c\u4e3a\u56de\u8c03\u51fd\u6570\u4f20\u7ed9learner":156,"\u5c06\u8bad\u7ec3\u4fe1\u606f\u5b58\u50a8\u6216\u53d1\u9001":156,"\u5c06master":153,"\u5c1a\u672a\u5b9e\u4f8b\u5316\u5b50\u73af\u5883":146,"\u5c1a\u672a\u8fdb\u884c":146,"\u5c24\u5176\u6307\u6570\u5b66\u8ba1\u7b97\u903b\u8f91\u7684\u6784\u5efa":158,"\u5c31\u4e0d\u4f1a\u51fa\u73b0\u4e3a\u5b50\u73af\u5883\u91cd\u590d\u53d1\u9001\u547d\u4ee4\u7684\u60c5\u51b5":146,"\u5c31\u4f1a\u63a5\u6536\u5230\u8be5\u4efb\u52a1":156,"\u5c31\u53ef\u4ee5\u88ab\u6d3e\u4e0a\u7528\u573a":164,"\u5c31\u662f\u5c06\u7cfb\u7edf\u63a2\u7d22\u73af\u5883\u83b7\u5f97\u7684\u6837\u672c\u4fdd\u5b58\u8d77\u6765":196,"\u5c31\u88ab":156,"\u5c3d\u91cf\u4fdd\u8bc1\u6bcf\u4e2acommit\u53ea\u5bf9\u5e94\u4e00\u79cd\u76f8\u5173\u7684\u4ee3\u7801\u6539\u52a8":168,"\u5c5e\u6027\u4e2d":146,"\u5c5e\u6027\u4f1a\u7b49\u5f85\u81f3\u5c11\u4e00\u4e2a\u5b50\u73af\u5883\u5b8c\u6210\u8fd0\u884c":146,"\u5c5e\u6027\u83b7\u5f97\u5f53\u524d\u8fd0\u884c\u5b8c\u6210":146,"\u5c5e\u6027\u8fd4\u56de\u4e00\u4e2a\u5b57\u5178":146,"\u5c5e\u6027\u8fd4\u56de\u7684":146,"\u5c5e\u6027\u8fd4\u56de\u7684\u73af\u5883":146,"\u5de6\u53f3":143,"\u5df2\u7ecf\u5b9a\u4e49\u597d\u7684":164,"\u5df2\u7ecf\u5b9e\u73b0\u4e86\u8bb8\u591a\u5e38\u7528\u7684":164,"\u5e38\u89c1\u7684slurm\u96c6\u7fa4\u7b49\u73af\u5883\u4e0a\u8fd0\u884c\u4e00\u822c\u7684\u8bad\u7ec3\u4efb\u52a1":153,"\u5e38\u91cf":158,"\u5e38\u9a7b":156,"\u5e76\u4e0d\u662f\u6bcf\u4e00\u4e2a\u72b6\u6001\u4e0b\u73af\u5883\u90fd\u4f1a\u7ed9\u4e88\u53cd\u9988":196,"\u5e76\u4e0e":143,"\u5e76\u4e0e\u73af\u5883\u4ea7\u751f\u4ea4\u4e92":148,"\u5e76\u4e14":153,"\u5e76\u4e14\u53ef\u4ee5\u53ea\u8bc4\u4f30\u5173\u6ce8\u7684\u67d0\u4e2a\u72b6\u6001":196,"\u5e76\u4e14\u53ef\u4f9b\u8bbf\u95ee":142,"\u5e76\u4e14\u5b9e\u9645\u4e0a\u5728\u8fd9\u6837\u7684\u73af\u5883\u4e0b":153,"\u5e76\u4e14\u5f71\u54cd\u5176\u5185\u90e8\u7684\u903b\u8f91\u4e0e\u6570\u636e\u7ea6\u675f":153,"\u5e76\u4e14\u63d0\u4f9b\u4e0e":146,"\u5e76\u4e14\u7ed3\u5408\u4f20\u5165\u7684\u65f6\u95f4\u5bf9\u8c61\u8fdb\u884c\u8bb0\u5f55":142,"\u5e76\u4e3a\u5176\u89e3\u51b3\u6d89\u53ca\u901a\u4fe1\u7684\u95ee\u9898":156,"\u5e76\u5145\u5206\u8003\u8651\u5176\u4e2d\u53ef\u80fd\u7684":148,"\u5e76\u5229\u7528\u73af\u5883\u6a21\u578b\u6765\u8fdb\u884c\u5b66\u4e60":196,"\u5e76\u5229\u7528flaskfilesystemlearner\u4f20\u6765\u7684\u56de\u8c03\u51fd\u6570\u54cd\u5e94\u76f8\u5e94\u7684task":156,"\u5e76\u5355\u72ec\u7528\u4e00\u4e2a":168,"\u5e76\u5728\u5176\u57fa\u7840\u4e0a\u589e\u52a0\u4e86\u4e00\u7cfb\u5217\u66f4\u4e3a\u65b9\u4fbf\u7684\u529f\u80fd":148,"\u5e76\u5728\u8fd0\u884c\u7ed3\u675f\u65f6\u8fd4\u56de":146,"\u5e76\u5b58\u50a8\u5728":145,"\u5e76\u5b9e\u73b0":156,"\u5e76\u5b9e\u73b0\u4e86":148,"\u5e76\u5c06\u5176\u53d1\u9001\u7ed9":145,"\u5e76\u5c06\u5176\u901a\u8fc7learner":156,"\u5e76\u5c06\u5176\u952e\u503c\u4f5c\u4e3a\u5b50\u73af\u5883":146,"\u5e76\u5c06\u8bfb\u53d6\u5230\u7684\u6570\u636e\u653e\u7f6e\u5728":145,"\u5e76\u63d0\u4f9b\u4e86\u7b80\u5355\u7684\u8c03\u7528\u65b9\u6cd5":164,"\u5e76\u653e\u7f6e\u5728":145,"\u5e76\u663e\u793a\u542f\u7528\u7684":148,"\u5e76\u6709\u4e13\u4eba\u5bf9\u8fd9\u4e9b\u7b97\u529b\u8fdb\u884c\u7ef4\u62a4":153,"\u5e76\u6839\u636e\u52a8\u4f5c\u6240\u8fd4\u56de\u7684\u4e0d\u540c\u7c7b\u578b\u7684\u73af\u5883\u53cd\u9988":196,"\u5e76\u6ce8\u518c\u4e00\u4e9b\u7edf\u8ba1\u65b9\u6cd5":142,"\u5e76\u7b49\u5f85learner\u7ed3\u675f\u8bad\u7ec3":156,"\u5e76\u7ed9\u4e88\u667a\u80fd\u4f53\u52a8\u4f5c\u7684\u53cd\u9988\u5956\u52b1":196,"\u5e76\u884c\u6a21\u5f0f\u4e2d\u7684\u8bad\u7ec3\u6d41\u7a0b\u89e3\u6790":156,"\u5e76\u884c\u6a21\u5f0f\u7531\u4e8e\u6d89\u53ca\u5230\u5f02\u6b65\u8fd0\u884c\u7684learner":156,"\u5e76\u884cpipelin":156,"\u5e76\u884cpipeline\u4f1a\u521b\u5efacomm":156,"\u5e76\u8c03\u7528":156,"\u5e76\u8fd4\u56de":146,"\u5e76\u8fd4\u56de\u5176":146,"\u5e76\u8fd4\u56de\u6b64":148,"\u5e76\u8fd4\u56de\u7ed3\u679c\u6216\u629b\u51fa\u5f02\u5e38":146,"\u5e76\u8fd4\u56de\u7ed9coordin":156,"\u5e76\u901a\u8fc7\u5efa\u7acb\u7684\u8fde\u63a5\u5bf9slave\u8fdb\u884c\u4efb\u52a1\u7684\u4e0b\u8fbe\u548c\u63a5\u6536":153,"\u5e76\u901a\u8fc7\u8fd4\u56de\u503c\u4ee5\u53ca\u5f02\u5e38\u629b\u51fa\u6765\u8fdb\u884c\u6d88\u606f\u56de\u4f20":153,"\u5e76\u901a\u8fc7\u8fdb\u7a0b\u9501":153,"\u5e93\u7684\u4e00\u4e9b":164,"\u5e94\u5bf9\u8d8a\u6765\u8d8a\u5bc6\u96c6\u7684\u6570\u636e\u9700\u6c42\u7684\u80fd\u529b":145,"\u5e94\u8be5\u7279\u522b\u6ce8\u610f\u7684\u70b9":168,"\u5ed6\u7684\u6559\u7a0b\u65b9\u4fbf\u4e00\u5c0f\u65f6\u5165\u95e8":168,"\u5ed6\u96ea\u5cf0\u7684":168,"\u5ef6\u4f38\u51fa\u4e0d\u540c\u7684\u7b97\u6cd5":196,"\u5efa\u7acb\u901a\u4fe1\u7ba1\u9053":146,"\u5efa\u8bae\u4e0e\u7279\u5b9a\u73af\u5883\u5143\u7d20\u76f8\u5173\u7684\u72b6\u6001\u53d8\u91cf\u4e00\u5f8b\u653e\u5728\u8fd9\u91cc\u7ef4\u62a4":148,"\u5efa\u8bae\u5148\u67e5\u9605":146,"\u5efa\u8bae\u5220\u9664\u8001\u7248\u672c\u540e\u91cd\u65b0\u5b89\u88c5\u65b0\u7248\u672c":150,"\u5efa\u8bae\u5bf9\u4e8e\u7279\u5b9a\u7684\u4e1a\u52a1\u8bbe\u5b9a\u7279\u5b9a\u7684channel\u503c":153,"\u5efa\u8bae\u6839\u636e\u4e0d\u540c\u7684\u4e1a\u52a1\u5f02\u5e38\u7c7b\u578b\u4f7f\u7528\u5bf9\u5e94\u7684\u5f02\u5e38\u7c7b":153,"\u5efa\u8bae\u73b0\u5728":168,"\u5efa\u8bae\u7c7b\u672c\u8eab\u4e5f\u5bf9\u751f\u547d\u5468\u671f\u8fdb\u884c\u59a5\u5584\u7ba1\u7406":153,"\u5efa\u8bae\u8bbf\u95ee\u4fe1\u606f\u901a\u8fc7":148,"\u5efa\u8baefork\u51fa\u4e00\u4e2a\u65b0\u4ee3\u7801\u4ed3\u5e93\u81f3\u81ea\u5df1\u7684\u7528\u6237\u540d\u4e0b":168,"\u5f00\u53d1\u5b8c\u6210\u540e\u65e0\u7528\u7684\u5206\u652f\u8bf7\u5728\u8fdc\u7a0b\u4ed3\u5e93\u4e2d\u5220\u9664":168,"\u5f00\u542fcomm":156,"\u5f02\u5e38\u6765\u8868\u793a\u4efb\u52a1\u6267\u884c\u5931\u8d25":153,"\u5f02\u6b65":156,"\u5f02\u6b65\u5f0f\u6570\u636e\u52a0\u8f7d\u5668":145,"\u5f3a\u5316\u5b66\u4e60":196,"\u5f3a\u5316\u5b66\u4e60\u4e0d\u9700\u8981\u5e26\u6807\u7b7e\u7684\u6570\u636e\u96c6":196,"\u5f3a\u5316\u5b66\u4e60\u4e2d\u5305\u542b\u4e86\u5982\u4f55\u4f7f\u7528\u7b56\u7565\u6765\u91c7\u6837\u8f68\u8ff9\u6570\u636e":196,"\u5f3a\u5316\u5b66\u4e60\u4e2d\u5c06\u9a6c\u5c14\u53ef\u592b\u51b3\u7b56\u8fc7\u7a0b\u7684\u4e00\u4e2a\u5e8f\u5217\u79f0\u4e3a":196,"\u5f3a\u5316\u5b66\u4e60\u4e3b\u8981\u9488\u5bf9\u7684\u95ee\u9898\u662f\u5728\u4e00\u4e2a\u53ef\u80fd\u4e0d\u65ad\u6f14\u5316\u7684\u73af\u5883\u4e2d":196,"\u5f3a\u5316\u5b66\u4e60\u4e5f\u88ab\u5e94\u7528\u4e8e\u81ea\u52a8\u9a7e\u9a76":196,"\u5f3a\u5316\u5b66\u4e60\u53ef\u4ee5\u7528\u4e8e\u5904\u7406\u66f4\u591a\u590d\u6742\u7684\u51b3\u7b56\u95ee\u9898":196,"\u5f3a\u5316\u5b66\u4e60\u5728\u4e92\u8054\u7f51\u63a8\u8350":196,"\u5f3a\u5316\u5b66\u4e60\u5df2\u7ecf\u5728\u6e38\u620f\u9886\u57df":196,"\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u5148\u4f30\u8ba1\u7b56\u7565\u7684\u503c\u51fd\u6570":196,"\u5f3a\u5316\u5b66\u4e60\u7684\u76ee\u6807\u4e5f\u5c31\u662f\u8ba9\u667a\u80fd\u4f53\u5b66\u4f1a\u4e00\u79cd\u7b56\u7565":196,"\u5f3a\u5316\u5b66\u4e60\u7684\u76ee\u6807\u662f\u7ed9\u5b9a\u4e00\u4e2a\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"\u5f3a\u5316\u5b66\u4e60\u76ee\u524d\u7684\u5e94\u7528\u573a\u666f\u6709\u54ea\u4e9b":196,"\u5f3a\u5316\u5b66\u4e60\u8bad\u7ec3\u5e76\u53d1\u8ba1\u7b97\u91cf\u5927":153,"\u5f3a\u5316\u5b66\u4e60\u95ee\u9898\u7684\u4f18\u5316\u76ee\u6807\u5c31\u662f\u627e\u5230\u4e00\u4e2a\u7b56\u7565":196,"\u5f3a\u70c8\u4e0d\u5efa\u8bae\u76f4\u63a5\u5bf9master\u548cslave\u7c7b\u8fdb\u884c\u4e8c\u6b21\u7ee7\u627f":153,"\u5f3a\u884c\u8986\u76d6\u63a8\u9001\u672c\u5730\u6539\u52a8\u5230\u8fdc\u7a0b\u5206\u652f":168,"\u5f53":146,"\u5f53\u4e0d\u4f20\u5165\u4efb\u4f55\u53c2\u6570\u65f6":146,"\u5f53\u4e14\u4ec5\u5f53":196,"\u5f53\u4e2d":156,"\u5f53\u4f20\u5165":146,"\u5f53\u5b89\u88c5\u6210\u529f\u540e":150,"\u5f53\u6211\u4eec\u5e0c\u671b\u5728\u67d0\u4e2a\u51fd\u6570\u6267\u884c\u7684\u65f6\u5019\u989d\u5916\u6267\u884c\u4e00\u4e9b\u81ea\u5b9a\u4e49\u7684\u64cd\u4f5c\u65f6":164,"\u5f53\u6240\u6709\u4ecd\u5728\u8fd0\u884c":146,"\u5f53\u6570\u636e\u4e0d\u53d8\u65f6":145,"\u5f53\u667a\u80fd\u4f53\u53ea\u80fd\u63a5\u6536\u90e8\u5206\u73af\u5883\u4fe1\u606f":196,"\u5f53\u667a\u80fd\u4f53\u80fd\u591f\u63a5\u6536\u5230\u73af\u5883\u5168\u90e8\u7684\u72b6\u6001\u4fe1\u606f":196,"\u5f53\u6709\u4e00\u5b9a\u6570\u91cf\u7684\u5b50\u73af\u5883\u8fd4\u56de":146,"\u5f53\u6709\u4f7f\u7528\u8005\u6709\u8bad\u7ec3\u4efb\u52a1\u65f6":153,"\u5f53\u73af\u5883\u53d1\u751f\u53d8\u5316\u65f6":196,"\u5f53\u73af\u5883\u89c4\u6a21\u589e\u5927":145,"\u5f53\u73af\u5883\u8fd4\u56de\u7684obs\u7b49\u53d8\u91cf\u5927\u5c0f\u8d85\u8fc7100kb\u65f6":146,"\u5f53\u7a0b\u5e8f\u8fd0\u884c\u5230\u6307\u5b9a\u4f4d\u7f6e\u7684\u65f6\u5019":164,"\u5f53\u7b56\u7565\u4e3a\u786e\u5b9a\u7684":196,"\u5f53\u7b56\u7565\u4e3a\u968f\u673a\u7684":196,"\u5f53\u7f13\u5b58\u4e2d\u7684\u6570\u636e\u8db3\u591f\u591a\u65f6":196,"\u5f53\u8c03\u7528":164,"\u5f53\u8d85\u8fc7\u7b49\u5f85\u65f6\u95f4\u65f6\u4f1a\u629b\u51fa\u5f02\u5e38":146,"\u5f53coordinator\u6536\u5230\u6d41\u7a0b2\u4e2d\u6700\u540e":156,"\u5f53loader\u548cnorm\u653e\u5728\u4e00\u5757\u4f7f\u7528\u7684\u65f6\u5019":158,"\u5f53master\u4e0b\u8fbe\u4efb\u52a1\u65f6":153,"\u5f53master\u7aef\u4e0b\u8fbe\u4efb\u52a1\u65f6":153,"\u5f62\u6210\u590d\u6742\u7684\u9a8c\u8bc1\u8f6c\u6362\u7ed3\u6784":158,"\u5f85\u5168\u90e8\u6216\u90e8\u5206\u73af\u5883\u8fd0\u884c\u7ed3\u675f\u65f6\u8fd4\u56de\u7ed3\u679c":146,"\u5f88\u7b80\u5355":158,"\u5f97\u5230\u5b9e\u9645\u8fd0\u884c\u65f6\u7684\u5143\u7d20\u503c":148,"\u5f97\u5230\u7684":164,"\u5faa\u73af\u4e0a\u8ff0\u7684\u6b65\u9aa4":196,"\u5fc5\u987b\u4f7f\u7528":[148,168],"\u5fc5\u987b\u5305\u542b\u8be5\u952e\u503c":148,"\u5feb\u901f\u67e5\u9605\u5f53\u524d\u73af\u5883\u7684\u5404\u79cd":148,"\u5ffd\u7565\u524d5\u6b21\u65f6\u95f4\u8868\u73b0\u4e0d\u592a\u7a33\u5b9a\u7684\u8fed\u4ee3":145,"\u6027\u80fd\u4e0a\u6574\u4f53\u4f18\u4e8e":143,"\u6027\u80fd\u7684\u5ea6\u91cf":148,"\u6027\u8bc4\u4f30":196,"\u603b\u4f53\u7528\u65f6\u5982\u4e0b\u8868":143,"\u603b\u7528\u65f6\u53cd\u800c\u4f1a\u51cf\u5c0f":145,"\u603b\u7ed3\u6765\u8bf4":196,"\u6052\u771f":158,"\u60c5\u51b5\u4e0b\u7684":145,"\u610f\u5473\u7740\u6570\u636e\u63a8\u65ad\u65f6\u95f4\u9012\u51cf":145,"\u6210\u529f\u6267\u884c\u7684\u4fe1\u606f\u540e":156,"\u6211\u4eec\u4e00\u822c\u7528":196,"\u6211\u4eec\u4f1a\u89e3\u91ca\u4ee5\u4e0b\u7684\u57fa\u7840\u6982\u5ff5":196,"\u6211\u4eec\u4f1a\u8fdb\u4e00\u6b65\u89e3\u91ca\u4ee5\u4e0b\u7684\u65b9\u6cd5\u6982\u5ff5":196,"\u6211\u4eec\u51c6\u5907\u4e86\u4e09\u4e2a\u89c4\u6a21\u4e0d\u540c\u7684\u73af\u5883":143,"\u6211\u4eec\u51c6\u5907\u4e86\u56db\u4e2a\u89c4\u6a21\u4e0d\u540c\u7684\u73af\u5883":145,"\u6211\u4eec\u5206\u522b\u4fdd\u7559\u4e86\u4e24\u8005\u7684\u9ed8\u8ba4\u503c":143,"\u6211\u4eec\u53d1\u73b0":145,"\u6211\u4eec\u53ea\u8ba8\u8bba\u6709\u9650\u72b6\u6001\u7684\u9a6c\u53ef\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"\u6211\u4eec\u53ef\u4ee5\u5c06\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u4e0e\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u8868\u793a\u4e3a":196,"\u6211\u4eec\u53ef\u4ee5\u5f88\u65b9\u4fbf\u7684\u67e5\u9605\u5230":148,"\u6211\u4eec\u53ef\u4ee5\u8fdb\u4e00\u6b65\u5f97\u5230\u6700\u4f18\u7684\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u4e0e\u6700\u4f18\u7684\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u7684\u5173\u7cfb":196,"\u6211\u4eec\u53ef\u4ee5\u901a\u8fc7\u4ee5\u4e0b\u65b9\u5f0f\u8fdb\u884c\u4efb\u52a1\u7684\u4e0b\u8fbe":153,"\u6211\u4eec\u5728\u540e\u8fb9\u7684\u6d41\u7a0b\u4e2d\u518d\u89e3\u91ca":156,"\u6211\u4eec\u5b9e\u73b0\u7684":145,"\u6211\u4eec\u5bf9":143,"\u6211\u4eec\u5bf9\u5176\u4e5f\u5b9e\u73b0\u4e86\u548c":164,"\u6211\u4eec\u5c06":145,"\u6211\u4eec\u5f3a\u5236\u8981\u6c42\u6240\u6709\u7b7e\u5165":168,"\u6211\u4eec\u6240\u8bad\u7ec3\u7684\u667a\u80fd\u4f53\u5c31\u662f\u5728\u8fd9\u6837\u7684\u73af\u5883\u4e2d\u53bb\u8fdb\u884c\u63a2\u7d22\u548c\u5b66\u4e60":148,"\u6211\u4eec\u6bcf\u6b21\u884c\u52a8\u5c31\u53ea\u9700\u8981\u91c7\u53d6\u6536\u76ca\u8f83\u5927\u7684\u884c\u52a8\u6216\u8005\u91c7\u53d6\u80fd\u591f\u5230\u8fbe\u6536\u76ca\u8f83\u5927\u72b6\u6001\u7684\u884c\u52a8":196,"\u6211\u4eec\u6d4b\u91cf\u4e86\u4e09\u79cd":145,"\u6211\u4eec\u76f4\u63a5\u4f7f\u7528":196,"\u6211\u4eec\u79f0\u667a\u80fd\u4f53\u7684\u5b66\u4e60\u8fc7\u7a0b\u4e3afulli":196,"\u6211\u4eec\u7ed3\u5408":145,"\u6211\u4eec\u8bbe\u5b9a":143,"\u6211\u4eec\u8bbe\u5b9a\u4e00\u4e2a":143,"\u6211\u4eec\u8bbe\u5b9a\u4e00\u6b21\u5b9e\u9a8c\u4e2d\u4f1a\u6a21\u62df":143,"\u6211\u4eec\u8fd8\u6dfb\u52a0\u4e86":143,"\u6211\u4eec\u8fd8\u89c2\u5bdf\u4e86\u5728":145,"\u6211\u4eec\u8fd8\u8bbe\u5b9a\u4e86\u4e09\u4e2a":145,"\u6211\u4eec\u8fed\u4ee3\u8ba1\u7b97\u7684\u662f\u503c\u51fd\u6570":196,"\u6211\u4eec\u901a\u5e38\u4f7f\u7528\u54ea\u4e9b\u65b9\u6cd5\u5e73\u8861explor":196,"\u6211\u4eec\u901a\u5e38\u4f7f\u7528batch\u4e3a\u5355\u4f4d\u5c06fix":196,"\u6211\u4eec\u901a\u5e38\u5982\u4f55\u5b9e\u73b0offlin":196,"\u6211\u4eec\u901a\u8fc7\u8fed\u4ee3\u66f4\u65b0\u503c\u51fd\u6570\u7684\u8868\u683c\u5373\u53ef\u5b8c\u6210\u5bf9\u503c\u51fd\u6570\u7684\u4f30\u8ba1":196,"\u6211\u4eec\u9700\u8981\u5229\u7528\u51fd\u6570\u903c\u8fd1\u7684\u65b9\u6cd5\u5bf9\u503c\u51fd\u6570\u8fdb\u884c\u8868\u793a":196,"\u6216":[146,158],"\u6216\u5143\u6570\u636e":156,"\u6216\u5b50\u8fdb\u7a0b\u5361\u6b7b\u65f6\u7a0b\u5e8f\u4e0d\u4f1a\u6b63\u5e38\u9000\u51fa":146,"\u6216\u5e76\u884c\u5730":146,"\u6216\u662f\u6253\u7b97\u4fee\u6539\u73b0\u6709\u4ee3\u7801":168,"\u6216\u662f\u6570\u636e\u6d41\u538b\u529b\u589e\u5927\u65f6":145,"\u6216\u67d0\u4e00\u6761":168,"\u6216\u8005":[158,164],"\u6216\u8005\u4e5f\u53ef\u4ee5\u5728\u539frepo\u4e0b\u521b\u5efa\u4e00\u4e2a\u81ea\u5df1\u7684\u5f00\u53d1\u5206\u652f":168,"\u6216\u8005\u662f\u8ba1\u7b97\u51fd\u6570\u76f8\u5173\u7684\u4e00\u4e9b\u72b6\u6001":164,"\u6216\u8005\u7531":146,"\u6216\u8005\u901a\u8fc7":153,"\u6216\u8fd8\u6ca1\u6709\u51c6\u5907\u597d\u53d1\u5e03\u5230\u5c0f\u7ec4\u5185":168,"\u6216\u901a\u8fc7":153,"\u6216math":158,"\u6240\u4ee5\u53ea\u6709\u5f53\u4e0a\u4e00\u4e2a":145,"\u6240\u4ee5\u53ef\u8ba4\u4e3a\u662f\u4e0e\u73af\u5883\u603b\u5171\u4ea4\u4e92":143,"\u6240\u4ee5\u5bf9\u4e8e\u540c\u4e00\u73af\u5883":145,"\u6240\u4ee5\u5e73\u8861exploitation\u548cexploration\u7684\u76ee\u7684\u5c31\u662f\u83b7\u5f97\u4e00\u79cd\u957f\u671f\u6536\u76ca\u6700\u9ad8\u7684\u7b56\u7565":196,"\u6240\u4ee5\u6211\u4eec\u53c8\u505a\u4e86\u4e00\u7ec4\u5b9e\u9a8c":143,"\u6240\u4ee5\u6211\u4eec\u73b0\u5728\u4f1a\u5355\u72ec\u63d0\u4f9b\u5bf9\u5e94\u7248\u672c\u4e0b":150,"\u6240\u4ee5dataloader\u662f\u5e76\u884cpipeline\u7279\u6709\u7684":156,"\u6240\u4f7f\u7528\u7684":164,"\u6240\u51fa\u54c1\u7684":148,"\u6240\u5360\u6574\u4f53\u65f6\u95f4\u7684\u6bd4\u4f8b":145,"\u6240\u6307\u5b9a\u7684\u5b50\u73af\u5883\u6309\u7167":146,"\u6240\u6307\u5b9a\u7684\u5b50\u73af\u5883\u8fdb\u7a0b\u6309\u7167":146,"\u6240\u6709\u4ee3\u7801\u5b9e\u73b0\u4e2d\u547d\u540d\u5efa\u8bae\u4e00\u822c\u60c5\u51b5\u4f7f\u7528\u5355\u6570":148,"\u6240\u6709\u4ee3\u7801\u5b9e\u73b0\u79c9\u627f":148,"\u6240\u6709\u5728\u8fd0\u884c\u72b6\u6001\u7684\u73af\u5883":146,"\u6240\u6709\u5b50\u73af\u5883":146,"\u6240\u6709\u5bf9":148,"\u6240\u6709\u65b0\u4ee3\u7801\u4ed3\u5e93":168,"\u6240\u6709\u672a\u8fd0\u884c\u7ed3\u675f\u7684\u73af\u5883":146,"\u6240\u6709\u73af\u5883":146,"\u6240\u8c13\u7b56\u7565":196,"\u6240\u8c13valu":196,"\u6240\u9700\u7684\u65f6\u95f4":143,"\u6240\u9700\u8981\u7684\u53c2\u6570":164,"\u624b\u52a8\u8fdb\u884cmerg":168,"\u624d\u53ef\u4ee5\u5c06\u4e0b\u4e00\u4e2a":145,"\u624d\u80fd\u7ee7\u7eed\u4f7f\u7528":146,"\u6253\u4e0a":168,"\u6253\u5370\u65e5\u5fd7":164,"\u6253\u5370log\u7b49":156,"\u6267\u884c":145,"\u6267\u884c\u540e\u8fd4\u56de\u7ed3\u679c":156,"\u6267\u884cpip\u5b89\u88c5\u547d\u4ee4":139,"\u6269\u5c55\u6027\u548c\u6613\u7528\u6027":142,"\u6279\u91cf\u5904\u7406":168,"\u627e\u5230\u6700\u5927\u503c\u6240\u5728\u7684\u7684":164,"\u629b\u51fa\u7684\u7f51\u7edc\u8bf7\u6c42\u5f02\u5e38\u5728interaction\u6846\u67b6\u4e2d":153,"\u62ff\u5230\u6570\u636e\u540e\u8c03\u7528":156,"\u6301\u6709\u7684\u67d0\u51e0\u4e2a\u73af\u5883\u8bbe\u7f6e\u7279\u5b9a\u7684":146,"\u6307\u5411\u8be5\u7c7b\u7684\u552f\u4e00\u5b9e\u4f8b":148,"\u6307\u5b9a\u5176\u8fd0\u884c\u53c2\u6570":146,"\u6307\u5c06\u6570\u636e\u4ece\u6587\u4ef6\u4e2d\u8bfb\u53d6\u5230\u5185\u5b58\u7684\u65f6\u95f4":145,"\u6307\u6570\u636e\u9884\u5904\u7406\u65f6\u95f4":145,"\u6309\u7167\u4e0a\u6587\u7684\u8981\u6c42\u4f7f\u7528":148,"\u6309\u7167critic\u90e8\u5206\u5f97\u5230\u7684\u4ef7\u503c":196,"\u6362\u884c":168,"\u6362\u884c\u7b26":168,"\u63a5\u53e3":148,"\u63a5\u53e3\u65b9\u6cd5":156,"\u63a5\u8fd1":145,"\u63a5\u8fd10":196,"\u63a5\u8fd1\u4e8e1\u65f6\u8868\u660e\u66f4\u8003\u8651\u8fdc\u671f\u7684\u5229\u76ca":196,"\u63a7\u5236":164,"\u63a8\u65ad\u8fc7\u7a0b":145,"\u63a8\u8350\u5728":148,"\u63a8\u8350\u5f15\u5165\u81ea\u52a8\u6d4b\u8bd5\u548c\u6301\u7eed\u96c6\u6210":168,"\u63a8\u8350\u8bbe\u7f6e\u4e3atrue":146,"\u63a8\u9001\u81f3\u539f\u59cb\u4ed3\u5e93":168,"\u63a8\u9001\u8fdb\u81ea\u5df1\u7684":168,"\u63cf\u8ff0\u4f60\u51c6\u5907\u52a0\u5165\u7684\u529f\u80fd\u548c\u5177\u4f53\u7684":168,"\u63d0\u4ea4\u81f3":168,"\u63d0\u4f9b\u4e86":164,"\u63d0\u4f9b\u4e86\u53c2\u6570freq\u6765\u63a7\u5236hook\u88ab\u6267\u884c\u7684\u9891\u7387":[164,165],"\u63d0\u4f9b\u4e86\u66f4\u4e3a\u7b80\u5355\u7684\u8c03\u7528\u65b9\u6cd5":164,"\u63d0\u4f9b\u4e86\u73af\u5883\u72b6\u6001\u7684\u679a\u4e3e\u7c7b\u578b\u6765\u5b9e\u65f6\u638c\u63e1\u6240\u6709\u5b50\u73af\u5883\u7684\u8fd0\u884c\u72b6\u6001":146,"\u63d0\u4f9b\u7684\u9ed8\u8ba4\u5b9a\u4e49":148,"\u63d0\u4f9b\u7b80\u5355\u7684reset\u65b9\u6cd5":164,"\u641c\u7d22\u65b9\u9762\u6709\u4e30\u5bcc\u7684\u5e94\u7528\u573a\u666f":196,"\u642c\u8fd0\u81f3":145,"\u652f\u6301\u4e00\u5c42\u4e00\u5c42\u7684\u590d\u7528":164,"\u652f\u6301\u4ee5\u7ee7\u627f\u7b49\u5f62\u5f0f\u7684\u6269\u5c55":142,"\u652f\u6301\u5c06\u8bad\u7ec3\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5206\u5272\u4e3a\u591a\u4e2a\u5b50\u4efb\u52a1\u4ea4\u7531":145,"\u6536\u96c6\u4e00\u5b9a\u91cf\u6570\u636e\u6240\u9700\u7684\u65f6\u95f4":143,"\u653e\u5165\u8fd9\u4e00\u6570\u636e\u8bf7\u6c42":156,"\u6545":156,"\u6545\u4e32\u884cpipeline\u53ef\u4ee5\u5b9e\u4f8b\u5316bas":156,"\u6545\u4e5f\u653e\u5728\u6b64\u5904\u5217\u51fa":143,"\u6545\u4f5c\u4e3a\u4e00\u4e2a\u72ec\u7acb\u6a21\u5757\u5b58\u5728":158,"\u6545\u53ef\u4ee5\u652f\u6301\u91cd\u7528":158,"\u6545\u5728\u8fd9\u4e00\u90e8\u5206\u4ee5\u6211\u4eec\u5b9e\u73b0\u7684":156,"\u6545\u6b64\u5904\u8bbe\u8ba1\u4e3a\u975e\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1\u6a21\u5f0f":153,"\u6545\u6b64\u65f6\u7684\u4efb\u52a1\u5e94\u5f53\u4e3a":156,"\u6545learner":156,"\u6559\u7a0b":168,"\u6570\u636e":[145,156],"\u6570\u636e\u52a0\u8f7d\u6d41\u7a0b":145,"\u6570\u636e\u5728\u6709\u6548\u65f6\u95f4\u7a97\u53e3\u5185\u7684\u81ea\u52a8\u8bb0\u5f55\u4e0e\u5206\u6790":142,"\u6570\u636e\u5904\u7406":145,"\u6570\u636e\u63a8\u65ad":145,"\u6570\u636e\u6536\u96c6":150,"\u6570\u636e\u6d41\u538b\u529b\u589e\u5927":145,"\u6570\u91cf\u8fbe\u5230":146,"\u6574\u4e2a\u6587\u4ef6\u5939\u5185\u7684\u6362\u884c":168,"\u6574\u5408\u81ea\u5df1\u7684\u672c\u5730":168,"\u6574\u5408\u8fdb\u7c7b\u5185\u90e8":153,"\u6574\u578b":142,"\u6587\u4ef6":[150,168],"\u6587\u4ef6\u53ef\u4f9b\u5b89\u88c5":150,"\u6587\u4ef6\u5939":168,"\u6587\u4ef6\u5939\u79fb\u52a8\u51fa\u53bb":139,"\u65b0\u589e\u4e86":148,"\u65b9\u4fbf\u5730\u5bf9":164,"\u65b9\u5dee\u8f83\u5927":196,"\u65b9\u6cd5":[146,148,153,156,164],"\u65b9\u6cd5\u4e00\u6837":146,"\u65b9\u6cd5\u4e2d":148,"\u65b9\u6cd5\u4e2d\u5b8c\u6210\u8be5\u529f\u80fd":148,"\u65b9\u6cd5\u4e2d\u5b9e\u73b0":148,"\u65b9\u6cd5\u4e4b\u524d":148,"\u65b9\u6cd5\u4e4b\u540e":148,"\u65b9\u6cd5\u4e4b\u540e\u4fbf\u53ef\u901a\u8fc7\u8c03\u7528":146,"\u65b9\u6cd5\u4ee5\u4fbf\u67e5\u770b\u5404\u4e2a\u4f4d\u7f6e\u7684":164,"\u65b9\u6cd5\u4ee5\u542f\u52a8comm":156,"\u65b9\u6cd5\u4ee5\u83b7\u53d6\u65f6\u95f4\u5bf9\u8c61\u5185\u7684\u65f6\u95f4":142,"\u65b9\u6cd5\u4f1a\u4e32\u884c\u5730":146,"\u65b9\u6cd5\u4f1a\u5f15\u53d1\u5f02\u5e38":146,"\u65b9\u6cd5\u4f20\u5165\u53c2\u6570\u7684":146,"\u65b9\u6cd5\u4f9d\u636e\u8f93\u5165\u7684":148,"\u65b9\u6cd5\u5219\u662f\u5bf9\u73af\u5883\u8fdb\u884c\u91cd\u7f6e":148,"\u65b9\u6cd5\u5373\u53ef\u7528\u4e8eloggedmodel":142,"\u65b9\u6cd5\u5373\u53ef\u770b\u5230\u6240\u6709\u5f53\u524dmodel\u6240\u6dfb\u52a0\u7684wrapper\u5d4c\u5957\u60c5\u51b5":164,"\u65b9\u6cd5\u53ea\u9700\u8981\u8bb0\u5f55\u4e0b\u8fd9\u4e2a\u503c":148,"\u65b9\u6cd5\u53ef\u4f5c\u4e3a\u4e00\u4e2a\u7ebf\u7a0b\u542f\u52a8":156,"\u65b9\u6cd5\u6267\u884c\u65f6\u8bbe\u7f6e\u968f\u673a\u79cd\u5b50\u5373\u53ef":148,"\u65b9\u6cd5\u662f\u4ece\u5916\u754c\u4f20\u5165\u8bad\u7ec3\u6570\u636e":156,"\u65b9\u6cd5\u6765\u624b\u52a8":146,"\u65b9\u6cd5\u6765\u6267\u884c\u4efb\u52a1":153,"\u65b9\u6cd5\u68c0\u67e5\u662f\u5426\u5408\u6cd5":148,"\u65b9\u6cd5\u7684\u53c2\u6570":146,"\u65b9\u6cd5\u7684\u5b50\u73af\u5883\u7684":146,"\u65b9\u6cd5\u7684\u7b49\u5f85\u65f6\u95f4":146,"\u65b9\u6cd5\u7684\u8c03\u7528\u4e00\u822c\u5728":148,"\u65b9\u6cd5\u7684\u8f93\u5165\u662f\u4e00\u4e2a":164,"\u65b9\u6cd5\u7684\u8fd0\u884c\u65f6":146,"\u65b9\u6cd5\u88ab\u7528\u4e8e\u89e3\u51b3\u667a\u80fd\u4f53\u4e0e\u73af\u5883\u7684\u4ea4\u4e92\u95ee\u9898":196,"\u65b9\u9762\u7684\u64cd\u4f5c":164,"\u65e0":[148,156],"\u65e0\u8bba\u662f\u54ea\u4e00\u79cd\u65b9\u6cd5":196,"\u65e2\u53ef\u4ee5\u53bb\u9002\u5e94\u4e0d\u540c\u7684\u52a8\u4f5c\u7a7a\u95f4\u4e0e\u72b6\u6001\u7a7a\u95f4\u7684\u95ee\u9898":196,"\u65e5\u5fd7\u6a21\u578b\u7cfb\u7edf\u662fautolog\u7684\u6838\u5fc3":142,"\u65f6":[145,146,168,196],"\u65f6\u4e3a\u8be5\u5b50\u73af\u5883\u8bbe\u7f6e\u7684\u53c2\u6570":146,"\u65f6\u4e5f\u5fc5\u987b\u8c03\u7528":148,"\u65f6\u4f1a\u5f15\u53d1\u5f02\u5e38":146,"\u65f6\u542f\u52a8\u73af\u5883\u8bbe\u5b9a\u79cd\u5b50":148,"\u65f6\u5e8f\u5dee\u5206\u5b66\u4e60":196,"\u65f6\u7684\u53c2\u6570\u4e3a\u4e0a\u6b21\u624b\u52a8":146,"\u65f6\u95f4":145,"\u65f6\u95f4\u7cfb\u7edf\u662fautolog\u7cfb\u7edf\u7684\u5173\u952e\u8981\u7d20":142,"\u65f6\u9690\u72b6\u6001\u7684\u884c\u4e3a":164,"\u660e\u786e\u89c4\u5b9a\u5176\u683c\u5f0f":148,"\u661f\u9645\u4e89\u9738":196,"\u661f\u9645\u89c4\u6a21":145,"\u6620\u5c04\u7ed3\u679c\u662f\u4e0d\u786e\u5b9a\u7684":150,"\u662f":[143,145,168],"\u662f\u4e00\u4e2a":148,"\u662f\u4e00\u4e2a\u73af\u5883\u7ba1\u7406\u5668":146,"\u662f\u4e00\u7c7b\u4f18\u5316\u65b9\u6cd5":196,"\u662f\u4e24\u8005\u7684\u7ed3\u5408":196,"\u662f\u4e32\u884c\u6a21\u5f0f\u4e0e\u5e76\u884c\u6a21\u5f0f\u4e2d\u8fdb\u884c\u8bad\u7ec3\u7684\u6838\u5fc3":156,"\u662f\u53ef\u9009\u952e\u503c":148,"\u662f\u5426\u5728\u8f6c\u4e3afloat\u540e\u5728\u533a\u95f4":158,"\u662f\u5426\u6240\u6709\u6301\u6709\u7684\u73af\u5883\u5df2\u7ecf\u8fd0\u884c\u7ed3\u675f":146,"\u662f\u5426\u8fd0\u884c\u81f3":146,"\u662f\u5728\u539f\u59cb\u65b9\u6cd5\u7684\u57fa\u7840\u4e0a":164,"\u662f\u57fa\u4e8e\u4e24\u4e2aloader":158,"\u662f\u5bf9\u539f\u59cb\u51fd\u6570\u7684\u5c01\u88c5":164,"\u662f\u5bf9\u73af\u5883\u7684\u90e8\u5206\u6027\u63cf\u8ff0":196,"\u662f\u5bf9\u73af\u5883\u7684global\u6027\u63cf\u8ff0":196,"\u662f\u5bf9\u73af\u5883\u7c7b\u7684\u4e00\u4e2a\u5305\u88c5":164,"\u662f\u5f02\u6b65\u52a0\u8f7d\u6570\u636e\u7684":145,"\u662f\u5f3a\u5316\u5b66\u4e60\u4e2d\u91cd\u8981\u7684\u6a21\u5757\u4e4b\u4e00":148,"\u662f\u5f3a\u5316\u5b66\u4e60\u5728\u6570\u5b66\u4e0a\u7684\u7406\u60f3\u5316\u5f62\u5f0f":196,"\u662f\u6307\u662f\u7b56\u7565":196,"\u662f\u6307\u667a\u80fd\u4f53\u91c7\u7528\u7b56\u7565":196,"\u662f\u6307\u72b6\u6001\u5230\u52a8\u4f5c\u7684\u6620\u5c04":196,"\u662f\u667a\u80fd\u4f53\u6240\u5904\u7684\u73af\u5883\u7ed9\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u4e00\u4e2a\u5b66\u4e60\u4fe1\u53f7":196,"\u662f\u6709\u9650\u72b6\u6001\u96c6\u5408":196,"\u662f\u72b6\u6001\u7ef4\u5ea6":143,"\u662f\u72b6\u6001\u8f6c\u79fb\u6982\u7387":196,"\u662f\u73af\u5883":143,"\u662f\u89e3\u51b3\u5b9e\u9645\u95ee\u9898\u65f6\u6700\u5e38\u8003\u8651\u7684\u6846\u67b6":196,"\u662f\u975e\u5e38\u65b9\u4fbf\u4e14\u6709\u6548\u7684\u5de5\u5177":164,"\u662f\u9a6c\u5c14\u79d1\u592b\u7684":196,"\u662fmaster\u7aef\u548cslave\u7aef":153,"\u667a\u80fd\u4f53\u4ece\u73af\u5883\u4e2d\u63a5\u6536\u89c2\u5bdf\u5230\u7684\u4fe1\u606f":196,"\u667a\u80fd\u4f53\u7684\u76ee\u6807\u662f\u6700\u5927\u5316\u79ef\u7d2f\u81ea\u5df1\u63a5\u6536\u5230\u7684\u5956\u52b1":196,"\u66f4\u52a0\u6666\u6da9\u96be\u61c2":156,"\u66f4\u591a\u7684actor":196,"\u66f4\u591a\u7684polici":196,"\u66f4\u65b0\u65f6\u57fa\u4e8e\u5f53\u524d\u5df2\u5b58\u5728\u7684\u4f30\u8ba1":196,"\u66f4\u65b0\u7684\u76ee\u6807\u662f":196,"\u6700\u4e3a\u5173\u952e\u7684\u90e8\u5206\u5728\u4e8e":148,"\u6700\u4f73\u5b9e\u8df5\u4e3a\u9884\u5148\u5f00\u542f\u5168\u90e8\u7684\u670d\u52a1\u8282\u70b9":153,"\u6700\u540e\u518d\u5728\u539f\u4ed3\u5e93\u4e0a\u63d0":168,"\u6700\u540e\u6211\u4eec\u8fd8\u89e3\u7b54\u4e86\u4e00\u4e9b\u5f3a\u5316\u5b66\u4e60\u9886\u57df\u4e2d\u5e38\u89c1\u7684\u6982\u5ff5\u6027\u95ee\u9898":196,"\u6700\u57fa\u7840\u7684wrapper":164,"\u6700\u7ec8\u7684\u4f18\u5316\u76ee\u6807\u90fd\u662freturn\u7684\u6700\u5927\u5316":196,"\u6709\u4e24\u79cd\u65b9\u5f0f":153,"\u6709\u8f83\u660e\u663e\u7684\u6548\u7387\u4f18\u52bf":145,"\u672a\u8fd0\u884c\u81f3":146,"\u672c\u5730\u4ee3\u7801\u4ed3\u5e93\u5f00\u53d1":168,"\u672c\u7c7b\u56fe\u5e76\u4e0d\u5b8c\u6574":156,"\u672c\u8fdb\u7a0b\u4ec5\u8d1f\u8d23\u5c06\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5207\u5206\u6210":145,"\u673a\u5668\u4eba\u63a7\u5236\u7b49\u63a7\u5236\u7cfb\u7edf\u4e2d":196,"\u6765\u4ecb\u7ecd\u5e76\u884c\u6a21\u5f0f\u4e2d\u4ece\u5e76\u884cpipeline\u5165\u53e3\u90e8\u7f72coordin":156,"\u6765\u5b8c\u6210":168,"\u6765\u5b9e\u73b0":148,"\u6765\u5b9e\u73b0\u65b9\u4fbf\u6613\u7528\u7684\u7edf\u8ba1\u529f\u80fd":142,"\u6765\u5bf9":146,"\u6765\u5f97\u5230\u65b0\u7684\u7ecf\u8fc7\u5305\u88c5\u7684\u73af\u5883":164,"\u6765\u63cf\u8ff0\u5177\u4f53\u8981\u505a\u7684\u5de5\u4f5c\u6216\u8ddf\u540c\u4e8b\u8ba8\u8bba\u76f8\u5173\u89e3\u51b3\u65b9\u6848":168,"\u6765\u63d0\u4ea4\u6539\u52a8":168,"\u6765\u6e90\u4e8e\u63a5\u53e3\u7684\u7236\u7c7b":148,"\u6765\u786e\u4fdd":168,"\u6765\u7ef4\u62a4\u591a\u4e2a\u73af\u5883\u5b9e\u4f8b":146,"\u6765\u8868\u793a":196,"\u6765\u8bf4":146,"\u6765\u8bf4\u5219\u662f\u8fd0\u884c\u6bcf\u4e2a\u73af\u5883\u7684\u5b50\u8fdb\u7a0b":146,"\u6784\u5efa\u4e00\u4e2a\u5927\u5c0f\u5199\u4e0d\u654f\u611f\u7684\u679a\u4e3eloader":158,"\u6784\u5efa\u4e00\u4e2a\u679a\u4e3eloader":158,"\u6784\u5efa\u4e00\u4e2a\u7c7b\u578b\u8f6c\u6362loader":158,"\u6784\u5efa\u4e00\u4e2a\u7c7b\u578b\u9a8c\u8bc1loader":158,"\u6784\u5efadict\u683c\u5f0f\u6570\u636e":158,"\u6784\u9020\u4e00\u4e9b\u73af\u5883\u8fd0\u884c\u65f6\u7684\u72b6\u6001\u53d8\u91cf\u7b49":146,"\u6784\u9020\u6bcf\u4e2a":146,"\u67e5\u770b":164,"\u67e5\u770bforward\u65b9\u6cd5\u5728model\u4e2d\u7684\u8c03\u7528\u60c5\u51b5":[164,165],"\u67e5\u770bwrapper\u5d4c\u5957\u60c5\u51b5":164,"\u6837\u4f8b":146,"\u6839\u636e\u4f20\u5165\u7684\u521d\u59cb\u914d\u7f6e\u4e3a\u6bcf\u4e2a\u5177\u4f53\u7684\u73af\u5883\u751f\u6210\u76f8\u5e94\u7684\u914d\u7f6e\u6587\u4ef6":148,"\u6839\u636e\u4f20\u5165\u7684hook\u4f4d\u7f6e\u540d":156,"\u6839\u636e\u53c2\u6570\u7ed9\u5b9a\u7684freq\u6bcf\u9694\u4e00\u5b9a\u6570\u91cf\u4e2aiter\u4e4b\u540e\u4fdd\u5b58\u6a21\u578b":164,"\u6839\u636e\u53c2\u6570\u7ed9\u5b9a\u7684freq\u6bcf\u9694\u4e00\u5b9a\u6570\u91cf\u4e2aiter\u4e4b\u540e\u6253\u5370\u65e5\u5fd7":164,"\u6839\u636e\u63a5\u6536\u5230\u7684\u4fe1\u606f\u9009\u62e9\u52a8\u4f5c":196,"\u6839\u636e\u6982\u7387\u91c7\u6837\u52a8\u4f5c":164,"\u6839\u636e\u8fd9\u4e9b\u7ed3\u679c\u4fee\u6539\u5b50\u73af\u5883\u7684\u8fd0\u884c\u72b6\u6001":146,"\u6839\u636e\u9884\u5148\u8bbe\u5b9a\u7684\u6700\u5927\u8fed\u4ee3\u6570\u53caevaluate\u6536\u655b\u60c5\u51b5":156,"\u683c\u5f0f\u7684":146,"\u68c0\u67e5\u4e00\u4e2a\u73af\u5883\u5143\u7d20\u7c7b\u662f\u5426\u5b9e\u73b0\u4e86\u5fc5\u9700\u5c5e\u6027":148,"\u68c0\u67e5\u5408\u6cd5\u6027\u65b9\u6cd5":148,"\u68c0\u67e5\u5e76\u63d0\u53d6":158,"\u68c0\u6d4b\u673a\u5236":146,"\u6982\u8ff0":[142,145,146,148,156,164],"\u6a21\u5757\u4e3a\u6bcf\u4e2a\u73af\u5883\u521b\u5efa\u5355\u72ec\u7684\u8fdb\u7a0b":146,"\u6a21\u5757\u5df2\u7ecf\u5e2e\u6211\u4eec\u5b9a\u4e49\u4e86\u7edd\u5927\u591a\u6570\u5e38\u7528\u7684\u5b66\u672f\u73af\u5883":148,"\u6a21\u5757\u8fd8\u4e0d\u591f\u4e86\u89e3":146,"\u6a21\u578b\u5229\u7528\u6570\u636e":145,"\u6a21\u578b\u6536\u655b\u901f\u5ea6\u592a\u6162":196,"\u6a21\u5f0f\u5207\u6362\u4ee5\u53ca\u4e0d\u540c":164,"\u6a21\u62df\u771f\u5b9e\u573a\u666f":143,"\u6b21":143,"\u6b21\u5b9e\u9a8c\u53d6\u5e73\u5747":143,"\u6b21\u6570":146,"\u6b63\u5728\u7b49\u5f85\u65b0\u547d\u4ee4\u7684\u5b50\u73af\u5883":146,"\u6b63\u5728\u8fd0\u884c\u4e2d\u7684\u5b50\u73af\u5883":146,"\u6b63\u5728\u8fdb\u884c":146,"\u6b63\u662f\u901a\u8fc7\u5728learn":196,"\u6b63\u786e\u5173\u95ed\u5404\u9879\u8d44\u6e90":156,"\u6b63\u786e\u8fd0\u884c":168,"\u6b64\u4e3e\u53ef\u4ee5\u52a0\u5feb":146,"\u6b64\u5904":153,"\u6b64\u5916":[142,143,148,153,156],"\u6b64\u5916\u8fd8\u4f20\u6765\u5efa\u7acblearner\u5fc5\u987b\u7684\u4fe1\u606f":156,"\u6b64\u65f6":[146,196],"\u6b64\u65f6\u6700\u4f18\u7b56\u7565\u662f\u8d2a\u5a6a\u7b56\u7565":196,"\u6b64\u65f6\u7684\u53c2\u6570\u6240\u5bf9\u5e94\u7684\u7b56\u7565\u4e3a\u6700\u4f18\u7b56\u7565":196,"\u6b64\u65f6\u8ba8\u8bba\u5355\u6b65td\u5373td":196,"\u6b64\u65f6dataloader\u53c8\u4f1a\u8c03\u7528":156,"\u6b65\u8fdb\u65f6\u95f4":142,"\u6bcf\u4e2a":145,"\u6bcf\u4e2a\u8fed\u4ee3\u4e2d\u81ea\u884c\u53d1\u9001\u83b7\u53d6\u6570\u636e\u7684\u8bf7\u6c42":156,"\u6bcf\u6b21":[143,164],"\u6bcf\u969420\u4e2aiter\u4f1a\u5b58\u4e00\u6b21ckpt":164,"\u6bd4\u5982\u5c06\u76f8\u5173\u6570\u636e\u79fb\u9664":148,"\u6bd4\u5982\u7b97\u6cd5\u66f4\u65b0\u4f7f\u7528":168,"\u6bd4\u5982\u7ef4\u62a4\u4e00\u4e9b\u72b6\u6001\u8bb0\u5f55\u53d8\u91cf":148,"\u6bd4\u5982\u81ea\u5df1\u9020\u8f6e\u5b50":168,"\u6bd4\u5982\u83b7\u53d6\u73af\u5883observation\u7684\u7ef4\u5ea6\u7b49\u4fe1\u606f":148,"\u6bd4\u5982behavior":196,"\u6bd4\u8f83\u63a8\u8350\u7684\u4e00\u79cd\u65b9\u5f0f":153,"\u6ca1\u9519":158,"\u6cbf\u7740\u68af\u5ea6\u65b9\u6cd5":196,"\u6ce8":145,"\u6ce8\u518c":164,"\u6ce8\u518c\u4e86\u4e00\u4e2a\u7528\u4e8e\u8fdb\u884c\u5e73\u5747\u503c\u8ba1\u7b97\u7684\u51fd\u6570":142,"\u6ce8\u518c\u65b0\u7684hook":156,"\u6ce8\u518c\u7684\u65f6\u5019\u9700\u8981\u63d0\u4f9b\u540d\u79f0":164,"\u6ce8\u610f":[148,158],"\u6ce8\u610f\u4e0d\u8981\u76f4\u63a5\u4f7f\u7528httperror\u8fdb\u884c\u5f02\u5e38\u7684\u6355\u6349":153,"\u6ce8\u610f\u521d\u59cb\u5316\u5b8c\u6210\u540e\u4f1a\u8c03\u7528":148,"\u6ce8\u610f\u7f16\u5199\u5408\u9002\u7684":168,"\u6d4b\u8bd5\u5176\u5728\u4e0d\u540c\u89c4\u6a21\u7684\u73af\u5883\u4e0e\u4e0d\u540c\u7c7b\u578b\u7684\u73af\u5883\u7ba1\u7406\u5668\u4e0b":143,"\u6d4b\u8bd5\u6a21\u5757\u4e2d\u5747\u53ef\u4f7f\u7528":150,"\u6d4b\u901f\u7ed3\u679c\u5982\u4e0b\u8868\u6240\u793a":143,"\u6dfb\u52a0\u4e86":146,"\u6dfb\u52a0\u8fd9\u4e2a\u529f\u80fd\u7684\u539f\u56e0\u548c\u6253\u7b97\u4f7f\u7528\u7684\u5b9e\u73b0\u65b9\u5f0f":168,"\u6e10\u8fdb\u6027\u6536\u655b":196,"\u7075\u6d3b\u7684\u6570\u636e\u7ec4\u5408\u6846\u67b6\u7ec4\u4ef6":158,"\u7136\u540e\u540c\u6837\u901a\u8fc7":168,"\u7136\u540e\u5c06\u9ed8\u8ba4\u73af\u5883\u914d\u7f6e\u590d\u5236\u76f8\u5e94\u4efd\u6570\u8fd4\u56de":148,"\u7136\u540e\u6211\u4eec\u5f00\u59cb\u4ecb\u7ecd\u5e76\u884c\u6a21\u5f0f\u4e0b\u7684flaskfilesystemlearner\u8fd9\u4e00comm":156,"\u7136\u540e\u662f\u5728\u6574\u4f53\u6d41\u7a0b\u4e2d":145,"\u7136\u540e\u6839\u636e\u503c\u51fd\u6570\u5bf9\u7b56\u7565\u8fdb\u884c\u6539\u8fdb":196,"\u7136\u540e\u8bd5\u56fe\u4ece":156,"\u7136\u540e\u8fdb\u5165\u6d41\u7a0b5":145,"\u7136\u540e\u91cd\u590d\u6267\u884c\u83b7\u53d6\u6570\u636e":156,"\u7136\u540emymaster\u591a\u91cd\u7ee7\u627fmaster\u548c\u65b0\u7684\u529f\u80fd\u7c7b":153,"\u7136\u800c\u4e0e\u73af\u5883\u4ea4\u4e92\u540e\u4ea7\u751f\u7684\u6570\u636e\u4e0d\u80fd\u76f4\u63a5\u7528\u4e8e\u8bad\u7ec3":196,"\u7136\u800c\u5b9e\u9645\u5f00\u53d1\u4e2d\u63a2\u7d22\u51fa\u4e86\u5176\u66f4\u591a\u7684\u7528\u6cd5\u4ee5\u53ca\u66f4\u5927\u7684\u529f\u80fd\u6f5c\u529b":158,"\u72b6\u6001":[146,196],"\u72b6\u6001\u4ef7\u503c\u51fd\u6570":196,"\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u548c\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u7684\u5173\u7cfb":196,"\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u662f\u8bc4\u4ef7\u7b56\u7565\u51fd\u6570\u4f18\u52a3\u7684\u6807\u51c6\u4e4b\u4e00":196,"\u72b6\u6001\u7684":146,"\u738b\u8005\u8363\u8000\u7b49":196,"\u73af\u5883\u4e00\u4e2a":148,"\u73af\u5883\u4e2d\u4e5f\u4fdd\u6301\u4e86\u8f83\u9ad8\u7684\u6027\u80fd":143,"\u73af\u5883\u4e2d\u4f18\u52bf\u66f4\u52a0\u660e\u663e":143,"\u73af\u5883\u4f1a\u56e0\u4e3a\u667a\u80fd\u4f53\u91c7\u53d6\u7684\u52a8\u4f5c\u53d1\u751f\u6539\u53d8":196,"\u73af\u5883\u5143\u7d20\u4fe1\u606f\u6a21\u677f":148,"\u73af\u5883\u5143\u7d20\u57fa\u7c7b":148,"\u73af\u5883\u5143\u7d20\u7684\u952e\u503c\u5982\u679c\u4e3a\u7a7a\u65f6":148,"\u73af\u5883\u5143\u7d20\u8fd0\u884c\u65f6\u57fa\u7c7b":148,"\u73af\u5883\u5143\u7d20\u90e8\u5206\u7b80\u6613\u7684\u7c7b\u903b\u8f91\u56fe\u5982\u4e0b":148,"\u73af\u5883\u6267\u884c\u8f93\u5165\u7684\u52a8\u4f5c":146,"\u73af\u5883\u6a21\u5757":148,"\u73af\u5883\u6bcf\u4e2a\u65f6\u95f4\u6b65\u90fd\u53ef\u5305\u542b\u8be5\u952e\u503c":148,"\u73af\u5883\u76f8\u5e94\u53c2\u6570\u5982\u4e0b\u8868":145,"\u73af\u5883\u7ba1\u7406\u5668\u7528\u4f5c":143,"\u73b0\u5728":156,"\u73b0\u5728\u5df2\u7ecf\u53ef\u4ee5\u5728":164,"\u7528":164,"\u7528\u4e8e\u4e00\u4e9b\u7b80\u5355\u73af\u5883\u7684\u8fd0\u884c\u6216":146,"\u7528\u4e8e\u5728\u8bad\u7ec3\u7684\u7279\u5b9a\u65f6\u95f4\u70b9\u6267\u884c\u4e00\u4e9b\u51fd\u6570":156,"\u7528\u4e8e\u57fa\u4e8e\u65f6\u95f4\u7cfb\u7edf":142,"\u7528\u4e8e\u5b58\u653e\u4e00\u4e9b\u548c\u901a\u4fe1\u76f8\u5173\u7684\u6d88\u606f\u5b57\u5178":156,"\u7528\u4e8e\u5b9e\u73b0":164,"\u7528\u4e8e\u5c06\u4e24\u79cd\u65f6\u95f4\u7cfb\u7edf\u8fdb\u884c\u5c01\u88c5":142,"\u7528\u4e8e\u5e76\u884c\u8bad\u7ec3\u4e2d\u548c":156,"\u7528\u4e8e\u652f\u6301\u4e2d\u7b49\u590d\u6742\u6570\u5b66\u8fd0\u7b97":158,"\u7528\u4e8e\u652f\u6301\u7b80\u5355\u975e\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1":153,"\u7528\u4e8e\u652f\u6301\u9ad8\u590d\u6742\u6570\u5b66\u8ba1\u7b97\u6216\u4e0d\u53ef\u63a7\u8ba1\u7b97\u903b\u8f91":158,"\u7528\u4e8e\u6a21\u62df":145,"\u7528\u4e8e\u751f\u6210\u91c7\u6837\u6570\u636e\u5e8f\u5217\u7684\u7b56\u7565\u548c\u7528\u4e8e\u5b9e\u9645\u51b3\u7b56\u7684\u5f85\u8bc4\u4f30\u548c\u6539\u8fdb\u7b56\u7565\u662f\u4e0d\u540c\u7684":196,"\u7528\u4e8e\u751f\u6210\u91c7\u6837\u6570\u636e\u5e8f\u5217\u7684\u7b56\u7565\u548c\u7528\u4e8e\u5b9e\u9645\u51b3\u7b56\u7684\u5f85\u8bc4\u4f30\u548c\u6539\u8fdb\u7b56\u7565\u662f\u76f8\u540c\u7684":196,"\u7528\u4e8e\u79bb\u6563\u52a8\u4f5c":164,"\u7528\u4e8e\u8fde\u7eed\u52a8\u4f5c":164,"\u7528\u53c2\u6570\u62df\u5408\u7b56\u7565\u51fd\u6570":196,"\u7528\u540e\u7ee7\u5404\u4e2a\u72b6\u6001\u7684\u4ef7\u503c\u4f30\u8ba1\u503c\u6765\u66f4\u65b0\u5f53\u524d\u67d0\u4e2a\u72b6\u6001\u7684\u4ef7\u503c\u4f30\u8ba1\u503c":196,"\u7528\u5904":164,"\u7528\u6237\u53ef\u5728":146,"\u7528\u6765\u5e2e\u52a9\u667a\u80fd\u4f53\u7684\u5b66\u4e60":196,"\u7528\u6765\u8ba1\u7b97\u7d2f\u79ef\u7684\u5956\u52b1":196,"\u7528\u6cd5":146,"\u7528baseenvinfo\u548cenvelementinfo":146,"\u7531\u4e8e":[143,145,150],"\u7531\u4e8e\u4e0d\u786e\u5b9a\u6bcf\u4e2a\u5b50\u73af\u5883":146,"\u7531\u4e8e\u4f7f\u7528\u4e86":143,"\u7531\u4e8e\u5176\u4e0e\u73af\u5883\u76f8\u5173":143,"\u7531\u4e8e\u524d\u9762\u63d0\u5230\u7684":164,"\u7531\u4e8e\u67d0\u4e9b\u8fd0\u884c\u73af\u5883\u4e2d\u7f3a\u5c11\u76f8\u5e94\u6743\u9650":139,"\u7531\u4e8e\u68af\u5ea6\u4e0b\u964d\u8981\u6c42\u7528\u4e8e\u6279\u6b21\u8bad\u7ec3\u7684\u6570\u636e\u7b26\u5408i":196,"\u7531\u4e8e\u8bbe\u5b9a":143,"\u7531\u4e8e\u8f68\u8ff9\u4e2d\u4e5f\u5305\u542b\u4e86\u73af\u5883\u7684dynamics\u6a21\u578b\u7684\u4fe1\u606f":196,"\u7531\u4e8e\u9010\u6e10\u589e\u5927\u7684\u6570\u636e\u6d41\u538b\u529b\u662f\u901a\u8fc7\u9010\u6e10\u964d\u4f4e\u7684":145,"\u7531\u9879\u76ee\u8d1f\u8d23\u4eba\u6216\u6307\u5b9a\u76f8\u5173\u540c\u4e8b\u8fdb\u884c":168,"\u7531learner\u8bad\u7ec3\u4e00\u4e2a\u8fed\u4ee3":156,"\u7565\u6162\u4e8e":143,"\u7684":[139,143,145,146,148,150,164,168],"\u76848080\u7aef\u53e3":153,"\u7684\u4e00\u4e2a\u53c2\u6570":145,"\u7684\u4e09\u500d":145,"\u7684\u4e0d\u540c\u5de5\u4f5c\u8d1f\u8f7d":145,"\u7684\u4f18\u52bf\u66f4\u52a0\u660e\u663e":145,"\u7684\u4f30\u8ba1\u4e5f\u662f\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u4e00\u4e2a\u4f18\u5316\u65b9\u5411":196,"\u7684\u4f7f\u7528":153,"\u7684\u5185\u5bb9\u8fdb\u884c":164,"\u7684\u521d\u59cb\u5316\u9700\u8981\u4f20\u5165\u6bcf\u4e2a":146,"\u7684\u533a\u522b":[146,164],"\u7684\u540d\u79f0":164,"\u7684\u566a\u58f0":164,"\u7684\u5730\u65b9\u6709\u4e09\u4e2a":164,"\u7684\u5730\u65b9\u6bd4\u8f83\u5c11":164,"\u7684\u57fa\u7c7b":164,"\u7684\u5927\u5c0f":145,"\u7684\u5b50\u73af\u5883":146,"\u7684\u5b50\u73af\u5883\u65f6":146,"\u7684\u5b50\u73af\u5883\u90fd\u6ca1\u6709\u5b8c\u6210":146,"\u7684\u5b50\u7c7b":164,"\u7684\u5b9a\u4e49":148,"\u7684\u5b9e\u4f8b":164,"\u7684\u5b9e\u4f8b\u5316\u51fd\u6570\u8fdb\u884c\u5305\u88c5":146,"\u7684\u5b9e\u4f8b\u5316\u63a5\u53e3":146,"\u7684\u5b9e\u4f8b\u5316\u8c03\u7528\u63a5\u53e3\u548c":146,"\u7684\u5b9e\u73b0\u903b\u8f91\u4e0d\u540c":143,"\u7684\u5b9e\u9645\u9700\u6c42":145,"\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u5305\u62ec\u4e24\u4e2a\u6b65\u9aa4":196,"\u7684\u601d\u60f3":148,"\u7684\u64cd\u4f5c":164,"\u7684\u6536\u76careturn\u5728\u72b6\u6001":196,"\u7684\u6570\u636e\u5168\u90e8\u88ab\u8bfb\u51fa":145,"\u7684\u6570\u636e\u653e\u5165":145,"\u7684\u6574\u6570":158,"\u7684\u65b9\u6cd5\u6dfb\u52a0\u5230":164,"\u7684\u65f6\u5019":164,"\u7684\u65f6\u5019\u4f1a\u81ea\u52a8\u6839\u636e":164,"\u7684\u65f6\u95f4":143,"\u7684\u6700\u5927\u91cd\u8bd5\u6b21\u6570":146,"\u7684\u672c\u8d28\u533a\u522b\u5728\u4e8e":196,"\u7684\u6d4b\u901f\u7ed3\u679c":145,"\u7684\u73af\u5883\u4e2d\u6027\u80fd\u4e0b\u964d\u5f97\u975e\u5e38\u660e\u663e":143,"\u7684\u76ee\u6807":168,"\u7684\u76f8\u5173\u4f7f\u7528\u5b58\u5728\u5f3a\u4f9d\u8d56":148,"\u7684\u76f8\u5173\u6a21\u5757\u4f1a\u8fdb\u884c\u76f8\u5e94\u5904\u7406":148,"\u7684\u79cd\u5b50\u63a7\u5236":148,"\u7684\u79cd\u7c7b\u81ea\u52a8\u4fee\u6539\u5bf9\u5e94\u7684":148,"\u7684\u7ed3\u679c":146,"\u7684\u8868\u73b0\u53ca\u89e6\u53d1\u573a\u666f":168,"\u7684\u8bad\u7ec3\u65f6\u95f4\u76f8\u543b\u5408":145,"\u7684\u8bad\u7ec3\u90e8\u5206\u53ef\u4ee5\u7b80\u5316\u5982\u4e0b":164,"\u7684\u8bbe\u8ba1\u521d\u8877":145,"\u7684\u8fc7\u7a0b":196,"\u7684\u8fd0\u884c\u6548\u7387":146,"\u7684\u901f\u5ea6\u662f":143,"\u7684\u952e\u503c\u5bf9":146,"\u7684\u957f\u671f\u671f\u671b\u6536\u76ca":196,"\u7684\u95f4\u9694\u65f6\u95f4":146,"\u7684\u96c6\u5408\u79f0\u4e4b\u4e3a\u52a8\u4f5c\u7a7a\u95f4":196,"\u76d1\u7763\u5b66\u4e60\u662f\u4ece\u6709\u6807\u7b7e\u7684\u6570\u636e\u96c6\u4e2d\u8fdb\u884c\u6a21\u5f0f\u548c\u7279\u5f81\u7684\u5b66\u4e60":196,"\u76ee\u524d\u4f9d\u8d56\u4e8e\u7279\u5b9a\u7684\u73af\u5883\u7248\u672c":150,"\u76ee\u524d\u5df2\u7ecf\u652f\u6301\u7684":164,"\u76ee\u524d\u652f\u6301\u7684\u73af\u5883\u7248\u672c\u662f":150,"\u76ee\u524d\u652f\u6301\u7684\u7c7b\u578b\u6709\u5355\u8fdb\u7a0b\u4e32\u884c\u548c\u591a\u8fdb\u7a0b\u5e76\u884c\u4e24\u79cd\u6a21\u5f0f":146,"\u76ee\u5f55\u4e0b\u6709\u6211\u4eec\u5df2\u7ecf\u63d0\u4f9b\u597d\u7684":150,"\u76f4\u5230\u7d2f\u79ef\u56de\u62a5\u7684\u671f\u671b\u6700\u5927":196,"\u76f4\u5230\u8bad\u7ec3\u7ed3\u675f":156,"\u76f4\u63a5\u4ece\u6700\u4f18\u4ef7\u503c\u51fd\u6570\u7684\u5b9a\u4e49\u51fa\u53d1":196,"\u76f4\u63a5\u5728\u672c\u8fdb\u7a0b\u4e2d\u8bfb\u53d6\u6570\u636e":145,"\u76f4\u63a5\u8fdb\u5165\u6d41\u7a0b5":145,"\u76f8\u4f3c\u7684\u5c01\u88c5":164,"\u76f8\u4f3c\u7684\u63a5\u53e3":146,"\u76f8\u5173\u4efb\u52a1":148,"\u76f8\u5bf9\u4e8e\u7b80\u5355\u76f4\u63a5\u7684\u4e32\u884c\u6a21\u5f0f":156,"\u76f8\u5f53\u4e8e":148,"\u76f8\u6bd4\u8f83dp\u5728\u9a6c\u5c14\u53ef\u592b\u6027\u4e0d\u6210\u7acb\u65f6\u635f\u5931\u8f83\u5c0f":196,"\u771f\u6b63\u7684\u4f18\u52bf\u73af\u5883\u4e3a\u591a\u673a\u89c4\u6a21\u5316\u5206\u5e03\u5f0f\u73af\u5883":153,"\u77e9\u9635\u6216\u9ad8\u9636\u5f20\u91cf\u6765\u8868\u793a\u72b6\u6001\u548c\u89c2\u5bdf\u7684\u7ed3\u679c":196,"\u786e\u5b9a\u52a0\u8fd9\u4e2a\u529f\u80fd\u662f\u5fc5\u987b\u4e14\u53ef\u884c\u7684":168,"\u786e\u5b9e\u662f\u63d0\u9ad8\u4e86":145,"\u7981\u6b62":168,"\u79bb\u5f00":196,"\u79cd\u7c7b":148,"\u79d2":[143,145],"\u7aef\u7528\u4e8e\u8bad\u7ec3\u4e4b\u95f4\u6240\u7ecf\u5386\u7684\u8fc7\u7a0b":145,"\u7aef\u8fde\u63a5":153,"\u7b14\u8bb0\u672c\u4e0a\u8fd0\u884cdemo":153,"\u7b2c\u4e00\u6b21":148,"\u7b49":150,"\u7b49\u4ef7\u4e8eint":158,"\u7b49\u51fd\u6570":164,"\u7b49\u53ef\u4ee5\u89c6\u4e3a\u73af\u5883\u5143\u7d20":148,"\u7b49\u5f85\u4e4b\u524d\u7684\u4efb\u52a1\u5b8c\u6210\u540e\u518d\u6267\u884c":153,"\u7b49\u5f85\u5176\u8bfb\u53d6\u6570\u636e":145,"\u7b49\u5f85\u76f4\u5230\u81f3\u5c11\u4e00\u4e2a\u73af\u5883\u8fd4\u56de\u4e86\u8fd0\u884c\u7ed3\u679c":146,"\u7b49\u5f85coordinator\u518d\u6b21\u5206\u914d\u65b0\u7684\u4efb\u52a1":156,"\u7b49\u5f85coordinator\u5206\u914d\u65b0\u7684\u4efb\u52a1":156,"\u7b49\u7684\u4e00\u7cfb\u5217\u65b9\u6cd5":153,"\u7b56\u7565\u4e0e\u8bad\u7ec3\u4fe1\u606f\u7684\u5b9a\u65f6\u5b58\u50a8\u6216\u53d1\u9001\u7684hook":156,"\u7b56\u7565\u4f18\u5316":196,"\u7b56\u7565\u662f\u6700\u4f18\u7684":196,"\u7b56\u7565\u66f4\u65b0":156,"\u7b56\u7565\u68af\u5ea6\u7684\u65b9\u6cd5\u5bb9\u6613\u6536\u655b\u5230\u5c40\u90e8\u6700\u5c0f\u503c":196,"\u7b56\u7565\u68af\u5ea6\u7684\u65b9\u6cd5\u9700\u8981\u5b66\u4e60\u53c2\u6570\u5316\u8868\u793a\u7684\u7b56\u7565":196,"\u7b56\u7565\u8bc4\u4f30\u4e0e\u7b56\u7565\u4f18\u5316":196,"\u7b80\u5199\u4e3a":143,"\u7b80\u5316\u8c03\u7528\u7684":164,"\u7b80\u5355\u5728conflicts\u53ef\u4ee5\u76f4\u63a5\u5728":168,"\u7b80\u5355\u6570\u5b66\u8fd0\u7b97":158,"\u7b80\u5355\u7684\u63cf\u8ff0\u4ea4\u4e92":196,"\u7b80\u5355\u7684\u6765\u8bf4":196,"\u7b97\u5b50\u652f\u6301\u524d\u5411":150,"\u7ba1\u7406\u4ee5\u53ca\u7ed3\u679c\u7684\u83b7\u53d6":153,"\u7c7b":153,"\u7c7b\u53d8\u91cf":[148,156],"\u7c7b\u578b":148,"\u7c7b\u578b\u5224\u65ad\u4e0e\u8f6c\u6362":158,"\u7c7b\u578b\u548c":146,"\u7c7b\u5c5e\u6027\u65b9\u6cd5":146,"\u7c7b\u63a5\u53e3\u65b9\u6cd5":[146,148,156],"\u7c7b\u66f4\u4e3a\u5feb\u901f\u65b9\u4fbf\u7684\u66f4\u6539":164,"\u7c7b\u6bd4\u5bf9slurm\u96c6\u7fa4\u7684\u7ef4\u62a4":153,"\u7c7b\u7ee7\u627f\u5173\u7cfb\u5982\u4e0b\u56fe\u6240\u793a":148,"\u7cfb\u7edf":150,"\u7cfb\u7edf\u4f7f\u7528":168,"\u7d2f\u79ef\u56de\u62a5\u7684\u671f\u671b\u6700\u5927":196,"\u7d2f\u79ef\u5956\u52b1":196,"\u7ebf\u7a0b":145,"\u7ebf\u7a0b\u5747\u5728\u5de5\u4f5c":145,"\u7ebf\u7a0b\u6765\u907f\u514d\u7a0b\u5e8f\u76f2\u7b49":143,"\u7ec4\u4ef6\u6253\u5305\u597d\u7684":150,"\u7ec4\u4ef6\u662f\u4e00\u4e2a\u52a0\u901f\u7b97\u5b50\u7ec4\u4ef6":150,"\u7ec4\u6210\u56db\u4e2a\u5f85\u6d4b\u8bd5\u7684\u7ec4\u4ef6":143,"\u7ecf\u5e38\u4f7f\u7528":196,"\u7ecf\u9a8c\u56de\u653e\u6280\u672f":196,"\u7ecf\u9a8c\u56de\u653e\u6c60\u66f4\u65b0\u7b49":156,"\u7ed3\u5408\u4e0a\u6587\u4e2dslave\u7684\u4f8b\u5b50":153,"\u7ed3\u5408\u4e86\u4ee5\u4e0a\u4e24\u79cd\u65b9\u6cd5\u7684\u4f18\u70b9":196,"\u7ed3\u675f\u65f6":148,"\u7ed3\u675f\u65f6\u5c06\u8fd4\u56de\u503c\u4fdd\u5b58\u8d77\u6765":146,"\u7ed3\u6784\u7684":146,"\u7ed3\u679c\u540e":146,"\u7ed3\u679c\u8868\u660e":[143,145],"\u7ed9learner":156,"\u7edd\u5bf9\u4e0d\u8981\u628a\u5927\u5bb9\u91cf\u4e8c\u8fdb\u5236\u6587\u4ef6\u5d4c\u5165git":168,"\u7edf\u4e00\u653e\u5728":164,"\u7ee7\u627f":164,"\u7ee7\u627f\u4e86":148,"\u7ee7\u627f\u4e86baseenvmanag":146,"\u7ef4\u62a4\u9759\u6001\u7684\u5c5e\u6027\u548c\u65b9\u6cd5":148,"\u7f3a\u70b9":196,"\u7f51\u7edc\u7aef\u53e3\u7b49":153,"\u7f51\u7edc\u89c4\u6a21\u9012\u51cf":145,"\u8003\u8651\u5230":153,"\u8003\u8651\u5230learner\u53ef\u80fd\u9700\u8981\u5728\u6574\u4e2a\u8bad\u7ec3\u524d\u540e":156,"\u800c":[143,145,153,158,164],"\u800c\u52a8\u6001\u89c4\u5212\u5c5e\u4e8emodel":196,"\u800c\u5728":156,"\u800c\u5728\u4e4b\u540e\u7684\u8bad\u7ec3\u4e2d\u53d6\u51fabuffer\u4e2d\u7684experience\u4f7f\u7528":196,"\u800c\u5728\u7b56\u7565\u641c\u7d22\u65b9\u6cd5\u4e2d":196,"\u800c\u5bf9\u4e8e\u4e1a\u52a1\u5f02\u5e38":153,"\u800c\u5bf9\u4e8eslave\u7c7b\u7684\u8c03\u7528":153,"\u800c\u5f88\u591a\u60c5\u51b5\u4e0b":196,"\u800c\u662f\u4f1a\u5728":146,"\u800c\u662f\u5efa\u7acb\u5728\u73af\u5883feedback\u7684\u57fa\u7840\u4e0a":196,"\u800c\u662f\u76f4\u63a5\u4f7f\u7528fix":196,"\u800c\u6dfb\u52a0\u4e86\u4f4d\u7f6eposition\u8fd9\u4e00\u5c5e\u6027":156,"\u800c\u7528\u6237\u53ef\u4ee5\u5728\u94a9\u5b50\u4e2d\u5b9e\u73b0\u81ea\u5df1\u6240\u9700\u8981\u7684\u529f\u80fd":164,"\u800cactor":196,"\u800ccomm":156,"\u800cexploitation\u5219\u662fagent\u9700\u8981\u53bb\u9009\u62e9\u5f53\u524d\u72b6\u6001\u4e0b\u5c3d\u53ef\u80fd\u7684\u6536\u76ca\u9ad8\u7684\u52a8\u4f5c":196,"\u800cmodel":196,"\u800cmujoco\u7b49\u4e00\u4e9b\u673a\u5668\u4eba\u8fde\u7eed\u63a7\u5236\u4efb\u52a1\u4e2d\u4e3a\u8fde\u7eed\u52a8\u4f5c\u7a7a\u95f4":196,"\u800ctd":196,"\u8017\u65f6":168,"\u81ea\u52a8\u8c03\u7528\u94a9\u5b50\u5185\u5b9a\u4e49\u597d\u7684\u51fd\u6570":164,"\u81ea\u5b9a\u4e49":164,"\u81ea\u7136\u65f6\u95f4":142,"\u81ea\u7531":158,"\u81ea\u884c\u4ecedataloader\u83b7\u53d6\u6570\u636e":156,"\u81ea\u8eab\u5bf9\u5916\u754c\u8f93\u5165\u8d28\u7591":148,"\u81ea\u8eab\u5bf9\u5916\u754c\u8f93\u51fa\u8d1f\u8d23":148,"\u81f3":143,"\u81f3\u4e8e\u4ec0\u4e48\u662f\u56de\u8c03\u51fd\u6570\u53ca\u56de\u8c03\u51fd\u6570\u662f\u7528\u6765\u505a\u4ec0\u4e48\u7684":156,"\u81f3\u4e8e\u5b9e\u9645\u4efb\u52a1\u7684\u5206\u914d\u4e0e\u6267\u884c":156,"\u81f3\u672c\u5730\u4e4b\u540e":168,"\u81f3\u6b64":164,"\u82e5":145,"\u82e5\u4e3a0\u62161\u8868\u660e\u4e0d\u4f7f\u7528\u591a\u8fdb\u7a0b":145,"\u82e5\u4e3a\u5927\u4e8e1\u7684\u6570\u5219\u8868\u660e\u4f7f\u7528\u591a\u8fdb\u7a0b":145,"\u82e5\u4e3a\u6570\u636e":145,"\u82e5\u5176\u4e3a\u7a7a":156,"\u82e5\u6210\u529f\u5b89\u88c5\u540e":150,"\u82e5\u6240\u6709\u73af\u5883\u5747\u5728\u8fd0\u884c\u4e0a\u4e00\u4e2a\u547d\u4ee4":146,"\u82e5\u6307\u5b9a\u9700\u8981":145,"\u82e5\u662f":146,"\u82e5\u679cslave\u7aef\u5df2\u7ecf\u6709\u4e00\u4e2a\u4efb\u52a1\u6b63\u5728\u8fd0\u884c":153,"\u82e5\u8981\u5173\u95ed\u8be5\u7279\u6027":146,"\u82e5\u8ba4\u4e3a\u5f53\u503c\u51fd\u6570\u6700\u4f18\u65f6":196,"\u82e5\u968f\u673a\u53d8\u91cf\u5e8f\u5217\u4e2d\u7684\u6bcf\u4e2a\u72b6\u6001\u90fd\u662f\u9a6c\u5c14\u79d1\u592b\u7684\u5219\u79f0\u6b64\u968f\u673a\u8fc7\u7a0b\u4e3a\u9a6c\u5c14\u79d1\u592b\u968f\u673a\u8fc7\u7a0b":196,"\u83b7\u53d6\u6570\u636e":145,"\u83b7\u53d6\u6570\u636e\u7684\u51fd\u6570":156,"\u83b7\u53d6\u6570\u636e\u8bfb\u53d6\u4efb\u52a1":145,"\u8499\u7279\u5361\u6d1b\u548ctd\u7b97\u6cd5\u96b6\u5c5e\u4e8emodel":196,"\u8499\u7279\u5361\u6d1b\u65b9\u6cd5":196,"\u867d\u7136\u5bf9\u6574\u4f53\u7b56\u7565\u7684\u66f4\u65b0\u66f4\u7a33\u5b9a\u4f46\u662f\u964d\u4f4e\u4e86\u5b66\u4e60\u7684\u6548\u7387":196,"\u867d\u7136\u63d0\u4f9b\u4e86\u8bad\u7ec3\u63a5\u53e3":156,"\u884c\u4e3a\u4ef7\u503c\u51fd\u6570":196,"\u8868\u793a\u4e3a":196,"\u8868\u793a\u53c2\u6570":196,"\u8868\u793a\u73af\u5883\u8dd1\u5b8c\u4e00\u4e2a":148,"\u8868\u793a\u73af\u5883\u8fd0\u884c\u8be5\u6b65\u662f\u662f\u5426\u53d1\u751f\u4e86\u9519\u8bef":148,"\u8870\u51cf\u56e0\u5b50\u4f53\u73b0\u7684\u662f\u672a\u6765\u7684\u5956\u52b1\u5728\u5f53\u524d\u65f6\u523b\u7684\u4ef7\u503c\u6bd4\u4f8b":196,"\u8870\u51cf\u56e0\u5b50\u7684\u5f15\u5165\u4e0d\u4f46\u5728\u6570\u5b66\u8868\u8fbe\u4e0a\u66f4\u65b9\u4fbf":196,"\u88ab\u5e7f\u6cdb\u5e94\u7528\u4e8e\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u4e2d":196,"\u89c2\u5bdf\u7a7a\u95f4\u7684\u7ef4\u5ea6\u7b49\u7b49":148,"\u89c4\u6a21":145,"\u89c6\u7ebf\u56de\u5230comm":156,"\u89c6\u7ebf\u56de\u5230coordin":156,"\u89c6\u7ebf\u56de\u5230learner":156,"\u89e3\u51b3mdp\u95ee\u9898\u7684\u5e38\u7528\u65b9\u6cd5":196,"\u8ba1\u7b97":158,"\u8ba1\u7b97\u5f97\u51fa\u4e00\u4e2a\u65b0\u7684loader":158,"\u8ba1\u7b97x":158,"\u8bad\u7ec3":150,"\u8bad\u7ec3\u4e00\u4e2a\u80fd\u4e3b\u52a8\u9009\u62e9\u81ea\u5df1\u7684\u52a8\u4f5c":196,"\u8bad\u7ec3\u4e00\u4e2a\u8fed\u4ee3":156,"\u8bad\u7ec3\u4efb\u52a1\u4f1a\u5206\u4e3a\u5982\u4e0b\u51e0\u79cd\u60c5\u51b5":153,"\u8bad\u7ec3\u4efb\u52a1\u5b8c\u6210\u4e4b\u540e":164,"\u8bad\u7ec3\u4efb\u52a1\u5f00\u59cb\u4e4b\u524d":164,"\u8bad\u7ec3\u591a\u4e2a\u8fed\u4ee3":156,"\u8bad\u7ec3\u5b8c\u6210\u540e":156,"\u8bad\u7ec3\u5b8c\u6bd5\u7684\u65f6\u5019\u4f1a\u5b58\u4e00\u6b21ckpt":164,"\u8bb2\u5f97\u8db3\u591f\u6df1\u5165":168,"\u8bbe\u4e3a8":145,"\u8bbe\u5b9a\u5177\u4f53\u7684\u8fd0\u884c\u7ec6\u8282":146,"\u8bbe\u7f6e":146,"\u8bbe\u7f6e\u4e3a":168,"\u8bbe\u7f6e\u73af\u5883\u968f\u673a\u79cd\u5b50":146,"\u8bbe\u8ba1\u4e86":145,"\u8bc4\u4f30\u5355\u4e2a\u7b56\u7565\u65f6\u5e76\u4e0d\u5145\u5206":196,"\u8bd5\u56fe\u83b7\u53d6\u6570\u636e":156,"\u8be5\u4efb\u52a1\u53ef\u4ee5\u4fdd\u8bc1":143,"\u8be5\u5c5e\u6027\u4f1a\u5224\u65ad\u6240\u6709\u5b50\u73af\u5883\u7684\u5b8c\u6210\u60c5\u51b5":146,"\u8be5\u5c5e\u6027\u53d6\u503c\u5fc5\u987b\u4e3a\u7c7b\u53d8\u91cfpositions\u4e2d\u7684\u4e00\u4e2a":156,"\u8be5\u5f02\u5e38\u53ea\u80fd\u6355\u6349\u975e\u4e1a\u52a1\u5f02\u5e38":153,"\u8be5\u60c5\u51b5\u5e76\u4e0d\u4e3b\u8981\u8ba8\u8bba":145,"\u8be5\u6270\u52a8\u670d\u4ece\u5e73\u5747\u5206\u5e03":143,"\u8be5\u65b9\u6cd5\u4f1a\u5b89\u5168\u5730\u5173\u95ed\u6240\u6709\u7684\u5b50\u73af\u5883":146,"\u8be5\u65b9\u6cd5\u4f1a\u6309\u7167\u4f20\u5165\u7684":146,"\u8be5\u65b9\u6cd5\u4f1a\u68c0\u67e5\u8fd0\u884c\u7ed3\u679c":146,"\u8be5\u65b9\u6cd5\u4f1a\u7b49\u5f85\u8fd9\u4e9b\u5b50\u73af\u5883\u7684\u4e0a\u4e00\u6b21":146,"\u8be5\u65b9\u6cd5\u4f20\u5165\u7684\u53c2\u6570\u662f\u4e00\u4e2a":146,"\u8be5\u65b9\u6cd5\u53ef\u9009\u5b9e\u73b0":148,"\u8be5\u6846\u67b6\u96c6\u6210\u4e86\u503c\u51fd\u6570\u4f30\u8ba1\u7b97\u6cd5\u548c\u7b56\u7565\u641c\u7d22\u7b97\u6cd5":196,"\u8be5\u7c7b\u53ca\u5176\u5b50\u7c7b\u662f":148,"\u8be5\u7c7b\u53ca\u5176\u5b50\u7c7b\u8d1f\u8d23\u67d0\u4e00\u5177\u4f53\u73af\u5883\u5143\u7d20\u7684\u57fa\u672c\u4fe1\u606f\u548c\u5904\u7406\u51fd\u6570\u5b9a\u4e49":148,"\u8be5\u7c7b\u5c06\u5bf9\u5e94\u7684\u9759\u6001\u73af\u5883\u5143\u7d20\u5b9e\u4f8b\u4f5c\u4e3a\u81ea\u5df1\u7684\u4e00\u4e2a\u6210\u5458\u53d8\u91cf":148,"\u8be5\u7c7b\u662f":164,"\u8be5\u7c7b\u662f\u6240\u6709":164,"\u8be5\u7c7b\u7684\u552f\u4e00\u6807\u8bc6\u540d":148,"\u8be5\u884c\u4e3a\u4e0d\u5e94\u8be5\u5728":148,"\u8be5\u90e8\u5206\u4e5f\u53ef\u81ea\u7531\u9009\u62e9":148,"\u8be5\u952e\u503c\u975e\u5fc5\u987b":148,"\u8be6\u7ec6\u7684\u53c2\u6570\u4fe1\u606f\u53ef\u53c2\u8003":139,"\u8bf7\u4ecd\u7136\u5728\u539f\u4ee3\u7801\u4ed3\u5e93\u63d0\u4e00\u4e2a":168,"\u8bf7\u4f7f\u7528\u5bf9\u5e94\u7684\u5f02\u5e38\u7c7b\u5df2\u7ecf\u6355\u6349":153,"\u8bf7\u5148\u7ebf\u4e0b\u548c\u4ee3\u7801\u5e93\u7684\u8d1f\u8d23\u4eba\u804a\u4e00\u4e0b\u4f60\u7684\u610f\u56fe":168,"\u8bf7\u6c42":145,"\u8bf7\u6ce8\u610f\u52a0\u4e0a":158,"\u8bf7\u6ce8\u610f\u5728\u5b9e\u9645\u4f7f\u7528\u7684\u65f6\u5019":158,"\u8bf7\u7279\u522b\u7559\u610f":168,"\u8bf7\u7ee7\u627fmaster\u7c7b":153,"\u8bf7\u7ee7\u627fslave\u7c7b\u5e76\u5b9e\u73b0":153,"\u8bf7\u7ee7\u7eed\u9605\u8bfb":156,"\u8bf7\u81ea\u884c\u786e\u8ba4\u4e0d\u4f1a\u6709\u8d44\u6e90\u6d6a\u8d39\u6216\u51b2\u7a81\u7684\u60c5\u51b5\u53d1\u751f":148,"\u8bfb\u51fa\u7684\u6570\u636e\u6309\u7167\u539f\u6765\u7684":145,"\u8bfb\u53d6\u5e76\u9884\u5904\u7406\u6570\u636e":145,"\u8bfb\u53d6\u6a21\u578b\u7684\u68c0\u67e5\u70b9":164,"\u8c03\u7528":[146,156,164],"\u8c03\u7528\u5728":146,"\u8c03\u7528\u60c5\u51b5":164,"\u8c03\u7528\u65b9\u6cd5\u4e5f\u66f4\u4e3a\u7b80\u5355":164,"\u8c03\u7528\u6700\u5916\u5c42\u7684model":164,"\u8c03\u7528\u6d41\u7a0b":164,"\u8c03\u7528\u7236\u7c7b\u7684\u8be5\u65b9\u6cd5":148,"\u8c03\u7528\u8be5\u4f4d\u7f6e\u6240\u6709hook":156,"\u8c03\u7528\u8be5\u65b9\u6cd5\u540e":146,"\u8c03\u7528hook\u4fdd\u5b58checkpoint":156,"\u8c03\u7528hook\u8981\u6267\u884c\u7684\u51fd\u6570":156,"\u8d1d\u5c14\u66fc\u65b9\u7a0b\u662f\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u57fa\u7840":196,"\u8d1d\u5c14\u66fc\u65b9\u7a0b\u8868\u793a\u5f53\u524d\u72b6\u6001\u7684\u4ef7\u503c\u4e0e\u4e0b\u4e00\u4e2a\u72b6\u6001\u7684\u4ef7\u503c":196,"\u8d1f\u8d23\u548ccoordinator\u901a\u4fe1":156,"\u8d1f\u8d23\u8fd0\u884c\u65f6\u76f8\u5173\u7684\u72b6\u6001\u7ba1\u7406":148,"\u8d1f\u8f7d\u624d\u83b7\u5f97\u4e86\u5982\u6b64\u4f18\u79c0\u7684\u6027\u80fd\u63d0\u5347":145,"\u8d1f\u8f7d\u738720":145,"\u8d1f\u8f7d\u76f8\u5bf9\u7a33\u5b9a":145,"\u8d1f\u8f7d\u7a33\u5b9a\u4fdd\u6301\u5728":143,"\u8d1f\u8f7d\u7ea6\u4e3a":145,"\u8ddf\u8fdb\u81ea\u5df1\u7684\u8fdb\u5c55":168,"\u8ddf\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u4e0d\u540c\u7684\u662f":196,"\u8de8\u7ec4\u4ed3\u5e93\u63a8\u8350\u7528fork":168,"\u8f68\u8ff9\u6570\u636e\u4e2d\u5305\u542b\u4e86\u73af\u5883\u7684transition\u65b9\u7a0b":196,"\u8f68\u8ff9\u6570\u636e\u6587\u4ef6\u5927\u5c0f\u4e5f\u5404\u4e0d\u76f8\u540c":145,"\u8f6c\u4e3aloader":158,"\u8f6c\u6362\u4e0e\u9a8c\u8bc1":158,"\u8f6c\u6362\u503c\u8fd8\u539f":158,"\u8f83\u4e3a\u590d\u6742\u7684\u9700\u8981\u5728\u672c\u5730fetch\u76ee\u6807\u5206\u652f\u7684\u6539\u52a8\u4e4b\u540e":168,"\u8f93\u5165":164,"\u8fc7\u7a0b":143,"\u8fd0\u7528\u5b66\u5230\u7684\u6a21\u578b\u6765\u8fdb\u884cplanning\u83b7\u53d6\u65b0\u7684\u6570\u636e":196,"\u8fd0\u884c\u591a\u4e2a\u73af\u5883\u7684\u5b9e\u4f8b":146,"\u8fd0\u884c\u5b8c\u6bd5\u518d\u8fd0\u884c\u6b64\u6b21":146,"\u8fd0\u884c\u5e73\u53f0\u662f16gv100":150,"\u8fd0\u884c\u65e5\u5fd7\u6587\u4ef6\u7b49":168,"\u8fd0\u884c\u7684":146,"\u8fd0\u884c\u7ed3\u675f\u540e\u5bf9\u5e94\u7684":146,"\u8fd0\u884c\u81f3":146,"\u8fd1\u89c6":196,"\u8fd4\u56de":146,"\u8fd4\u56de\u503c":148,"\u8fd4\u56de\u5168\u90e8\u8fd0\u884c\u7ed3\u679c":146,"\u8fd4\u56de\u5b8c\u6210\u4e86\u4e0a\u4e00\u4e2a":146,"\u8fd4\u56de\u6240\u6709\u672a\u8fd0\u884c\u7ed3\u675f\u7684\u73af\u5883":146,"\u8fd4\u56de\u63d0\u4f9b\u5143\u7d20\u8bf4\u660e\u7684\u5b57\u7b26\u4e32":148,"\u8fd4\u56de\u8be5\u5143\u7d20\u7c7b\u7684\u57fa\u672c\u4fe1\u606f\u548c\u5904\u7406\u51fd\u6570":148,"\u8fd8\u6709\u5fc5\u8981\u4ecb\u7ecd\u4e00\u4e0blearnerslav":156,"\u8fd8\u6709\u66f4\u591a\u7684\u4e00\u4e9b\u529f\u80fd\u548c\u7528\u6cd5":153,"\u8fd8\u9488\u5bf9\u7ec6\u8282\u505a\u4e86\u4e00\u4e9b\u6539\u52a8":148,"\u8fd9\u4e00\u4f7f\u7528flask\u53ca\u6587\u4ef6\u7cfb\u7edf\u8fdb\u884c\u901a\u4fe1\u7684comm":156,"\u8fd9\u4e00\u500d\u7387\u8303\u56f4\u5185\u968f\u673a\u6d6e\u52a8":143,"\u8fd9\u4e00\u6bd4\u4f8b":145,"\u8fd9\u4e00\u70b9\u4e5f\u4e0e\u5176\u76f8\u8f83\u4e8e":145,"\u8fd9\u4e00\u771f\u6b63\u8d1f\u8d23\u548ccoordinator\u8fdb\u884c\u901a\u4fe1\u7684\u7c7b":156,"\u8fd9\u4e00\u8282\u4e3b\u8981\u5217\u4e00\u4e9b\u5728\u4f7f\u7528":168,"\u8fd9\u4e24\u4e2a\u65f6\u95f4\u5747\u4e3a\u591a\u6b21\u91cd\u590d\u5b9e\u9a8c\u6d4b\u5f97":145,"\u8fd9\u4e24\u8005\u7684\u5dee\u5f02\u5728\u4e8e":158,"\u8fd9\u4e2a":148,"\u8fd9\u4e2a\u5b57\u5178\u4e2d":164,"\u8fd9\u4e2a\u7c7b\u7684\u4e1a\u52a1\u903b\u8f91\u4e3a":153,"\u8fd9\u4e2a\u8fc7\u7a0b\u53ef\u80fd\u5bf9short":196,"\u8fd9\u4e2a\u8fc7\u7a0b\u5faa\u73af\u53d1\u751f":196,"\u8fd9\u4e5f\u662f\u76ee\u524dmodel":196,"\u8fd9\u4e9b\u4fe1\u606f\u90fd\u4f20\u5230\u4e86learner":156,"\u8fd9\u4e9b\u64cd\u4f5c\u5c06\u4ee5hook\u7684\u65b9\u5f0f\u5b8c\u6210":156,"\u8fd9\u4e9b\u6587\u4ef6\u53ef\u80fd\u4f1a\u5e26\u6765\u591a\u79cd\u591a\u6837\u7684\u95ee\u9898":168,"\u8fd9\u4e9b\u6d4b\u8bd5\u4f1a\u8fd0\u884c\u539f\u59cb\u7248\u672c\u57fa\u4e8epytorch":150,"\u8fd9\u4efd\u6587\u6863\u65e8\u5728\u7ed9\u4e86\u89e3":168,"\u8fd9\u5c31\u662fexploit":196,"\u8fd9\u5c31\u7528\u5230\u4e86\u6211\u4eec\u521a\u521a\u63d0\u5230\u7684":156,"\u8fd9\u6837\u4e3b\u8981\u662f\u4e3a\u4e86\u9632\u6b62\u516c\u5171\u4ee3\u7801\u5e93\u5206\u652f\u6df7\u4e71":168,"\u8fd9\u6837\u5b9e\u73b0\u662f\u4e3a\u4e86\u8ba9\u5b50\u7c7b\u8c03\u7528\u65b9\u6cd5":148,"\u8fd9\u6837\u5f53\u4ee3\u7801\u8fd0\u884c\u5230\u6307\u5b9a\u4f4d\u7f6e\u7684\u65f6\u5019":164,"\u8fd9\u6837\u7684\u5199\u6cd5":158,"\u8fd9\u6837\u7684\u8bdd":168,"\u8fd9\u7c7b\u73af\u5883":143,"\u8fd9\u90e8\u5206\u7684":164,"\u8fd9\u91cc\u4e3b\u8981\u5206\u4e24\u79cd\u60c5\u51b5":168,"\u8fd9\u91cc\u662fvalueerror":158,"\u8fd9\u91cc\u6709\u4e0b\u9762\u51e0\u4e2a\u5efa\u8bae":168,"\u8fd9\u91cc\u8bf4\u7684\u4e8c\u6b21\u7ee7\u627f\u662f\u6307":153,"\u8fdb\u5165\u6d41\u7a0b2":145,"\u8fdb\u5165\u6d41\u7a0b3":145,"\u8fdb\u5165\u6d41\u7a0b4":145,"\u8fdb\u7a0b":145,"\u8fdb\u7a0b\u5217\u8868":145,"\u8fdb\u7a0b\u5217\u8868\u4e2d\u7684\u6bcf\u4e00\u4e2a\u5143\u7d20":145,"\u8fdb\u7a0b\u5217\u8868\u4e5f\u4e0d\u4f1a\u88ab\u521d\u59cb\u5316":145,"\u8fdb\u7a0b\u90fd\u4ece":145,"\u8fdb\u884c":146,"\u8fdb\u884c\u4e86\u5bf9\u6bd4":143,"\u8fdb\u884c\u4e86\u5f02\u5e38\u7c7b\u7684\u5f52\u7c7b":153,"\u8fdb\u884c\u4e86\u6d4b\u901f\u5b9e\u9a8c":143,"\u8fdb\u884c\u4e86\u901f\u5ea6\u4e0a\u7684\u5bf9\u6bd4":145,"\u8fdb\u884c\u521b\u5efa":148,"\u8fdb\u884c\u52a0\u901f":146,"\u8fdb\u884c\u5404\u4e2a\u5b57\u6bb5\u7684\u8bb0\u5f55\u548c\u5206\u6790":142,"\u8fdb\u884c\u5b58\u50a8\u53ca\u8fde\u63a5":145,"\u8fdb\u884c\u5f53\u524d\u8fed\u4ee3\u7684\u8bad\u7ec3":156,"\u8fdb\u884c\u5feb\u901f\u521b\u5efa\u548c\u8d44\u6e90\u56de\u6536":153,"\u8fdb\u884c\u5feb\u901f\u8c03\u7528":153,"\u8fdb\u884c\u64cd\u4f5c":164,"\u8fdb\u884c\u6ce8\u518c":164,"\u8fdb\u884c\u6dfb\u52a0":164,"\u8fdb\u884c\u7b56\u7565\u7684\u4ef7\u503c\u8bc4\u4f30":196,"\u8fdb\u884c\u7b56\u7565\u8fed\u4ee3\u7684\u8ba1\u7b97":196,"\u8fdb\u884c\u7ba1\u7406":148,"\u8fdb\u884c\u8ba8\u8bba\u6216code":168,"\u8fdb\u884c\u8bad\u7ec3":156,"\u8fdb\u884c\u963b\u585e\u63a7\u5236":153,"\u8fde\u63a5\u8d85\u65f6\u7b49":153,"\u8fed\u4ee3\u66f4\u65b0\u7b56\u7565\u53c2\u6570\u503c":196,"\u9009\u62e9\u9891\u9053":153,"\u9009\u9879":139,"\u9009\u9879\u4f1a\u5bfc\u81f4\u65e0\u6cd5\u4f7f\u7528cli":139,"\u901a\u4fe1":156,"\u901a\u5e38":148,"\u901a\u8fc7":[146,158,164],"\u901a\u8fc7\u4e0a\u8ff0\u8c03\u7528\u540e":153,"\u901a\u8fc7\u4e0b\u9762\u7684\u4ee3\u7801\u5373\u53ef\u5f97\u5230\u6240\u9700":164,"\u901a\u8fc7\u4eff\u771f\u8f68\u8ff9\u4f30\u8ba1\u503c\u51fd\u6570\u8fdb\u800c\u4f18\u5316\u7b56\u7565":196,"\u901a\u8fc7\u4f7f\u7528replai":196,"\u901a\u8fc7\u5728\u5b50\u8fdb\u7a0b\u4e2d\u8fd0\u884c":146,"\u901a\u8fc7\u5b50\u8fdb\u7a0b\u5411\u91cf\u5316\u7684\u65b9\u5f0f":146,"\u901a\u8fc7\u5faa\u73af\u4e32\u884c":146,"\u901a\u8fc7\u7ba1\u9053\u5411":145,"\u901a\u8fc7\u7ed9\u5b9a\u7684":148,"\u901a\u8fc7\u8be5\u5b9e\u4f8b":164,"\u901a\u8fc7\u8c03\u7528":146,"\u901a\u8fc7\u903b\u8f91\u7ec4\u5408\u7b49\u65b9\u5f0f":158,"\u901a\u8fc7\u91c7\u6837\u5148\u5b66\u4e60\u4e00\u4e2a\u5bf9\u73af\u5883\u7684\u5efa\u6a21":196,"\u901a\u8fc7\u91c7\u6837\u6765\u76f4\u63a5\u5bf9\u4e8e\u6700\u4f18\u4ef7\u503c\u51fd\u6570\u8fdb\u884c\u65e0\u504f\u4f30\u8ba1":196,"\u901a\u8fc7\u91cd\u5199":153,"\u903b\u8f91\u7ec4\u5408":158,"\u90a3\u4e48":[168,196],"\u90a3\u4e48\u57fa\u4e8e\u503c\u51fd\u6570\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u65e0\u6cd5\u5b66\u4e60\u5230\u8fd9\u6837\u7684\u7b56\u7565":196,"\u90a3\u4e48\u6a21\u578b\u6bd4\u8f83\u5bb9\u6613\u9677\u5165\u5c40\u90e8\u6700\u4f18":196,"\u90a3\u6837\u53bb\u4f7f\u7528":164,"\u90e8\u5206\u4e3a\u8be5":164,"\u90e8\u5206\u8fd0\u884c\u73af\u5883\u4f1a\u5c06cli\u5b89\u88c5\u5728\u7528\u6237\u76ee\u5f55\u4e0b":139,"\u90e8\u5206\u8fd0\u884c\u73af\u5883\u4f7f\u7528pip\u5b89\u88c5\u65f6\u6307\u5b9a":139,"\u90fd\u6bd4":145,"\u90fd\u8c03\u7528":156,"\u914d\u7f6e\u4e0e\u4f7f\u7528\u5982\u4e0b":164,"\u914d\u7f6e\u6587\u4ef6\u5939":168,"\u91c7\u53d6\u52a8\u4f5c":196,"\u91ca\u653e\u5168\u90e8\u8d44\u6e90":146,"\u91ca\u653e\u8d44\u6e90":146,"\u91cc\u9762\u7528\u5230\u7684":164,"\u91cd\u542f\u65f6\u5bf9\u5e94\u8fdb\u884c\u8c03\u7528":148,"\u91cd\u542f\u72b6\u6001":148,"\u91cd\u590d":143,"\u91cf\u5316\u4ea4\u6613\u7b49\u9886\u57df":196,"\u9488\u5bf9":143,"\u9488\u5bf9\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u4e2d\u8f83\u901a\u7528\u7684\u7b97\u6cd5\u6a21\u5757":150,"\u94a9\u5b50":164,"\u94a9\u5b50\u4e2d\u5b9a\u4e49\u597d\u7684\u51fd\u6570\u4f1a\u88ab\u81ea\u52a8\u8c03\u7528":164,"\u94a9\u5b50\u4f1a\u88ab\u89e6\u53d1":164,"\u9500\u6bc1\u5b50\u73af\u5883\u5f00\u8f9f\u7684\u8fdb\u7a0b":146,"\u9500\u6bc1\u73af\u5883\u5b50\u8fdb\u7a0b":146,"\u952e\u503c\u4e3a\u8be5\u5b50\u73af\u5883\u7684":146,"\u952e\u503c\u5bf9":148,"\u957f\u5ea6\u4e3a1\u7684\u961f\u5217":156,"\u9605\u8bfb":168,"\u963b\u585e":156,"\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1":153,"\u963b\u585e\u5728":145,"\u963b\u585e\u591a\u7ebf\u7a0b\u4efb\u52a1":153,"\u9644\u8fd1\u5c0f\u5e45\u6ce2\u52a8":145,"\u964d\u4f4e\u4e86\u65b9\u5dee\u5e76\u52a0\u5feb\u4e86\u5b66\u4e60":196,"\u964d\u4f4e\u8fdc\u671f\u5229\u76ca\u7684\u4e0d\u786e\u5b9a\u6027":196,"\u9664\u4e86\u5728":143,"\u9664\u6b64\u4e4b\u5916":196,"\u9664\u975e\u5fc5\u8981":168,"\u9664\u975e\u7d2f\u8ba1\u8fd0\u884c\u7684":146,"\u9664\u975e\u91cd\u65b0":146,"\u968f\u65f6\u95f4\u6ce2\u52a8\u975e\u5e38\u5927":145,"\u968f\u673a\u62bd\u6837\u5f97\u5230\u7684\u6570\u636e\u5c31\u80fd\u63a5\u8fd1i":196,"\u968f\u673a\u7b56\u7565\u5c06\u4f1a\u4f18\u4e8e\u786e\u5b9a\u6027\u7684\u7b56\u7565":196,"\u96c6\u5408\u5904\u7406\u65e5\u5fd7":164,"\u9700\u4f7f\u7528":146,"\u9700\u8981":146,"\u9700\u8981\u4f20\u5165\u5177\u4f53":148,"\u9700\u8981\u4fdd\u8bc1batch":145,"\u9700\u8981\u5728":148,"\u9700\u8981\u5728\u73af\u5883info\u51fd\u6570\u4e2d":146,"\u9700\u8981\u5b8c\u6210\u4ee5\u4e0b\u51e0\u6b65":164,"\u9700\u8981\u63d0\u4f9b":164,"\u9700\u8981\u6536\u96c6\u81f3\u5c11":143,"\u9700\u8981\u7684\u65f6\u95f4":146,"\u9700\u8981\u7b49\u5f85":143,"\u9700\u8981\u7b49\u5f85\u5168\u90e8":143,"\u9700\u8981\u7ee7\u7eed\u8fed\u4ee3":156,"\u9700\u8981\u901a\u8fc7":168,"\u9700\u8981\u9a8c\u8bc1cli\u7684\u5b89\u88c5\u76ee\u5f55\u662f\u5426\u5728\u4f7f\u7528\u8005\u7684\u73af\u5883\u53d8\u91cf\u4e2d":139,"\u975e\u963b\u585e\u591a\u7ebf\u7a0b\u4efb\u52a1":153,"\u975ehttp\u72b6\u6001\u7801":153,"\u9875\u9762\u63cf\u8ff0":168,"\u9879\u76ee\u7ef4\u62a4\u8005\u4e4b\u5916\u7684\u4eba\u76f4\u63a5\u66f4\u65b0":168,"\u9996\u5148\u5efa\u7acblearner":156,"\u9996\u5148\u662f\u6574\u4f53\u6d41\u7a0b\u6240\u7528\u5168\u90e8\u65f6\u95f4":145,"\u9996\u5148\u662f\u901a\u8fc7\u5e38\u89c4\u65b9\u5f0f\u542f\u52a8\u548c\u505c\u6b62master":153,"\u9996\u5148\u662f\u901a\u8fc7\u5e38\u89c4\u65b9\u5f0f\u542f\u52a8\u548c\u5173\u95edslave\u7aef":153,"\u9996\u6b21\u521d\u59cb\u5316\u73af\u5883\u9700\u8c03\u7528":146,"\u9a6c\u5c14\u53ef\u592b\u6027":196,"\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b\u7531\u5143\u7ec4":196,"\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b\u7684\u72b6\u6001\u8f6c\u79fb\u6982\u7387\u4e3a":196,"\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u4e2d\u4e0d\u5b58\u5728\u52a8\u4f5c\u548c\u5956\u52b1":196,"\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u662f\u4e00\u4e2a\u4e8c\u5143\u7ec4":196,"\u9a8c\u8bc1":150,"\u9a8c\u8bc1\u662f\u5426\u4e3a":158,"\u9a8c\u8bc1\u662f\u5426\u4e3a\u5728":158,"\u9a8c\u8bc1\u662f\u5426\u5728\u533a\u95f4":158,"\u9ad8\u7ea7\u7279\u6027":146,"\u9ad8\u81f350":145,"\u9ed8\u8ba4\u4e3a":146,"\u9ed8\u8ba4\u4f1a":146,"\u9ed8\u8ba4\u4f1a\u8fdb\u884c\u81ea\u52a8":146,"\u9ed8\u8ba4\u60c5\u51b5\u4e0b":168,"\u9ed8\u8ba4\u60c5\u51b5\u4f1a\u83b7\u53d6\u914d\u7f6e\u6587\u4ef6\u4e2d\u7684\u73af\u5883\u4e2a\u6570":148,"\u9ed8\u8ba4\u90fd\u4f7f\u7528":148,"\ufb01xed":192,"abstract":[2,8,17,23,49,50,58,69,93,94,96,101,105,107,108,123,132,155,157,160,163,193,199],"act\u548crew\u7684shape\u548cvalue\u7684dtyp":146,"adri\u00e0":171,"api\u7684\u5b9e\u73b0":150,"atari\u6e38\u620f\u4e2d\u4f7f\u7528rgb\u56fe\u7247\u6765\u8868\u793a\u6e38\u620f\u73af\u5883\u7684\u4fe1\u606f":196,"autolog\u6574\u4f53\u5206\u4e3a\u4e24\u90e8\u5206":142,"autolog\u6a21\u5757\u7684\u4e3b\u8981\u7528\u9014\u4e3a\u89e3\u51b3\u5728\u6a21\u578b\u8bad\u7ec3\u7b49\u6570\u636e\u52a8\u6001\u573a\u666f\u4e0b":142,"avglist\u7c7b\u4f1a\u81ea\u52a8\u8bb0\u5f55\u5bf9value\u503c\u7684\u66f4\u6539":142,"ayncdataloader\u7684\u53c2\u6570":156,"ba\u015far":174,"based\u548cmodel":196,"based\u5927\u7c7b\u65b9\u6cd5\u4e2d\u540c\u6837\u6709\u4e24\u79cd\u8def\u5f84":196,"based\u5bf9\u5e94\u7684\u662f\u5b66\u4e60\u5728\u4e00\u4e2a\u8f93\u5165\u72b6\u6001\u5e94\u8be5\u91c7\u53d6\u4ec0\u4e48\u884c\u52a8":196,"based\u5c31\u662f\u5728\u5b66\u4e60\u8bc4\u4ef7\u4e00\u4e2a\u8f93\u5165\u72b6\u6001\u7684\u4ef7\u503c":196,"based\u624d\u63d0\u9ad8\u4e86\u6574\u4e2a\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u8fed\u4ee3\u7684\u6548\u7387":196,"based\u65b9\u6cd5\u5148\u5b66\u4e60\u503c\u51fd\u6570":196,"based\u65b9\u6cd5\u5e38\u8d70\u7684\u8def\u7ebf":196,"based\u65b9\u6cd5\u7684\u91cd\u70b9\u5728\u4e8e\u73af\u5883\u6a21\u578b":196,"based\u65b9\u6cd5\u76f4\u63a5\u66f4\u65b0\u7b56\u7565":196,"based\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u662f\u5c06\u7b56\u7565\u8fdb\u884c\u53c2\u6570\u5316":196,"based\u7684\u65b9\u6cd5\u7684\u8be6\u7ec6\u7406\u89e3\u53c2\u8003\u6211\u4eec\u6587\u6863\u4e2d\u7684\u5177\u4f53\u7b97\u6cd5":196,"based\u7684\u7b56\u7565\u4f18\u5316":196,"based\u7b97\u6cd5\u6307\u8be5\u7b97\u6cd5\u4f1a\u5b66\u4e60\u73af\u5883\u7684\u8f6c\u79fb\u8fc7\u7a0b\u5e76\u5bf9\u73af\u5883\u8fdb\u884c\u5efa\u6a21":196,"basetime\u5747\u63d0\u4f9btim":142,"boolean":71,"break":[117,118,135,138,169,199,200],"buffer\u6211\u4eec\u53ef\u4ee5\u5c06experience\u5b58\u5165buff":196,"byte":77,"case":[4,43,56,75,94,95,115,117,119,124,126,133,155,157,159,162,165,169,181,183,185,188,197,199,200],"catch":[82,90,136,173],"class":[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,58,67,68,69,73,74,75,79,81,82,83,88,91,92,93,94,95,96,100,101,102,104,105,107,108,120,123,124,126,127,132,133,142,149,153,154,155,156,157,162,163,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,197,199,200,202],"cloning\u5c31\u662f\u7ecf\u5178\u7684offlin":196,"collector\u4e4b\u95f4\u7684\u901a\u4fe1\u95ee\u9898":156,"controller\u4f5c\u4e3a\u4e1a\u52a1\u903b\u8f91\u76f8\u5173\u7684\u7c7b\u5e94\u548cmymaster\u662f\u7ec4\u5408\u5173\u7cfb":153,"coordinator\u4e5f\u4f1a\u5728\u6536\u5230\u8be5\u4fe1\u606f\u540e\u7ee7\u7eed\u53d1\u9001\u4efb\u52a1":156,"coordinator\u5728\u6536\u5230learner\u7684\u6570\u636e\u8bf7\u6c42\u540e":156,"coordinator\u77e5\u9053comm":156,"cpu\u8d1f\u8f7d":145,"critic\u5c31\u662f\u4e00\u8fb9\u53bb\u5b66\u4e60crit":196,"critic\u63d0\u51fa\u7684\u6700\u5927\u71b5\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u6781\u5927\u7684\u63d0\u9ad8\u4e86off":196,"critic\u662f\u4e00\u79cd\u65e2\u5b66\u4e60\u4ef7\u503c\u51fd\u6570\u4e5f\u5b66\u4e60\u7b56\u7565\u51fd\u6570\u7684\u65b9\u6cd5":196,"critic\u7b97\u6cd5\u5982a2c":196,"dataloader\u4fbf\u4f1a\u8c03\u7528comm":156,"dataloader\u53ef\u4ee5\u5c06\u5176\u53d6\u51fa":156,"dataset\u4f5c\u4e3a\u7b97\u6cd5\u7684\u8f93\u5165":196,"dataset\u8f93\u5165":196,"default":[0,8,11,19,27,28,29,33,34,35,37,38,40,41,42,43,45,46,47,48,54,59,62,63,66,67,69,72,73,75,82,89,90,91,94,108,119,120,123,124,127,129,131,133,134,135,138,144,147,149,151,154,161,162,163,166,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,189,190,192,193,199,200,201],"demo\u5982\u4e0b":150,"do":[8,17,19,20,72,75,88,91,92,94,95,108,115,121,123,135,140,142,149,152,153,156,157,161,162,163,165,166,169,173,176,188,191,197,199],"dp\u5177\u6709\u4ee5\u4e0b\u7684\u7279\u70b9":196,"engine\u4e2d":164,"engine\u4e2d\u4e3a\u5206\u5e03\u5f0f\u73af\u5883\u4e0b\u7684\u591a\u673a\u591a\u5361\u8bad\u7ec3\u63d0\u4f9b\u652f\u6301":153,"engine\u4e2d\u9ed8\u8ba4\u5173\u95edhpc_rl\u7684\u4f7f\u7528":150,"engine\u4f1a\u5728import\u65f6\u81ea\u52a8\u8fdb\u884c\u5bfb\u627e\u76f8\u5e94\u7684\u66ff\u4ee3\u5e93\u6216\u4ee3\u7801\u5b9e\u73b0":139,"engine\u65f6\u547d\u4ee4\u884c\u4e2d\u663e\u793a\u7684import":139,"engine\u7684\u76f8\u5173wrapper\u4f1a\u81ea\u52a8\u6839\u636e\u6570\u636e\u5c3a\u5bf8\u8fdb\u884c\u8c03\u6574":150,"enum":[14,15,20,114,158,159],"envwrapper\u88c5\u9970\u8fc7\u7684":146,"exploration\u5373\u662frl\u4e2d\u7684agent\u9700\u8981\u4e0d\u65ad\u7684\u53bb\u63a2\u7d22\u73af\u5883\u7684\u4e0d\u540c\u72b6\u6001":196,"exploration\u56f0\u5883":196,"export":199,"final":[8,17,19,29,72,78,79,90,94,118,131,134,135,155,157,172,179,188,192,199],"float":[4,11,17,19,23,26,27,29,37,38,40,41,42,43,45,46,47,48,56,58,59,62,63,66,68,73,74,75,81,91,92,93,107,108,115,123,134,135,136,142,148,149,156,158,159,172,175,176,177,178,179,181,184,185,186,187,189,190,192],"free\u7684\u65b9\u6cd5\u4e2d":196,"free\u7b97\u6cd5\u5219\u4e0d\u9700\u8981\u5bf9\u73af\u5883\u8fdb\u884c\u5efa\u6a21":196,"function":[3,8,20,27,29,33,34,37,39,40,41,42,45,46,47,48,49,50,52,53,54,56,58,59,63,67,69,74,75,76,79,80,82,83,86,90,91,93,96,100,105,107,110,116,117,120,123,127,128,129,131,132,133,135,142,146,147,149,154,157,162,163,165,166,171,172,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,195,198,200],"gpu\u4e0a\u5e76\u884c\u6267\u884c":150,"hook\u6240\u5904\u7684\u4f4d\u7f6e":[164,165],"hook\u662f\u6700\u57fa\u672c\u7684\u57fa\u7c7b":156,"hook\u7684\u4f18\u5148\u7ea7":[164,165],"hook\u7684\u540d\u79f0":[164,165],"hook\u7684\u7c7b\u578b":[164,165],"hpc_rl\u4f18\u5316\u540e\u7684\u5b9e\u73b0":150,"hpc_rl\u53ea\u652f\u6301\u5176\u4e2d\u67d0\u4e9b\u5e38\u89c1\u7684\u53c2\u6570\u7ec4\u5408":150,"hpc_rl\u5728\u5185\u90e8\u9ed8\u8ba4\u4f1a\u9884\u5148\u5206\u914d\u7b97\u5b50\u6240\u9700\u8981\u7684\u5185\u5b58":150,"import":[31,40,41,43,45,46,47,61,64,66,82,85,108,118,120,123,126,127,129,132,133,135,136,138,142,146,147,148,149,150,151,155,157,160,161,162,164,165,169,172,176,177,179,181,184,186,187,188,189,190,194,195,197,199,200],"int":[0,3,4,8,12,14,15,17,19,20,23,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,56,58,63,67,68,73,74,75,79,81,82,89,90,91,93,94,95,102,105,107,108,114,115,123,124,128,130,131,134,135,136,138,142,156,158,159,162,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,192,199,200],"interaction\u4e3a\u4e00\u4e2a\u72ec\u7acb\u4e8e\u4efb\u4f55\u5177\u4f53\u4e1a\u52a1\u7684\u4ea4\u4e92\u5f0f\u670d\u52a1\u6846\u67b6":153,"interaction\u5206\u4e3a\u4e24\u4e2a\u7aef":153,"interaction\u662f\u5b8c\u5168\u4e0d\u5fc5\u8981\u7684":153,"inv_trans_fn\u4ec5\u652f\u6301r2d2\u4e2d\u7684\u76f8\u5173\u53d8\u6362\u5f62\u5f0f":150,"join\u7b49\u751f\u547d\u5468\u671f\u7ba1\u7406\u65b9\u6cd5":153,"learner\u4e0ecollector\u4ea4\u66ff\u5de5\u4f5c":156,"learner\u4e0ecollector\u540c\u4e00\u65f6\u523b\u90fd\u5728\u5de5\u4f5c":156,"learner\u4e2d\u4f1a\u5c06learner\u5173\u95ed":156,"learner\u4e2d\u5148\u662f\u5b9e\u4f8b\u5316\u4e00\u4e2a":156,"learner\u4e2d\u5b8c\u6210\u7684":156,"learner\u4e2d\u5b9e\u73b0\u7684":156,"learner\u4e2d\u7684":156,"learner\u4ece\u88ab\u5e76\u884cpipeline\u90e8\u7f72":156,"learner\u4fbf\u662f\u8d1f\u8d23\u89e3\u51b3\u5e76\u884c\u6a21\u5f0f\u4e2d\u7684\u8fd9\u4e9b\u95ee\u9898\u7684":156,"learner\u521b\u5efa\u51e0\u4e2a":156,"learner\u53calearn":156,"learner\u53ef\u4ee5\u72ec\u7acb\u5b8c\u6210\u4e32\u884cpipeline\u4e2d\u7684\u8bad\u7ec3\u5de5\u4f5c":156,"learner\u5728\u5efa\u7acb\u540e":156,"learner\u57fa\u7c7b":156,"learner\u5b8c\u6210\u8bad\u7ec3":156,"learner\u5b9e\u73b0":156,"learner\u5c06":156,"learner\u5c06\u8bad\u7ec3\u4fe1\u606f\u5b58\u653e\u5728":156,"learner\u5e76\u4e0d\u5b9e\u9645\u8fdb\u884c\u8bad\u7ec3":156,"learner\u5e76\u4e3a\u5176\u4e00\u6b21\u6216\u591a\u6b21\u5206\u914d\u4efb\u52a1":156,"learner\u5e76\u76f4\u63a5\u5bf9\u5176\u64cd\u4f5c":156,"learner\u5f00\u59cb":156,"learner\u662f\u56e0\u4e3adataloader\u65e0\u6cd5\u83b7\u5f97\u6570\u636e\u800c\u88ab\u963b\u585e\u4f4f\u7684":156,"learner\u662frl\u7b97\u6cd5\u8fdb\u884c\u8bad\u7ec3\u7684\u6838\u5fc3":156,"learner\u6709\u7740\u4e0d\u540c\u7684\u8c03\u7528\u63a5\u53e3\u548c\u8fd0\u884c\u6a21\u5f0f":156,"learner\u670d\u52a1":156,"learner\u6ca1\u6709\u5b8c\u6210\u8bad\u7ec3":156,"learner\u7684":156,"learner\u7684\u4e00\u4e2a\u91cd\u8981\u5de5\u4f5c\u5c31\u662f\u5c06\u8fd9\u4e9bhook\u53ca\u6267\u884chook\u65f6\u6240\u9700\u8981\u7684\u51fd\u6570\u6ce8\u518c\u81f3learner\u4e2d":156,"learner\u7684\u521b\u5efa":156,"learner\u7684\u5de5\u4f5c\u6d41\u7a0b":156,"learner\u7684\u5de5\u4f5c\u6d41\u7a0b\u4e3a":156,"learner\u8fdb\u884c\u8bad\u7ec3":156,"learner\u901a\u8fc7":156,"learner\u9700\u8981\u81ea\u5df1\u53d1\u51fa\u6570\u636e\u8bf7\u6c42":156,"learnerhook\u662f\u5728\u5176\u57fa\u7840\u4e0a\u9488\u5bf9learner\u7684\u5c01\u88c5":156,"learnerslave\u7ee7\u627f\u81easlav":156,"learnerslave\u8fd9\u51e0\u4e2a\u7c7b\u4e4b\u95f4\u7684\u5173\u7cfb\u53ef\u89c1\u7c7b\u56fe\u6240\u793a":156,"loader\u4e13\u6ce8\u4e8e\u903b\u8f91\u7684\u6784\u5efa":158,"loader\u4e3a\u4e00\u4e2a\u8f7b\u91cf\u5316":158,"loader\u7684\u57fa\u672c\u8bbe\u8ba1\u601d\u8def\u662f\u5c06\u4e00\u4e9b\u5e38\u89c1\u7684\u5c0f\u89c4\u6a21\u8f6c\u5316\u4e0e\u9a8c\u8bc1\u6a21\u5757":158,"loader\u7ec4\u4ef6":158,"loader\u8fdb\u884c\u903b\u8f91\u7ec4\u5408\u7684\u539f\u7406":158,"long":[75,95,114,144,147,152,154,190,197,199],"loss\u4e0b\u7684\u7b97\u5b50\u8fdb\u884c\u4f18\u5316":150,"loss\u7684\u57fa\u672c\u5f62\u5f0f":196,"lstm\u4e2d\u7684normalization\u4ec5\u652f\u6301ln":150,"ma\u0144dziuk":183,"master\u548cslave\u7aef\u7684channel\u52a1\u5fc5\u8bbe\u7f6e\u4e3a\u540c\u4e00\u4e2a\u6574\u6570":153,"master\u7aef\u6709\u4e24\u79cd\u542f\u52a8\u65b9\u5f0f":153,"master\u7aef\u7684\u4e3b\u8981\u4efb\u52a1\u662f\u5bf9slave\u7aef\u8fdb\u884c\u8fde\u63a5":153,"mc\u4e0d\u9700\u8981\u73af\u5883\u6a21\u578b":196,"mc\u6216td":196,"mc\u66f4\u65b0\u7684\u76ee\u6807\u662f":196,"mc\u7528\u6837\u672c\u56de\u62a5\u4ee3\u66ff\u5b9e\u9645\u7684\u671f\u671b\u56de\u62a5":196,"model\u57fa\u7840\u4e0a\u505aplan":196,"model\u7684\u5b66\u4e60\u53ef\u4ee5\u6839\u636e\u6a21\u578b\u6784\u9020\u7684\u4e0d\u540c":196,"model\u7684\u5b9a\u4e49\u53ef\u4ee5\u7528\u6570\u5b66\u8868\u793a\u4e3a\u72b6\u6001\u8f6c\u79fb\u5206\u5e03\u548c\u5956\u52b1\u51fd\u6570\u7ec4\u6210\u7684\u5143\u7ec4":196,"mujoco\u63a7\u5236\u4efb\u52a1\u4e2d\u4f7f\u7528\u5411\u91cf\u6765\u8868\u793a\u667a\u80fd\u4f53\u7684\u72b6\u6001":196,"new":[2,4,17,19,23,25,26,27,58,82,89,94,96,101,105,107,112,117,118,120,121,125,129,132,138,147,149,151,153,154,155,157,159,162,165,166,167,169,172,185,188,190,197,199,200],"none\u4e09\u9009\u4e00":158,"norm\u4e13\u6ce8\u4e8e\u6570\u5b66\u8ba1\u7b97":158,"norm\u673a\u5236":158,"normfunc\u673a\u5236":158,"null":[56,133,181],"over\ufb01t":192,"pip\u5b89\u88c5\u65f6\u53ef\u80fd\u51fa\u73b0":139,"pip\u6dfb\u52a0":139,"policy\u5219\u662f\u53ef\u4ee5\u4f7f\u7528\u4e4b\u524d\u8fc7\u7a0b\u4e2d\u7684\u7b56\u7565\u8fdb\u884c\u8bad\u7ec3":196,"policy\u548coff":196,"policy\u5f88\u96be\u5e73\u8861\u63a2\u7d22\u4e0e\u5229\u7528\u7684\u95ee\u9898":196,"policy\u662f\u4f7f\u7528\u5f53\u524d\u7684\u7b56\u7565\u8fdb\u884c\u8bad\u7ec3":196,"policy\u7684\u4f18\u52bf\u5728\u4e8e\u91cd\u590d\u5229\u7528\u6570\u636e\u8fdb\u884c\u8bad\u7ec3":196,"policy\u7684\u7a33\u5b9a\u6027\u548c\u6027\u80fd":196,"policy\u7684\u7b97\u6cd5":196,"public":[182,199],"puigdom\u00e8nech":171,"python\u771f\u652f\u6301\u8fd9\u4e2a":158,"r\u00e9mi":175,"redis\u7684\u76f8\u5173warn":139,"replay\u4f5c\u7528\u5728\u54ea\u91cc":196,"replay\u63d0\u51fa\u7684\u601d\u60f3\u5c31\u662f\u4e3a\u4e86\u8ba9agent\u4ece\u8fc7\u53bb\u7ecf\u5386\u7684transitions\u4e2d\u8fdb\u884c\u5b66\u4e60":196,"repo\u4e2d":168,"return":[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,53,55,56,57,58,59,61,62,63,64,66,67,68,69,71,73,74,75,76,77,78,79,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,101,102,104,105,107,108,114,115,118,120,123,124,125,126,127,128,129,130,133,135,138,142,146,147,149,153,154,155,156,157,158,159,162,163,166,171,172,175,176,178,179,181,185,186,187,188,189,190,191,192,195,198,199,200],"return\u7684\u5b9a\u4e49\u4e3a\u5728\u4e00\u4e2a\u9a6c\u5c14\u53ef\u592b\u8fc7\u7a0b\u4e2d\u4e0a\u4ecet\u65f6\u523b\u5f00\u59cb\u5f80\u540e\u6240\u6709\u7684\u5956\u52b1\u7684\u6709\u8870\u51cf\u7684\u6536\u76ca\u603b\u548c":196,"reward\u6709\u635f\u5931":196,"rl\u53c8\u79f0batch":196,"short":[69,78,95,172,199,201],"slave\u4e00\u76f4\u90fd\u5904\u4e8e\u5f85\u547d\u72b6\u6001":156,"slave\u4f1a\u901a\u8fc7\u9884\u5148\u5546\u5b9a\u7684ip\u5730\u5740\u4e0e\u7aef\u53e3\u53f7\u4e0ecoordinator\u5efa\u7acb\u8fde\u63a5":156,"slave\u4f5c\u4e3a\u7c7b\u7684\u4e00\u4e2a\u79c1\u6709\u5c5e\u6027":153,"slave\u53ef\u4ee5\u8c03\u7528\u8fd9\u4e9b\u51fd\u6570":156,"slave\u5411coordinator\u8fd4\u56de\u6210\u529f\u7684\u4fe1\u606f":156,"slave\u5904":156,"slave\u6536\u5230\u540e\u8c03\u7528comm":156,"slave\u672c\u8eab\u7684\u7ed3\u6784\u548c\u751f\u547d\u5468\u671f\u53d7\u5230\u5e72\u6270":153,"slave\u673a\u5236\u5e2e\u52a9flaskfilesystemlearner\u5b8c\u6210\u4e0ecoordinator\u7684\u901a\u4fe1\u5de5\u4f5c":156,"slave\u7684":156,"slave\u7aef\u7684\u4efb\u52a1\u662f\u4ecemaster\u7aef\u63a5\u6536\u4efb\u52a1\u4fe1\u606f":153,"slave\u7aef\u8bbe\u6709\u6700\u5927\u4efb\u52a1\u6570\u91cf":153,"slave\u8c03\u7528comm":156,"slave\u8fd4\u56de\u7ed9coordin":156,"static":[0,2,4,25,135,149],"super":[123,126,127,156,188],"switch":[130,154,165,189,199,200],"t\u02c6z_j":175,"td3\u7b49\u53c2\u8003\u6211\u4eec\u6587\u6863\u4e2d\u5bf9\u7b97\u6cd5\u7684\u89e3\u91ca":196,"td\u4e0emc\u7684\u5bf9\u6bd4":196,"template\u6765\u6307\u5b9a\u5bf9\u5e94ob":146,"tests\u4e0b\u7684\u5355\u5143\u6d4b\u8bd5\u6765\u9a8c\u8bc1\u7cbe\u5ea6\u548c\u6548\u7387":150,"th\u00e9ophil":174,"throw":[147,181],"time\u5206\u4e3a\u4ee5\u4e0b\u4e24\u7c7b":142,"training\u5373\u662ftraining\u65f6\u4e0d\u4f7f\u7528collector\u4e0e\u73af\u5883\u8fdb\u884c\u4ea4\u4e92":196,"training\u548cofflin":196,"training\u7b97\u6cd5":196,"transition\u53ef\u80fd\u662f\u786e\u5b9a\u7684\u4e5f\u53ef\u80fd\u662f\u968f\u673a\u7684":196,"true":[0,4,11,19,23,25,26,27,29,34,37,38,40,41,42,43,45,46,47,48,56,59,67,68,74,75,79,82,90,91,93,101,120,121,125,126,127,129,131,133,134,135,136,138,146,147,148,149,150,151,153,154,156,162,164,165,166,171,172,175,176,177,178,179,181,184,185,186,187,189,190,191,192,199,200],"try":[8,17,19,82,85,112,117,157,169,195,199],"var":[41,45,67,89,123],"void":[146,147],"while":[45,71,75,107,117,118,120,121,123,125,128,131,134,135,144,146,147,157,162,175,177,178,179,180,181,184,185,188,191,192,197,199,200],"windows\u4e0b\u53ef\u4ee5\u4f7f\u7528":168,"x\u662f\u5426\u5728\u533a\u95f4":158,A:[0,2,3,8,11,19,20,23,25,26,27,38,43,57,67,73,75,76,82,92,93,94,96,101,105,107,108,117,118,126,134,135,151,152,153,155,157,158,159,161,165,171,174,175,176,177,178,180,183,185,186,187,188,190,192,198,200,201],AND:[181,185],And:[0,43,107,127,128,129,131,157,161,162,163,166,167,181,188,195,199,200,202],As:[92,95,108,121,123,131,133,135,144,157,160,161,163,165,173,187,190,197,199,200],At:[79,147,149,155,181],But:[115,117,123,125,155,157,180,188],By:[29,78,115,117,123,131,149,154,169,172,179,183,187,190,199],FOR:[178,189,192],For:[27,40,41,43,46,58,75,77,78,95,96,108,114,115,117,120,121,123,125,126,127,130,131,132,133,134,135,136,140,147,149,151,154,155,157,160,162,165,167,169,172,175,177,178,179,181,186,187,188,190,191,194,197,199,200],IF:[178,189,192],IN:[75,185],IS:[40,41,43,45,46,108,129,176,177,181,184,186],If:[0,19,25,26,27,40,43,45,46,47,49,50,56,75,78,79,82,90,93,94,101,107,112,115,123,124,125,131,132,138,147,149,151,154,155,157,160,162,163,165,166,169,174,178,179,181,187,188,189,192,193,194,195,197,199,200,201],In:[25,27,43,45,47,53,54,58,69,75,94,95,96,105,107,112,114,115,117,118,119,120,121,124,125,126,127,129,131,132,133,134,135,136,138,144,147,149,151,154,155,157,159,161,162,163,165,167,168,169,172,173,175,176,177,178,179,181,184,187,188,189,190,192,193,197,199,200,201],Is:[152,166],It:[4,27,38,43,47,48,92,115,117,118,120,127,129,134,135,147,149,151,154,155,157,159,160,163,165,169,172,175,179,187,190,191,194,197,199,200],Its:[125,136,154,157,173],No:[4,14,15,163,173,194],Not:[108,114,166],ON:185,Of:197,On:[149,177,188,197],One:[8,25,53,135,179,189,199],Or:[3,123,127,135,154,169],Such:[134,142],That:[154,190],The:[3,4,11,17,19,23,25,26,27,28,29,31,33,34,37,38,39,40,41,42,43,45,46,47,48,49,52,53,54,56,58,67,76,77,78,79,81,82,84,89,90,91,92,93,94,96,100,101,105,107,108,112,113,114,115,117,118,119,121,123,124,126,127,128,132,133,134,135,136,138,140,144,147,149,151,154,155,157,159,161,162,163,165,166,167,169,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,189,190,191,192,193,194,195,197,200,201],Then:[79,91,105,108,118,123,124,125,126,128,129,132,133,157,163,172,175,181,188,189,197,199,200],There:[63,64,94,121,125,127,134,135,154,157,160,165,167,169,172,183,184,197,199,201],These:[133,142,151,157,169,173,177,186,199],To:[124,127,131,133,136,144,147,149,155,161,172,173,177,178,194,195,197,199,200],Will:[96,105,156,166,175,187],With:[21,108,124,151,169,172,190,197,199],_1:191,_2:[172,191],_:[78,117,123,138,142,146,147,156,166,171,172,174,175,176,177,178,179,181,183,184,185,186,187,189,191,192,193,199,200],__:78,_____________________________________:75,__________________________________________:75,_____________________________________________________________________________:75,__avg_func:[123,142],__call__:[58,83,107,123,156,157,164,165],__contains__:19,__del__:[100,102],__delitem__:19,__enter__:[8,88,93,153,154],__exit__:[8,88,93,153,154],__getattr__:108,__getitem__:[19,26,91,94],__init__:[0,2,4,11,12,14,15,17,19,20,21,23,25,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,50,52,53,54,56,58,73,75,79,81,82,88,91,93,94,95,96,100,101,102,104,105,107,108,120,123,124,126,127,135,142,145,146,147,148,149,155,156,157,162,163,166,171,174,175,176,177,178,179,181,185,186,187,188,192,199,202],__iter__:79,__main__:[127,135,136,138,142,150,151,153,154,187],__max_func:123,__min_func:123,__mul__:26,__name__:[127,135,136,138,142,150,151,153,154,187],__next__:79,__property_nam:142,__regist:[123,142],__repr__:[148,149,174],__setitem__:91,__version__:195,_a_:52,_act_shap:189,_actor_update_freq:192,_adder:128,_after_connect:19,_after_disconnect:19,_after_forward:75,_after_hook_typ:20,_after_new_task:19,_alpha:[58,189],_alpha_optim:189,_batch_mn_pdf:52,_before_connect:[19,21,23],_before_disconnect:[19,21,23],_before_forward:75,_before_hook_typ:20,_before_new_task:[19,153,154],_before_task:[21,23],_begin_tim:[123,142],_burnin_step:133,_calcul:[158,159],_calculate2:[158,159],_cfg:[40,41,45,46,47,123,127,128,133,156,162,166,178,189,192],_check:[148,149],_checkpointer_manag:[156,166],_collect_model:[133,162],_collector_envstep:123,_core:[148,149],_count:4,_create_collector:96,_create_learn:[156,157],_create_model:162,_cuda:189,_cut_ob:38,_data_demand_queu:[156,157],_data_preprocess_learn:[40,41,45,46,133,176,177,184,186],_data_result_queu:[156,157],_dataload:[107,156],_debug:81,_delai:192,_detail:[148,149],_devic:[156,166],_durat:142,_dynamic_se:131,_end_flag:156,_end_tim:[123,142],_env:[94,131],_env_dynamic_se:131,_env_num:131,_env_se:131,_epsilon:4,_error_connect:19,_error_disconnect:19,_error_hook_typ:20,_error_new_task:19,_eval_model:133,_factor:[40,41,46,176,177,186],_file_to_dict:0,_finished_task:156,_forward_collect:[39,40,41,42,43,45,46,47,48,129,162,176,177,184,186],_forward_colleect:129,_forward_ev:[39,40,41,42,43,45,46,47,162,184],_forward_eval_reset_ev:[40,41,46,176,177,186],_forward_learn:[39,40,41,42,43,45,46,47,48,123,126,128,129,133,162,176,177,178,184,186,192,199],_forward_learn_cnt:192,_freq:123,_gamma:[126,128,129,178,189,191,192],_get_action_dist:53,_get_attribut:162,_get_batch_s:[45,125,184],_get_collect_oppon:155,_get_flatten_s:28,_get_job_info:155,_get_null_transit:181,_get_ob:4,_get_oppon:155,_get_state_dist:53,_get_timestep:96,_get_train_sampl:[39,40,41,43,45,46,48,128,133,162,172,176,177,181,184,186],_gpu:[43,179],_hook:[156,166],_init:[148,149],_init_:188,_init_cfg:155,_init_collect:[39,40,41,42,43,45,46,47,48,128,133,162,176,177,184,186],_init_ev:[39,40,41,42,43,45,46,47,133,176,177,184,186],_init_leagu:155,_init_learn:[39,40,41,42,43,45,46,47,48,128,133,176,177,178,184,186,192],_init_multi_gpu_set:127,_init_play:25,_instanc:[148,149],_iresponseinform:[13,16],_is_auto_alpha:189,_is_trained_enough:27,_islaveconnect:[16,18],_iter:76,_itertargettyp:76,_itertyp:76,_j:191,_last_agent_step:27,_last_it:[156,166],_launch_job:155,_learn_info_queu:[156,157],_learn_model:[126,127,133,178,189,192],_learner_uid:[156,166],_len:[43,47,179],_list:123,_load_path:[156,166],_load_state_dict_collect:162,_load_state_dict_ev:162,_load_state_dict_learn:[40,41,43,45,46,162,176,177,184,186],_log_alpha:[189,191],_log_buff:[156,166],_logger:[156,166],_loss_weight:[40,176],_lost_connect:23,_mean:4,_metadata_queu:96,_model:[133,162,178,190,192],_monitor_vars_learn:[41,45,123,162,177,184],_mutate_play:[27,155],_name:[148,149,156,166],_next_data:156,_nstep:[126,128,129,133],_nstep_return:128,_obs_shap:189,_optim:[123,127],_optimizer_ac:45,_optimizer_actor:[178,192],_optimizer_aux_crit:45,_optimizer_crit:[178,192],_optimizer_polici:189,_optimizer_q:189,_parent_id:27,_per_collect:[41,45,177,184],_pfsp_branch:155,_polici:[94,107,156,164,165],_policy_embedding_s:189,_policy_net:189,_policy_net_forward:189,_posit:156,_preprocess_data:35,_print_result:[153,154],_prioriti:156,_priority_info:[156,166],_process_task:[21,23,96,153,154,156,157],_process_transit:[39,40,41,42,43,45,46,47,125,129,133,162,176,177,184,186],_prop_nam:142,_q:191,_rank:[156,166],_rate:[43,47,179],_rate_actor:[42,178,192],_rate_crit:[42,178,192],_rate_polici:189,_rate_q:189,_rate_valu:189,_reparameter:189,_reset_collect:[40,41,46,162,176,177,186],_reset_ev:[40,46,162],_reset_learn:[40,41,46,162,176,177,186],_result_valu:[153,154],_running_mean_std_rnd:188,_running_mean_std_rnd_ob:188,_s_:52,_sec:108,_seed:131,_set_attribut:162,_setup_global_encod:[38,176,186],_setup_hook:[107,156,166],_setup_wrapp:[107,156,166],_shape:4,_sigma_:52,_snapshot:[27,155],_soft_q_embedding_s:189,_soft_q_net:189,_soft_q_net_forward:189,_sp_branch:155,_start_tim:142,_state:124,_state_dict:108,_state_dict_collect:162,_state_dict_ev:162,_state_dict_learn:[40,41,43,45,46,162,176,177,184,186],_sum:142,_t:[171,172,185,191],_target_entropi:[189,191],_target_model:[126,133,162,178,192],_task_process:[153,154],_tb_logger:[156,166],_time:142,_time_wrapp:[107,166],_timer:[156,166],_tmp_conn:[153,154],_total_agent_step:27,_train:[52,53,54,188],_train_iter:123,_twin_crit:[178,192],_twin_q:189,_unroll_len:181,_update_play:155,_use_cuda:[156,166],_use_distribut:[156,166],_used_data:108,_valu:[123,142],_var:4,_weight:[43,47,179],_world_siz:156,_wrapper_tim:[156,166],_x0:58,_x:58,_z:172,a0fd:134,a1:[53,139,140],a2:[53,139,140],a2c:[6,44,60,128,133,141,181,182,194,197,199,202],a2c_data:55,a2c_error:[60,171],a2c_loss:[55,171],a2cpolici:[6,44,171],a3:[139,140],a4:[139,140],a_0:[117,172,196,197],a_1:117,a_:[171,172,176,178,181,185,187,191,192,196,197],a_i:181,a_k:172,a_layer_num:29,a_n:[196,197],a_siz:53,a_t:[133,172,179,181,191,196,197],aa:[158,159],aaai:177,ab:[46,54,65,75,123,126,129,153,154,171,172,175,178,179,181,183,184,185,186,187,188,190,192,193],abbeel:177,abc:156,abhishek:174,abl:[163,169,184],ablat:173,abnorm:[148,149,199],abort:135,about:[4,27,63,75,117,127,131,133,134,135,147,160,161,162,166,169,174,179,188,190,195,197,199,200,201],abov:[8,17,56,114,115,144,149,154,155,157,161,162,169,177,181,190,193,197,199,200,201],absolut:[91,142,179,187],abstractmethod:156,abstractproperti:156,abus:154,academ:[149,194],academia:120,acceler:[127,147,151],accept:[177,186],acces:169,access:[26,29,79,81,149,167,188,200],accord:[3,4,27,28,29,33,34,37,39,40,41,42,45,46,47,48,56,58,74,75,77,88,94,95,96,101,102,107,108,115,120,128,129,136,147,149,151,154,155,156,162,163,165,166,169,171,175,178,179,181,183,185,187,188,189,192,195,197,199,200],accordingli:[126,128,169,172,197],account:197,accumul:[41,63,130,147,190,192,197],accur:[4,52,53,54,95,154,199],accuraci:151,acer:[182,194],acer_policy_error:172,acer_trust_region_upd:172,acer_value_error:172,acerpolici:172,achiev:[17,19,124,127,149,165,173,175,183,184,187,188,193],acquir:[41,47,48,88,130,135,155,157,166,193,197,199,200],acquire_spac:82,across:[4,75,120],act:[58,63,75,134,147,148,149,155,172,181,197],act_func:75,act_shap:[4,148,149],act_spac:[130,135,148,149],actiion:120,action:[2,3,4,6,16,19,22,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,57,58,61,62,63,64,66,69,96,108,117,120,123,124,126,128,129,130,133,146,147,148,149,160,163,165,167,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,198,199,201],action_arg:[33,178,192],action_args_shap:[33,178,192],action_dim:[63,190],action_distribut:[43,123],action_mask:[35,138,177,190],action_nois:[164,165,192],action_num:126,action_shap:[33,34,35,37,38,126,127,135,136,171,175,176,177,178,179,181,185,186,187,189,192,199],action_spac:[126,130],action_type_shap:[33,178,192],actionnoisewrapp:[124,164,165],actions_dict:3,activ:[6,19,25,27,28,29,33,34,37,70,92,142,155,171,175,178,179,181,185,187,191,192,195],active_env:[3,146,147],activeplay:[25,155],acton:4,actor:[33,34,35,41,42,45,55,66,123,125,160,171,172,174,177,181,182,185,189,191,198,199],actor_:[42,178,192],actor_data:[178,192],actor_gradi:172,actor_head_hidden_s:[33,34,171,178,181,185,192],actor_head_layer_num:[33,34,171,178,181,185,192],actor_head_typ:[33,178,192],actor_hidden_size_list:[35,177],actor_loss:[172,178,192],actor_output:[33,34,171,178,181,185,192],actor_update_freq:192,actual:[82,112,114,115,121,128,149,153,154,157,165,197],actvat:75,ad:[26,67,75,81,147,149,154,155,159,160,165,166,167,169,178,192,195],adam:[6,70,178,180,188,189,192],adapt:[120,124,133,162,165,185,187,188,197,202],adaptivein:75,add:[25,26,38,42,67,69,75,82,91,101,102,107,108,117,120,123,124,127,129,131,132,133,140,142,149,151,156,157,159,165,166,168,169,176,178,186,188,190,192,197,199,200],add_learner_hook:[107,156],add_num:67,add_play:26,add_scalar:[123,138,200],add_used_data:108,add_wrapp:[164,165],addedr:107,adder:[6,60,133,172,181,199,202],addit:[75,120,154,157,163,173,184,185,186,200],addition:[27,96,123,144,155,174,191],address:[17,19,23,155,157,177,192],adjust:[151,165,191,199],adopt:[127,163,166,179,187,188,191,199],adv:[39,55,56,59,62,123,171,181,185],adv_:[45,184],adv_abs_max:[45,123],advanc:[4,108,114,147,154,161,163,180,184,188],advanced_buff:[108,163,202],advancedreplaybuff:[125,152,199,200],advantag:[45,55,56,59,66,110,116,154,171,177,179,181,184,187,190,197,199],advantage_n:172,advantage_retrac:172,adversari:180,advis:194,affect:[142,151,154,163],afoura:177,after:[0,4,17,19,20,23,26,27,28,29,33,34,37,38,39,40,41,42,43,45,46,47,48,56,67,68,75,81,92,96,112,120,123,125,127,129,133,134,138,147,149,151,153,154,155,156,157,159,162,163,165,168,169,171,172,173,175,176,177,178,179,181,184,185,186,187,188,192,194,195,197,199,200,201],after_connect:17,after_disconnect:17,after_forward:124,after_it:[107,156,164,165,166,199],after_run:[107,156,164,165,166,199,200],after_task_start:20,afterward:[96,114,123,157,166,188],ag:[42,114,161,178,189,192],again:[128,133,147,155,157,163],against:[25,27,155,172,187,189],agarw:187,agent57:188,agent:[27,35,38,40,41,46,57,117,120,125,133,135,136,138,149,155,174,176,177,180,186,188,190,194,197,200],agent_alone_st:[38,176],agent_colla_alone_q:40,agent_id:35,agent_num:[35,38,40,41,46,148,149,176,177,186],agent_q:[38,176,186],agent_q_act:[38,176,186],agent_st:[35,38,176,177,186],aggreg:[127,161,187,194,199],agre:[157,160],ai:[138,194,199],aim:[0,34,93,133,135,161,162,169,171,185,190,191,199],aka:[40,41,42,43,45,46,47,48,162,175,176,177,178,179,184,186,187,189,192],al:[135,173,174,176,177,180,186,188],alarm:93,alec:185,aleksand:185,alex:[171,179],alexand:178,alg1:[178,189,192],alg:[133,188],algorithm:[39,40,41,42,43,45,46,47,48,53,63,101,108,117,121,124,125,128,129,131,133,136,151,152,155,160,162,163,168,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,197,199,200,202],alia:17,align:[178,189,191,192],aliv:[17,19,92,153,154],all:[2,3,4,26,27,55,57,62,63,66,68,75,77,79,81,82,89,90,91,95,107,108,121,123,124,125,127,128,131,134,136,138,144,147,149,151,152,153,154,155,157,160,161,162,163,165,167,169,172,173,174,177,179,180,181,188,197,199,200,201],allai:38,allevi:155,alli:[38,176],alloc:151,allow:[78,82,124,133,174,177,184,187,197,199],allreduc:[86,127],ally_featur:38,ally_feature_rang:[38,176],almost:[120,199],alon:[38,154,176],alone_obs_shap:[38,176],along:[126,133,179,197],alpha:[40,73,129,176,189,190,191],alpha_loss:[189,191],alphabet:26,alphabetiv:26,alphago:[182,183,194],alphagozero:[182,194],alphastar:[25,75,155,181,194],alphastar_fake_data:25,alreadi:[15,27,62,132,138,154,195,199],also:[3,4,25,27,28,53,63,64,75,82,92,107,114,115,117,120,123,124,125,126,128,129,131,133,135,138,142,149,154,155,157,159,160,162,163,165,167,169,173,180,184,185,187,188,190,193,194,195,197,199,200],alter:126,altern:[118,140,171,177,184,187,199],although:[157,173,191],alwai:[82,92,123,149,155,157,160,166],ambigu:159,among:[26,62,107,108,123,127,157,162,175,177,180,199],amount:[4,151,154,187,188,192,197,201],amsgrad:73,an:[2,3,4,19,25,26,27,43,47,49,50,56,58,67,69,75,79,82,90,92,96,105,107,108,117,118,119,121,122,123,125,126,128,129,130,131,133,134,135,136,138,147,149,151,152,155,157,159,161,162,163,165,169,171,172,173,174,175,176,177,178,179,180,181,183,184,186,187,188,189,190,191,192,193,194,197,199,200,201,202],anaconda:195,analog:154,analysi:[152,191],analyst:191,analyz:187,anca:190,andoptim:41,andrew:185,ani:[2,3,4,8,12,17,19,20,21,23,39,40,41,42,43,45,46,47,48,49,50,56,68,74,78,79,81,82,84,89,90,92,94,95,96,108,117,123,124,127,128,129,133,153,154,156,159,162,163,165,166,167,169,172,181,183,188,193,195,199],annal:173,anneal:[129,179,187,199],anneal_step:129,annot:82,anoth:[15,17,115,179,197,199],answer:[196,197],answerbi:197,ant:141,antonogl:[179,193],any_dim:[40,46,78],anymor:108,anyon:199,anyth:[8,17,153,154,199],ap:129,apart:173,api:[107,127,133,151,155,167,194],api_doc:[28,29,31,37],api_vers:87,app:[6,9,16,161],appear:[3,114,123,140],append:[4,94,126,172,181,189,190],appli:[4,19,23,75,120,127,162,172,175,178,188,189,197,199,200],applic:[133,183,191,194],application_entri:[117,202],approach:[117,155,176,177,183,188,190,192,193,197],appropri:[154,159,169,190],approx:[177,178],approx_kl:[45,123],approx_kl_avg:123,approxeq:193,approxim:[144,172,175,179,192,193,197,199],ar:[3,4,14,15,17,19,20,23,26,27,33,39,40,41,42,43,45,46,47,48,53,55,57,62,66,72,75,78,79,82,91,94,96,105,107,108,114,115,117,118,120,121,123,124,125,127,129,131,132,134,135,136,138,140,144,147,149,151,152,155,156,157,159,160,161,162,163,165,167,169,172,173,174,175,178,179,181,183,184,185,186,187,188,189,190,192,193,195,197,199,200,201],arang:190,arbitrarili:200,architectur:[37,48,66,134,160,161,174,176,179,181,186,187,194],archiv:[155,169],area:[191,195],arg:[27,40,41,42,43,45,46,47,48,67,75,83,88,90,92,93,94,96,107,120,124,146,147,156,161,166,172,175,176,177,178,179,181,184,186,187,189,190,191,192],argiment:69,argmax:[38,39,40,41,45,46,47,69,75,124,176,186,187,188,199],argmax_act:133,argmax_sampl:[164,165,199],argmaxsamplewrapp:[124,164,165],argument:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,58,59,61,62,63,64,66,67,68,69,71,72,73,74,75,76,77,78,79,81,82,84,85,87,88,89,90,91,92,93,94,95,96,100,101,102,104,105,107,108,124,126,129,131,160,166,171,172,175,176,177,178,179,181,185,186,187,190,192,199],argumentskei:[3,25,33,35,40,41,43,45,46,108,177,178,192],argumet:4,arm:[136,173,193],around:[178,195],arrai:[3,4,91,126,135,136,175,187,192,193],arrang:[154,160],arrow:126,arthur:193,articl:93,articul:167,artifici:[173,177],arxiv:[42,46,53,54,55,59,62,66,75,171,172,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,192,193],ascent:[178,189,192],ask:132,aspect:[173,179],assembl:159,assert:[29,33,34,37,72,126,127,131,153,154,156,166,171,175,178,179,181,185,187,189,190,192,199],assess:197,assign:[43,47,56,88,91,104,129,136,152,155,157,162,176,177,179,188,197],assign_collector:104,assign_learn:104,assigne:[166,167],assum:[4,26,63,117,123,181],assumpt:117,astyp:4,asymmetr:175,asymptot:197,async:[80,86,90,107,143,144,146,147,166],async_op:90,async_process:145,async_train_queu:[79,145],asyncdataload:[80,145,156,157],asynchron:[79,157,171,199],asyncsubprocessenvmanag:[5,146,147,199],atari:[4,120,126,127,131,132,133,137,145,148,149,152,179,187,188,191,193,194,195,197,202],atari_env:[131,132,135],atarienv:135,atlanti:187,atoc:[133,182,194,202],atocpolici:174,atom:[37,48,175,187],attempt:[92,157,183],attent:[6,38,70,115,121,123,125,142,153,154,159,169,174,176,195,199],attention_s:[38,176],attibut:4,attr:[67,123],attribut:[27,49,50,52,53,54,69,75,107,123,130,134,147,149,154,157,162,163,166,176,188,199,200],audruna:186,augment:[189,190,191],auth:[14,15],authent:17,author:[165,175,182,185,187,193],auto:[0,14,15,124,189,191,199],auto_alpha:189,auto_checkpoint:[6,70,107,156],auto_reset:[146,147],autolog:[123,202],automat:[2,3,17,19,90,93,112,124,131,135,136,140,142,147,151,153,154,165,166,167,169,199,200],autonom:177,aux_:[45,184],aux_freq:123,aux_loss:[45,123],aux_value_loss:[45,123],aux_value_loss_avg:123,auxiliari:[4,45,123,184,193],auxiliary_loss:[45,123],auxiliary_loss_avg:123,avail:[130,138,140,183],aver:[42,178,189,192],averag:[45,63,64,95,108,119,123,134,135,142,144,171,172,178,187,188,191,192,199],avg:[123,142],avg_envstep_per_episod:134,avg_envstep_per_sec:134,avg_episode_per_sec:134,avg_pi:172,avg_sample_per_episod:134,avg_step_per_episod:134,avg_time_per_episod:134,avg_time_per_step:134,avg_train_sample_per_sec:134,avglist:142,aviv:177,avoid:[115,120,144,154,159,167,169,184,185,189,197],awai:[26,181],awak:20,away_id:26,axi:[188,189,191,201],azar:187,b440:134,b4a39461a268_451909_logg:134,b:[8,29,33,34,37,38,40,46,55,57,59,61,62,63,66,71,74,75,77,78,82,114,115,126,129,150,151,153,154,155,158,159,168,169,171,173,175,176,178,179,181,183,185,186,187,189,190,192],b_:[175,191],back:[72,130,140,157,174,189,199],backpropag:[127,183],backward:[39,40,41,42,45,46,47,48,107,127,151,172,178,188,189,192],backwardli:[172,174],badia:171,balanc:[41,45,119,162,163,177,183,184,188,190,197,199],bandit:[136,173,183],bandit_nois:136,bapst:172,bar:[172,181,183,187,191],barto:63,bartosz:183,base:[0,6,13,16,19,20,23,27,29,50,51,58,63,74,83,94,96,101,105,107,114,120,123,124,128,136,138,143,144,145,147,149,151,152,153,154,155,156,159,162,164,165,166,168,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,198,199,200,202],base_buff:[108,163,202],base_comm_collector:[6,98],base_comm_learn:[105,156,157],base_env:[5,6,148,149],base_env_manag:[5,6,94,152,199],base_leagu:[6,24,155,202],base_learn:[0,6,105,106,123,156,157,202],base_learner_default_config:[156,166],base_parallel_collector:[96,202],base_parallel_command:[6,103,202],base_polici:202,base_reward_estim:[6,51],base_reward_model:[49,202],base_serial_collector:[6,98,202],base_serial_command:[6,103,202],base_serial_evalu:[6,98,202],baseclass:[94,96,105],basecommcollector:98,basecommlearn:[106,152,156],baseenv:[5,152],baseenvinfo:[2,3,130,147,148,149],baseenvmanag:[5,94,138,152,199,200],baseenvtimestep:[3,148,149],baseleagu:155,baselearn:[0,101,106,123,138,156,157,166,200],baselin:[4,66,120,143,144,177,178,181,187,189,192],baselinevac:138,basemodelwrapp:[124,164,165],basenois:60,baseparallelcollector:96,baserewardmodel:[50,51,188],baseserialcollector:[0,101],baseserialevalu:[98,199,200],basetim:[108,123,142],bash:161,basi:[149,165,197],basic:[2,8,12,17,27,74,75,134,135,144,149,151,159,160,162,165,169,173,194,198,199],batch:[4,33,34,37,38,40,41,43,45,46,55,56,57,59,61,62,63,66,71,75,78,79,105,118,121,123,124,127,133,145,165,169,171,172,175,177,178,179,181,184,185,187,188,189,192,197,199],batch_:[43,47,179],batch_rang:190,batch_siz:[38,40,41,46,63,75,78,79,102,105,108,118,119,121,125,129,133,135,136,145,156,162,163,176,186,188,190,199,200],batchsiz:[63,64],batra:174,battl:[25,26,199],battlerecorddict:155,battlesharedpayoff:[27,155],bb:[153,154,158,159],bc:[117,190],bc_loss:[123,172],bc_weight:[45,184],beam:193,bear:144,beat:27,beaten:27,becaus:[48,69,115,121,132,133,134,149,151,154,157,163,175,176,179,187,188,193,197,199],becom:[133,155,173,181,191],been:[27,92,120,132,147,149,153,154,159,165,173,179,188,195,197,199],befor:[17,19,20,23,29,38,40,43,45,46,75,90,92,93,107,118,144,147,149,154,156,157,165,166,167,169,174,176,177,186,187,188,193,197,199,200],before_forward:124,before_it:[107,156,164,165,166,199],before_run:[107,156,164,165,166,199,200],before_task_start:20,begainn:75,begin:[54,75,107,117,122,133,135,151,166,167,172,175,178,186,187,188,189,191,192,193,194,199,200],beginn:[165,194],behavior:[45,117,133,136,149,165,172,180,181,199],behavioral_clon:[45,184],behavioral_cloning_loss:[45,123],behaviour:[17,19,23,61,66,197],behaviour_act:[61,66],behaviour_output:[61,66,181],behind:[4,166,181,188],bei:177,being:[147,149,154,157],believ:175,bellemar:175,bellman:[29,175,178,179,181,190,196,197],belong:[171,197],below:[112,120,135,138,147,179,180,187,188,190,193,199,200,201],benchmark:[136,152,171,175,176,177,178,179,181,182,184,185,186,187,189,192],benefit:[177,197],bengio:187,besid:[132,149,167,193,195,199],best:[134,154,155,184,190,194],beta:[73,108,129,163,178],beta_:184,beta_funct:202,beta_function_typ:29,better:[120,130,152,160,173,177,179,183,188,191,193,197,199],between:[19,26,27,40,41,45,46,66,69,75,93,96,118,128,133,138,147,152,155,157,163,165,171,172,173,175,176,177,180,181,184,186,188,189,191,192,193,197,199,201],beyond:[63,173],bia:[45,59,95,129,133,134,171,172,179,184,192,197,199],bias:[40,41,43,45,46,47,129,162,176,177,179,184,186],bidirect:174,big16:145,big64:145,big:[143,144,163,181,189,199],bigger:[40,41,43,45,46,47,48,162,163,172,175,176,177,179,181,184,186,187,188],bigtriangledown_:191,bilal:187,bilin:75,bilinearupsampl:[6,70],bin:[4,161,195],binari:[75,77,169,174,197],binary_encod:[6,70],bipedalwalk:202,bit:131,bitflip:[121,202],bitflip_dqn_main:121,blind:27,blob:63,block:[37,75,77,92,152,153,157,187],blog:[93,188],blue:[158,159],bn:75,board:173,bodi:197,boldsymbol:187,boltzmann:[190,191],bond:187,bonu:[4,181,188],bool:[0,3,4,11,12,17,19,20,23,25,26,27,28,29,33,34,37,38,40,41,42,43,45,46,47,48,56,61,62,63,67,68,69,72,73,74,75,81,82,84,89,90,91,93,94,95,100,101,102,108,124,127,131,148,149,162,171,172,175,176,177,178,179,181,184,185,186,187,189,190,192,199],booltensor:[63,190],bootstrap:[41,63,128,192,193],bootstrap_terminal_valu:64,bootstrap_valu:[63,64,181],born:173,borrow:120,bot:27,both:[21,23,28,33,75,115,117,118,120,144,155,157,163,167,171,172,178,179,181,184,185,187,188,190,192,197,199],bottleneck:75,bottom:[123,135,199],bound:[130,183,189,192],bound_typ:[29,34,171,181,185],boundari:120,box2d:[187,202],box:[135,195],bozhidar:177,brain:183,branch:[27,167,168,169,195],branch_prob:[27,155],breakout:135,brief:155,bring:[133,175,187],broadcast:[86,127],broken:199,brownian:178,browser:167,bs:133,bsuit:[137,194],bsuite_env:136,bsuite_id:136,bsuite_num_episod:136,bsuiteenv:136,buffer:[0,3,4,6,39,42,48,62,68,79,94,101,102,107,118,122,123,129,130,132,134,152,155,156,157,162,166,172,178,179,181,184,187,189,190,191,192,194,196,197,200],buffer_:108,buffer_id:[101,102],buffer_logg:134,buffer_tb_logg:134,bug:[168,169],build:[31,67,75,89,93,107,114,138,153,154,159,166,167,183,189,195,199,200],build_activ:[6,70],build_ce_criterion:[6,70],build_checkpoint_help:[6,70,156,166],build_learner_hook_by_cfg:[106,156,164,165],build_log_buff:[6,70,156,166],build_logg:[86,156,166],build_norm:[6,70],build_time_help:86,builg:68,built:[133,159],builtin:27,burda:188,burn:47,burnin:47,burnin_nstep_ob:133,burnin_ob:47,burnin_output:133,burnin_output_target:133,burnin_step:[47,133],busi:[144,152],button:[126,135,138],c029d882:134,c51:[37,133,141,150,151,182,187,194,202],c51dqn:[36,175],c51polici:175,c:[8,62,66,75,114,115,132,155,158,159,161,172,181,183,184,185,192,195,199,200],c_:[173,181,183],c_clip_ratio:[66,172,181],c_i:181,cach:[6,40,41,45,46,80,86,94],cachepool:98,calcuat:172,calcul:[4,38,40,41,43,45,46,47,48,56,59,62,63,66,69,74,75,82,108,110,114,116,123,126,128,129,133,142,151,155,159,160,165,172,176,178,179,181,182,185,186,189,190,192,197,199],call:[0,2,4,19,20,25,27,39,40,41,42,43,45,46,47,48,53,56,58,67,82,83,90,91,92,96,105,107,112,115,123,124,127,131,132,133,135,147,149,154,155,157,160,162,165,179,181,191,193,197,199,200],call_hook:[107,156,157,166,200],callabl:[2,3,8,17,20,27,63,67,71,73,75,76,77,79,82,90,91,92,96,100,105,107,124,156,166],callable_iter:81,callback:[20,96,100,105,153,154,157],callback_fn:[96,100],caller:[91,92],can:[0,2,8,11,12,17,19,21,23,25,26,27,35,40,41,43,45,46,47,48,49,50,56,58,62,68,75,78,79,81,82,90,92,93,94,95,96,101,105,107,108,112,114,115,117,118,119,120,123,124,125,126,129,130,131,132,133,134,135,136,138,140,147,149,151,154,155,157,159,160,161,162,163,165,166,167,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,194,195,197,199,200,202],cancel:19,cannot:[19,23,69,154,155,157,194,197],capabl:136,capac:[91,169,187],capit:[166,167],caption:[178,189,191,192],captur:[136,154],card:[121,154,163,199],care:[131,135,154,199],carefulli:[132,136,181],carla:[143,144,199],carlo:[128,173,183,193,196,197],carri:154,cartesian:126,cartpol:[118,125,150,151,190,199,200,201,202],cartpole_a2c_config:[150,151],cartpole_a2c_create_config:[150,151],cartpole_dqn:[134,200],cartpole_dqn_config:[161,199,200],cartpole_dqn_default_config:199,cartpole_dqn_ev:200,cartpole_dqn_main:[199,200],cartpole_ppg_config:125,cartpole_ppg_create_config:125,cartpole_ppg_main:125,cartpole_ppo_config:117,cartpole_ppo_create_config:117,cartpole_ppo_main:199,cartpole_rainbow_config:130,case1:[33,178,192],case2:[33,178,192],case_sensit:[114,158,159],cat:[161,181,189],catagor:69,catastroph:[117,197],categor:[69,171,181,190],categori:[27,155,197],categoricalpd:[6,70],categoricalpdpytorch:[6,70],caus:[47,92,129,135,147,151,154,169,179,188],causal:180,cc:[8,177],cd1cdd98caab8602ac6501ac:8,cd:[135,136,138,195],cdot:[171,172,176,177,184,189,191],cell:[29,75,168,169],center:[73,178],cento:195,central:[35,174,176,177,186,202],ceph:[84,85,139,140],certain:[68,95,134,147,151,155,165,176,183,197],cfg:[0,2,3,25,26,27,31,39,40,41,42,43,45,46,47,48,49,52,53,54,67,74,82,87,93,94,96,100,101,102,105,107,108,118,121,125,130,132,136,138,140,146,147,155,156,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,199,200],cfg_dict:0,cfg_text:0,chain:178,challeng:[136,174,176,177,178,183,186,193],champion:173,chang:[19,45,68,82,91,114,120,121,123,124,125,126,127,129,133,138,149,165,169,172,173,177,178,185,187,189,191,192,197,199],channel:[14,15,17,19,23,75,135,147,153,154,174],channel_invalid:[14,15],channel_not_found:15,channel_not_given:14,channelshuffl:[6,70],chapter:188,character:175,characterist:197,charat:159,chart:[115,167,184,193],chat:169,check:[4,17,19,23,72,81,82,91,115,147,148,149,152,153,154,169,194,199],check_onli:[114,158,159],checker:166,checkfor:[82,90],checkout:[168,169,194],checkpoint:[25,27,67,107,134,155,156,157,165,166,199],checkpoint_help:[6,40,43,45,46,70,107,202],checkpoint_path:27,checkpointhelp:[6,70],chelsea:180,chess:[121,163,173,193,199],chia:[174,176,177,186],child:[91,131,147,154],chines:[166,167],choic:[160,181],choos:[27,29,33,37,155,167,176,178,179,181,184,192,193,199],chosen:[61,66,181,188],christian:[174,176,177,186],christoph:173,chruncat:163,chunk:[79,145],chunk_siz:[79,145,156],ci:[168,169,202],cicular:163,circular:163,ck:[158,159],ckpt:[25,27,134,165,200],ckpt_:200,ckpt_baselearn:134,ckpt_best:134,ckpt_helper:67,ckpt_name:[107,134,200],ckpt_path:[27,200],ckx:[158,159],cl:[82,107,158,159,181],claim:[185,188],clamp:[172,181,188],clarifi:96,clariti:117,classic:[135,197],classic_control:[121,125,150,151,199,200,202],classifi:[154,174,197],classmethod:[56,93,94,108,163],clean:167,clear:[49,50,52,53,54,79,107,108,118,136,163,167],clear_dat:[52,53,54],clear_data:[49,50,52,53,54,118],clearli:[115,149,154,167,188,199],clh:199,cli:[132,194,195,199,202],client:[14,15,17,19,23,112,149,199],clip:[4,42,45,62,66,120,172,178,181,184,185,188,192],clip_:[45,184],clip_coef:73,clip_momentum_timestep:73,clip_norm_typ:73,clip_rang:[4,120],clip_ratio:[62,185],clip_reward:135,clip_valu:73,clipfrac:[45,123],clipped_c:181,clipped_pg_rho:181,clipped_rho:181,cliprewardenv:[5,120],clone:[45,117,138,168,169,181,191,195,197],close:[2,3,8,11,17,25,68,79,81,96,100,101,102,105,107,108,146,147,154,156,157,163,166,169,172,180,181,191,192,197],closur:73,cluster:[127,154,161,194],cn0014009700m:134,cnn1:[17,20],cnn:193,co:[42,158,159,175,178,192],cobb:184,code:[2,8,12,14,15,17,19,53,107,115,117,118,120,121,124,126,127,128,132,133,140,146,147,149,151,154,155,157,159,160,165,167,168,169,170,172,182,187,191,194,195,199,200],codebas:136,codestyl:166,coeffici:189,collab:176,collabor:[138,154,170,174,176,194],collaq:[6,36,44,133,141,182,194,202],collaqmultiheadattent:36,collaqpolici:[6,44,176],collaqsmacattentionmodul:36,collat:[45,79,80,86,181],collate_fn:[6,79,80,86,156,199],colleagu:169,collecotor:143,collecotr:143,collect:[0,2,3,28,29,34,37,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,63,90,94,95,101,107,110,116,117,118,119,121,122,125,131,133,134,135,136,138,143,144,149,151,155,158,159,162,163,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,194,195,199,200,201],collect_config:117,collect_count:117,collect_data:[49,50,52,53,54,118,119,190],collect_demo_data:117,collect_it:[163,199],collect_kwarg:[130,199],collect_mod:[42,117,121,130,138,162,174,178,192,199,200],collect_model:43,collect_reward:188,collect_s:[42,178,189,192],collect_st:188,collect_state_action_pair:51,collect_tim:134,collection_help:[6,86,202],collectionerror:115,collector0:199,collector1:199,collector:[0,2,6,40,41,43,45,46,47,48,56,59,61,66,67,101,102,104,108,117,118,119,121,125,129,130,131,133,134,138,149,152,155,157,161,162,163,172,175,176,177,179,181,184,186,187,190,194,197,200,202],collector_env:[82,130,138,200],collector_env_cfg:2,collector_env_num:[135,136,138,161,199,200],collector_episode_num:161,collector_host:[0,199],collector_info:67,collector_it:201,collector_logg:134,collector_model:199,collector_port:0,collector_step:[188,201],collector_task:[100,104],collector_task_count:101,collector_task_finish_count:101,collector_task_spac:101,collector_uid:96,collectorslav:98,collid:154,color:[158,159],com:[4,63,75,136,138,139,140,161,188,195],coma:[6,32,36,44,60,133,141,182,194,202],coma_data:57,coma_error:60,coma_loss:57,comaactornetwork:36,comacriticnetwork:36,comapolici:[6,44,177],comb:188,combin:[0,34,39,40,41,42,43,45,46,47,48,151,154,159,171,173,175,178,179,183,184,185,186,187,188,189,190,191,192,193,197,199],come:[78,133,165,181],comm:[6,98,106,156,157,202],comm_collector:132,comm_collector_nam:96,comm_collector_typ:96,comm_coordin:[6,103,202],comm_learn:132,comm_learner_nam:105,comm_learner_typ:105,comm_map:[96,105],comma:166,command:[6,103,129,132,134,135,136,138,147,151,155,157,161,194,195,200,202],command_mod:162,command_mode_policy_inst:202,commander_collector_logg:134,commander_evaluator_logg:134,commander_logg:134,commander_tb_logg:134,commcoordin:[6,103],comment:[53,160,167,169,170,191,194],commit:[167,168,169,200],commlearn:[96,105],commom:160,common:[6,9,16,20,32,78,93,96,107,110,116,120,121,126,132,148,149,151,154,159,160,162,163,166,171,179,192,195,197,199,200,202],common_env:[135,136,195],common_load:114,common_util:202,commonest:[123,197],commonli:[120,135,149,155,165,199],commun:[0,100,147,157,174],compar:[144,155,157,173,176,177,179,180,183,186,187,188,189,190,193,197],comparison:[144,152,175,197],compars:199,compat:[93,108,163,193,199],compens:187,competit:[155,177],competitive_rl:[155,202],compil:[0,199,200],compile_config:[1,138,199,200],compile_config_parallel:1,complet:[8,19,20,23,95,108,121,126,128,130,135,138,147,149,153,154,157,165,169,173,175,188,195,197,199,200],complex:[115,133,147,159,160,163,165,169,183,185,186,188,193,199,200],complic:[40,43,45,46,155,163,169,180,193],compon:[56,107,121,123,151,155,166,197,199,200],composit:[114,115,154],compound:[160,180],comprehens:167,compress:[77,177],compress_fn:77,compressed_data:77,compression_help:[6,86,202],compressor:77,comput:[29,33,34,35,37,38,43,56,61,63,64,68,75,150,151,154,159,171,172,175,176,177,178,179,181,185,186,187,188,189,191,192,193,194,197],compute_actor:[33,34,35,171,177,178,181,185,189,192],compute_actor_crit:[34,171,181,185],compute_crit:[33,34,35,171,177,178,181,185,192],compute_critic_q:189,compute_importance_weight:[60,181],compute_q_retrac:172,concat:53,concat_ob:138,concat_state_action_pair:53,concaten:177,concentr:[123,149],concept:[133,149,154,155,157,194,198],conceptu:126,concern:[38,192],concis:118,conclud:144,concret:[131,195,199,200],concurr:[8,81,154],conda:195,condit:[29,149,169,172,177,186,187,190,199],conduc:165,conduct:[144,187,188,189,200],confer:[174,177,186],confg:202,confid:[183,197],config:[2,3,6,25,26,27,31,39,40,41,42,43,45,46,47,48,49,52,53,54,67,74,87,93,94,96,100,101,102,105,107,108,118,119,121,126,127,128,129,132,133,138,139,140,146,147,149,150,151,152,155,156,162,163,166,171,172,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,192,193,194,202],config_:0,configur:[0,31,114,117,125,135,138,147,149,152,159,165,166,169,178,188,189,192,200,202],confirm:149,conflict:[149,168,169,199],confus:169,conn:[153,154],connect:[6,14,15,16,18,19,20,21,23,29,75,100,112,133,147,153,154,157,174,175,180,191],connect_timeout:[146,147],connectionrefus:[16,22,23],consequ:[27,190],consid:[27,120,128,133,149,154,159,169,176,177,186,188,189,190,192,197],consider:[165,183],consist:[131,155,174,177,180,186,193,199,200],consol:195,constant:[63,64,159,179,181,183,190,191],constantli:197,constitut:149,constrain:[172,178],constraint:[62,114,154,172,186],construct:[43,91,147,159,179,191,197,199,200],constructor:[11,12,14,15,17,19,20,21,23,92,199],consult:147,consum:169,contain:[2,4,25,26,27,37,41,48,59,63,67,75,78,79,82,87,94,96,107,108,124,126,133,135,136,138,147,149,155,157,158,159,161,172,173,183,185,187,189,190,197,202],content:[165,167,199],context:[8,17,75,88,127,140,173,190],context_dim:75,continu:[29,33,34,43,54,123,124,130,135,147,157,165,169,171,172,173,177,178,181,184,185,189,190,192,196,197,199],contrari:[188,197],contribut:[170,176,187,194,195,199],contributor:167,control:[8,42,58,108,125,126,127,129,149,152,153,154,162,165,171,172,177,178,180,181,185,188,189,192,193,197,199,200],controllablecontext:[9,16],controllableservic:[9,16],conv1d:75,conv1d_block:[6,70],conv2d:75,conv2d_block:[6,70],conv:[28,75,173],convencod:[30,188],conveni:[114,115,120,149,165,188,190,199],convenient:132,convent:[151,181],converg:[101,131,172,178,179,181,187,189,190,191,192,197,199],converge_stop_flag:117,convers:[147,159],convert:[0,75,159],convex:175,convient:[120,154],convinc:199,convlut:75,convnet:173,convolut:[28,75,173,187],convolv:75,convtranspose2d:75,cook:138,cooper:[138,174,177,186],coordin:[0,6,96,105,134,156,157,161,174,194,199,202],coordinator_host:0,coordinator_logg:134,coordinator_port:0,coorespond:[3,155],copi:[3,25,138,149,162,178,181,190,192,199],copy_data:3,copyright:166,core:[115,125,132,133,136,157,199],correct:[40,41,43,45,46,47,115,123,129,162,167,172,176,177,179,181,184,186,195,199],correct_terminate_gamma:56,correctli:[17,152,166,169],correl:[120,172,178],correspond:[2,3,27,31,33,34,63,75,77,82,92,93,94,96,101,102,105,107,128,129,133,134,135,140,147,149,151,154,155,157,163,165,166,167,169,171,178,181,185,187,188,190,192,193,195,197,199,201],correspondng:2,cost:[150,151,177,192,199],costli:193,could:[4,84,131,162,188,191],count:[4,27,54,108,118,120,129,134,163,183,199,201],count_factor:[45,184],counter:67,counterfactu:177,countvar:[6,70,156,166],coupl:[62,192,200],cours:[153,154,166],coutinu:197,covari:189,cover:[75,176,199],cp:[158,159],cpong_dqn_default_config:155,cpu:[45,49,52,53,54,96,143,144,145,152,156,166,188,189,194,195,199,200],cramped_room:138,creat:[0,3,12,19,25,26,27,31,58,67,75,89,94,96,101,105,107,108,112,118,124,132,136,147,149,153,154,155,156,157,161,162,163,165,167,169,178,189,197,199],create_cfg:[0,125],create_collector_env_cfg:[2,148,149],create_comm_collector:98,create_comm_learn:106,create_config:[0,127,132,135,136,187,199],create_env_manag:5,create_evaluator_env_cfg:[2,148,149],create_learn:106,create_logg:89,create_model:30,create_nois:58,create_noise_gener:60,create_polici:[132,156],create_reward_model:51,create_serial_collector:98,creation:[149,157],credit:[136,177],criteria:197,criterion:[63,74,150,151,190],critic:[33,34,35,41,42,45,55,125,160,171,172,174,177,181,182,185,188,189,191,193,198,199],critic_head_hidden_s:[33,34,171,178,181,185,192],critic_head_layer_num:[33,34,171,178,181,185,192],critic_loss:[172,178,192],critic_output:[34,171,181,185],critic_twin_loss:[178,192],crlf:[168,169],cross:[74,169],cross_entropi:69,cross_entropy_loss:[6,70],cs:181,csdn:93,cuda10:[150,151],cuda9:[150,151],cuda:[40,41,42,43,45,46,47,48,49,52,53,54,56,79,82,93,107,118,121,128,131,135,136,138,150,151,156,162,164,165,166,172,175,176,177,178,179,181,184,186,187,189,190,192,195,199,200],cuda_launch_block:[107,166],cuda_queu:[79,145],cuda_thread:145,cuda_visible_devic:127,cudafetch:[6,70],cude:82,cum_reward:[4,56,63,190],cumprod:126,cumul:[63,135,188,190,197,199],cup:191,cur:82,cur_collector_envstep:[108,118,119,121,125,130,200],cur_learn_it:102,cur_learner_it:[102,108],cur_lr:[40,41,43,46,47,48,123],cur_lr_avg:134,cur_lr_val:[150,151],current:[4,17,19,20,23,25,27,39,40,41,43,45,46,47,48,52,58,61,66,90,92,95,96,102,108,118,126,134,147,152,154,155,156,157,162,163,165,166,173,175,177,178,179,181,187,192,197,199],current_hav:134,current_lr:45,current_tim:108,curs:180,custom:[40,41,43,45,46,122,133,149,162,165,188,194,200,202],customr:162,cut:[38,162,181],cycl:[154,155],cyclic:147,czarnecki:186,d1:82,d2:82,d:[8,43,117,131,156,158,159,173,178,180,181,184,189,190,191,192,193,196],d_:[172,191],d_k:38,d_model_q:38,d_model_v:38,d_out:38,d_t:133,d_v:38,da:174,daan:[178,179],dabnei:[175,187],daemon:92,daewoo:186,dagger:117,dan:187,danger:190,data:[0,2,3,6,12,14,17,19,20,21,23,26,35,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,59,62,63,66,67,68,69,71,77,81,82,84,86,90,91,94,96,102,105,107,108,114,117,118,120,122,123,124,125,126,127,128,129,131,134,135,147,149,151,152,153,154,155,156,157,159,161,162,164,165,166,171,172,173,176,177,178,180,181,185,186,187,188,189,190,192,193,194,197,200,201],data_compressor:77,data_count:[4,120],data_decompressor:77,data_help:[6,70,199,202],data_id:[40,46,102,133],data_n:[126,128,129],data_path:117,data_preprocess:156,data_preprocess_tim:156,data_sourc:[68,79,145],data_tim:[107,156],dataflow:[124,145,199],dataload:[6,80,86,105,107,156,157,194],dataset:[67,197],datatyp:136,david:[171,175,178,179,186,187,192,193],dblevent:[9,16],dcf5f375b290_886803_logger:134,ddpg:[6,44,133,141,174,177,182,188,189,192,194,196,197,202],ddpgpolici:[6,44,178],de:[172,174,176,177,186],deadlock:92,deal:[56,82,102,197,199],deal_with_collector_clos:96,deal_with_collector_data:96,deal_with_collector_finish_task:102,deal_with_collector_learn:96,deal_with_collector_send_data:102,deal_with_collector_start:96,deal_with_get_data:[156,157],deal_with_learner_finish_task:102,deal_with_learner_get_data:102,deal_with_learner_learn:[105,156,157],deal_with_learner_send_info:102,deal_with_learner_start:[156,157],deal_with_resourc:96,dealt:102,debug:[4,81,107,146,147,149,161,163,166,199],decai:[26,40,41,43,46,47,48,58,135,136,162,175,179,187,197,200],decent:[93,179],decentr:[35,174,176,177,186],decid:[25,92,174,197],decis:[117,174,183,194,196,198,199],decol:78,decompos:[176,186],decomposit:[172,176,179,186],decompress:77,decompress_fn:77,decompressor:77,deconv2d_block:[6,70],decor:[8,115,132,147,149,165],decoupl:[172,181,187,199],decreas:[56,58,82,144,172],decrease_spac:82,decrement:82,dedic:154,deduc:180,deep:[66,133,136,160,171,173,177,178,179,181,183,185,186,187,188,189,190,192,194,200],deep_merge_dict:[86,156,166],deep_upd:86,deepcopi:[26,94,108,117,125,138,162,178,181,190,192],deepli:[82,194],deepmind:[25,63,136,173],def:[23,82,90,92,107,114,115,120,123,124,126,127,128,129,130,131,133,138,142,146,147,153,154,155,156,158,159,166,171,172,181,185,188,189,190,200],defail:160,defalut:[68,75,189],default_col:[80,199],default_config:[3,49,50,94,108,162,163],default_decol:[80,199],default_experi:[107,108,187],default_fn:82,default_func:[9,16],default_get:86,default_get_set:82,default_help:[6,86,131,133,202],default_model:[40,41,43,45,46,133,162,176,177,184,186],default_ret:[82,90],default_valu:82,defaultli:[49,52,53,54],defeat:[27,155,173],defin:[40,41,43,45,46,93,115,117,120,124,127,131,149,152,154,155,162,163,165,168,169,171,172,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,199],definit:[40,41,43,45,46,67,94,120,147,149,155,162,181,191,197,199],del:156,delai:[42,178,192],delet:[19,79,108,151,152,166,167,169],delete_used_data:108,delimit:82,deliv:138,delta:[172,174,175,181],delta_:[171,175,196,197],delta_t:181,demand:[162,194,199],demi:193,demo:[127,135,136,138,150,151,154,155,162,199,200],demonstr:[40,41,43,45,46,117,118,125,127,130,134,163,188,189,190,194],deni:[139,140],denot:[58,118,123,187,188,197],dens:135,densiti:175,depend:[27,33,34,78,91,96,108,133,135,149,151,167,171,175,176,178,181,185,189,192,195,197],deploi:[117,157,161,200],deploy:161,depth:169,dequ:[56,128],dereiv:69,deriv:[25,27,58,96,105,107,108,126,133,149,157,163,166,172,175,191,192,199,200,202],descent:[178,180,188,189,192],descib:169,describ:[117,126,133,135,138,157,161,169,179,181,185,197,199,201,202],descript:[4,40,41,42,43,45,46,47,48,89,149,167,172,175,176,177,178,179,181,184,186,187,189,192,197,199],deseri:84,design:[47,49,50,56,69,107,115,125,136,144,152,155,159,160,161,162,169,175,187,194,197,199,200,202],design_help:[6,86,202],desir:136,destin:[25,161],destroi:147,detach:[172,188,189,190],detail:[26,28,29,33,34,37,75,93,96,105,107,117,120,123,124,127,130,133,135,140,147,149,155,161,163,166,169,171,172,175,176,178,179,181,182,185,186,187,192,197,199,200,201],detect:[93,147],determin:[29,33,34,41,42,63,95,149,171,174,178,181,183,185,188,189,190,192,197,199],determinist:[29,69,175,178,187,188,192,196,197],deterministic_ev:189,determist:[190,197],dev:169,develop:[114,120,135,138,140,161,167,169],devi:174,deviat:[58,134,188],devic:[49,52,53,54,58,68,79,93,127,162,181,188,189,190,199],device_id:127,dhariw:185,dhruv:174,di:[42,45,117,118,120,121,124,125,127,128,129,131,132,134,139,141,143,146,147,148,149,150,152,157,160,163,166,167,171,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200],diagnost:4,diagon:189,diagram:[112,115,149,157,190,197,199,202],dict:[0,2,3,4,8,25,26,27,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,52,53,54,56,67,68,69,74,78,79,82,84,87,89,93,94,95,96,100,101,102,104,105,107,108,114,115,123,124,125,128,129,130,132,133,135,136,139,140,146,147,148,149,155,156,157,159,160,161,162,163,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,199,200],dict_:[114,115,158,159],dict_kei:[40,46,78],dicterror:115,dictionari:[3,29,31,37,53,82,147,165,175,187],dictionri:[34,171,185],dicts_to_list:86,did:134,didn:[95,199],diengin:161,diff:[40,41,43,45,46,47,48,114,172,175,176,177,179,181,184,186,187],diff_shape_col:80,differ:[2,27,42,43,45,47,56,62,78,79,94,95,107,115,117,120,121,127,128,129,130,131,133,134,144,147,149,152,154,155,157,160,161,162,163,165,166,171,172,173,174,175,179,180,181,184,187,188,189,192,193,194,197,199,201],differenti:[55,57,62,66,72,189],differnec:[6,60,197],difficult:[134,167,193],difficulti:[27,136,141,197],dijob:[152,202],dilat:75,dile:84,dilut:177,dim1:78,dim2:78,dim:[28,29,33,38,55,57,61,62,63,66,74,75,78,126,127,135,143,144,176,178,181,186,188,189,190,191,192],dimens:[35,37,38,71,75,78,118,126,136,144,149,176,177,179,180,186,188,193],dimension:[171,178,180,197],dimitri:185,ding:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,58,67,68,69,73,74,75,76,77,79,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,100,101,102,104,105,107,108,117,118,120,121,123,124,125,127,128,130,131,132,133,135,136,138,142,148,149,150,151,152,154,155,157,160,161,162,163,164,165,167,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200,202],ding_root:161,dingenvwrapp:[138,200],dir:[89,161],direct:[133,135,169,174,175,181,185,188,197],direct_print:[89,156,166],directli:[0,12,17,43,56,82,89,107,115,124,129,135,136,138,149,154,157,160,165,167,169,177,181,189,197,199,200],directori:[107,140,151,161,167,187,199,200],dirnam:200,disabl:[79,131,151,199],disadvantag:197,disappear:188,discard:56,disconnect:[15,17,19,21,23,112,157],disconnectionrefus:[16,22,23],discount:[40,41,43,45,46,47,48,56,59,63,66,162,175,176,177,179,184,186,187,188,190,193,197],discount_:[43,47,48,175,179,187],discount_factor:[128,135,136,162,200],discret:[29,33,37,61,66,122,123,130,133,135,136,138,165,171,172,175,176,177,178,179,181,184,185,186,187,190,191,192,194,196,197],discretehead:[30,37,179],discrimin:[134,166,180],discuss:[4,169,194,197],disjoint:184,disk_help:90,dispers:154,displai:[89,134,140,156,161,166],dist:[63,150,151,161,171,189,194],dist_behaviour:181,dist_entri:202,dist_fin:[86,156],dist_info:107,dist_init:[86,156],dist_mod:86,dist_nstep_td_data:63,dist_nstep_td_error:60,dist_target:181,distanc:[53,71],distcontext:127,distil:[45,160,184,188,199],distinguish:[180,199],distort:45,distribut:[6,29,37,42,47,48,58,63,66,70,90,107,117,120,123,127,133,154,155,161,171,172,174,175,178,180,181,187,189,190,192,194,197,199,202],distributionhead:30,distributiontimeimag:86,disturb:[68,107,154],div:172,diverg:[172,184,185,189,191],divers:[131,155,160,181,188],divid:[0,79,82,133,154,157,163,188,199,202],divis:52,dizoo:[121,125,126,127,131,132,135,136,138,150,151,155,187,199,200,202],dn:154,dntd:[150,151],doc:[28,29,31,37,69,75,166,167,172,181,194,195,200,202],docker:135,document:[82,169,170,195,197,199],doe:[27,42,45,75,82,108,128,135,151,157,162,163,197,199],doesn:[166,176,179,200],doi:[173,193],domain:[93,120,173,183,190,193,194,197],don:[58,62,107,127,147,155,188,199],done:[3,4,17,27,39,40,41,42,43,45,46,47,56,59,63,75,120,126,128,129,132,133,135,146,147,148,149,157,162,169,172,178,179,181,187,189,190,191,192,197,199],dontprintsemicolon:191,doron:181,dos2unix:[168,169],dot:[38,181],doubl:[11,42,43,155,160,175,178,179,182,185,189,192],double_dqn:133,doubt:166,down:[8,14,15,19,23,81,126,131,135,138,190],download:195,dozen:138,dp:[196,197],dpg:178,dqn:[6,36,44,47,48,118,124,126,127,128,132,133,134,135,136,141,151,160,161,162,175,176,182,187,190,194,200,201,202],dqn_polici:[132,199],dqn_user_config:199,dqnmultidiscretepolici:126,dqnpolici:[6,44,48,126,132,162,179,187,199,200],drag:78,dragan:190,dramat:[179,183],drastic:144,draw:[26,155,191],drew:190,drl:[134,191,194],drop:[56,151,181],dropout:[38,75],dropout_prob:75,dropout_ratio:75,drqn:[36,43,47,133,176,179,186],ds_store:[168,169],dst_checkpoint:25,dt:[58,158,159],dtype:[3,68,78,130,135,147],dual:[173,185],dual_clip:[62,185],due:[59,117,120,140,144,147,157,160,163,165,173,178,180,188,193,197,199,201],duel:[29,37,38,43,48,136,173,175,176,179,182,186],duelinghead:[30,37,134,160,179],dummy_compressor:86,dummy_decompressor:86,dump:[77,84],dun:181,durat:134,dure:[42,43,45,118,124,125,127,134,135,144,147,149,155,161,163,165,175,177,178,179,184,186,187,188,190,192,194,197,199,200,201],duti:154,dw_t:58,dx:193,dx_t:58,dynam:[2,122,133,135,174,183,188,190,193,194,196,197,199],dynamic_se:[3,82,131,138,200],e:[4,25,27,29,33,34,42,43,49,50,52,53,54,56,61,63,66,71,79,81,88,91,107,108,117,118,120,121,124,126,129,132,133,135,138,139,140,144,155,157,159,160,161,162,163,166,167,169,171,172,174,175,176,177,178,179,181,184,185,187,188,189,190,191,192,193,195,196,197,199,200],e_:[52,196,197],each:[3,25,26,29,33,35,37,38,41,43,53,56,63,64,75,78,79,90,93,94,95,96,105,107,108,118,119,121,123,124,125,126,127,129,131,132,133,134,135,136,138,144,147,149,154,155,157,160,161,163,165,167,169,174,175,176,177,178,179,180,181,186,187,188,189,190,191,192,197,199,200,201,202],each_reward:134,earl:186,earli:147,earlier:165,eas:138,easi:[0,115,133,134,138,154,165,188,197,200],easier:[27,149,193],easiest:188,easili:[93,108,114,117,133,157,163,165,172,186,190,192,197,199],east:138,easydict:[0,2,3,25,26,27,31,33,87,94,96,105,107,108,135,136,156,161,166,178,187,188,192,199,200],easytim:[86,156,166],ecec:173,ed:92,edit:[71,167,169],editor:167,edu:173,edward:[188,193],effect:[4,49,50,52,53,54,63,82,120,165,166,175,188,197],effici:[136,147,151,161,172,173,177,181,183,193,194,196,197,199],effort:165,egorov:177,either:[33,92,117,133,163,178,192,197,199],eject:81,el7:195,el:[40,46,78],elaps:197,eleg:[159,199,200],element:[2,3,33,37,38,43,56,63,68,75,76,78,82,90,91,94,105,108,121,132,149,159,163,175,176,178,179,181,186,192,199],elif:[131,181,188],elig:91,elimin:191,els:[82,121,123,126,146,147,153,154,156,166,178,181,188,189,190,192],emb:169,embed:[28,29,33,34,37,75,171,175,178,181,185,187,188,192],embedding_s:[38,189],emded:38,emerg:174,emphas:166,empir:[175,176,188,197],emploi:[186,189],empti:[68,102,135,149,155,157,178,181,188,189,191,192],empty8:188,enabl:[40,43,46,47,48,81,108,120,127,128,131,138,151,179,190,197,199,200],enable_fast_timestep:133,enable_field:[39,40,41,42,43,45,46,47,48,156,162,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192],enable_grad:181,enable_hpc_rl:[150,151],enable_save_replai:[2,3,135,148,149,200],enc:193,encapsul:[127,165,200],encod:[6,29,30,32,33,34,37,38,75,134,171,174,175,177,178,179,181,185,187,188,192,193,202],encoder_hidden_size_list:[34,37,135,136,171,175,179,181,185,187,200],encount:[136,155,187,195,199,200],encourag:181,end:[4,14,15,17,19,20,23,43,48,56,58,81,91,107,112,120,134,135,136,138,147,149,153,154,155,157,162,163,166,172,174,175,178,179,186,187,189,191,192,193,197,199,200],end_flag:[68,79],end_tim:93,endfor:[178,189,192],endif:[178,189,192],enduro:135,energi:[180,189,190],engin:[20,107,117,118,120,121,124,125,127,128,129,131,132,134,136,138,143,146,147,148,149,150,152,156,157,160,161,163,166,167,171,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200],engine_env_wrapp:131,engineenv:[146,147],english:[166,167],engstrom:185,enhanc:200,eniron:197,enlarg:188,enntropi:74,enough:[25,27,147,155,163,169,187,199],enought:135,enrich:155,ensur:[26,82,93,131,154,165,167,169,172,186,187,192,195,199,200],enter:[8,88,93,157,165,167,199],entir:[82,128,135,169,177,193,197,199],entiti:75,entri:[75,82,107,117,121,125,127,129,131,135,136,150,151,155,157,187,190,200,202],entropi:[41,45,69,74,171,177,180,181,184,189,190,191],entropy_:[41,45,177,184],entropy_loss:[41,45,55,57,123,171,181,185],entropy_weight:41,enumer:[147,159,172,190],env:[0,6,27,28,39,40,41,42,43,45,46,47,48,56,58,94,108,121,122,126,131,132,134,136,138,139,140,141,143,144,145,152,161,162,164,165,172,175,176,177,178,179,181,184,186,187,188,189,190,192,194,195,199,200,201,202],env_el:[148,149],env_element_runn:[148,149],env_fn:[2,3,138,146,147,200],env_id:[3,39,40,41,42,43,45,46,47,48,95,135,136,146,147,161,199],env_info:[3,130],env_manag:[0,5,6,94,135,136,152,187,199,202],env_nam:138,env_num:[3,26,94,95,131,133,134,146,147],env_ref:130,env_wrap:120,env_wrapp:[5,6,120,164,165,202],envel:152,envelementinfo:[3,130,147,148,149],envelementrunn:152,environ:[0,2,3,4,27,94,95,107,117,120,121,124,126,127,130,131,133,134,140,144,147,149,150,151,152,154,155,160,163,165,166,174,175,177,178,179,181,183,187,188,189,190,191,192,193,194,195,196,197,201,202],environment:[147,149,193,197],envmanag:[194,199],envnam:199,envname_policyname_main:199,envstep:[94,107,118,119,121,125,134,138,190,199,200],envstep_count:134,envwrapp:147,eof:[161,199],ep:[29,40,41,43,46,47,48,65,73,118,121,135,136,162,172,175,179,187,190,200],episod:[4,56,59,94,95,108,120,122,128,131,133,134,135,146,147,148,149,163,173,181,188,194,199,201],episode1v1collector:138,episode_buff:[108,121,163,202],episode_collector:199,episode_count:134,episode_lif:135,episode_num:[26,146,147],episode_s:121,episode_serial_collector:[6,98,202],episodecollector:[98,199],episodereplaybuff:[121,152,199],episodiclifeenv:[5,120],epoch:[45,67,150,151,184,185],eposid:134,eps_cfg:200,eps_fn:58,eps_greedi:[40,41,43,46,47,48],eps_greedy_sampl:[40,41,43,46,48,164,165],epsgreedysamplewrapp:[124,164,165],epsgreedysamplewrapper_sql:190,epsgreedysamplewrappersql:190,epsilon:[4,40,41,43,46,47,48,58,124,129,162,165,175,178,179,185,187,188,189,190,192,199],epsilon_:189,epsilon_greedi:[58,118,200],epsiode_lif:135,equ:62,equal:[19,23,56,133,135,136,172,178,181,189,192],equat:[182,196,197],equip:[154,171,175,185,187],equiv:187,equival:[63,110,116,149,159,190,191],erent:[40,41,43,45,46,47,48,172,175,176,177,179,181,184,186,187],erez:178,ermon:180,err:23,error:[12,14,15,19,20,63,82,92,102,117,129,133,146,147,149,152,167,172,175,179,180,187,188,190,192,194,197,199,200],error_cod:[14,15],error_task_start:20,error_wrapp:[86,90],errro_wrapp:86,es:167,eseri:134,especi:[114,144,159,167,181,187,188],espeholt:181,essenc:157,essennti:157,essenti:201,establish:[17,19,23,112,147,153,154,157,188],estim:[4,29,43,47,48,49,50,52,53,54,59,63,64,118,120,121,128,162,171,175,177,179,180,181,182,183,186,187,188,191,192,193,197,199],et:[173,174,176,177,180,186,188],eta:187,etc:[3,29,49,50,52,53,56,79,82,84,91,93,105,107,117,123,128,130,133,135,138,149,151,154,155,157,166,167,169,173,187,194,197,199,200,201],euclidean:53,eval:[39,40,41,42,43,45,46,47,133,135,136,138,162,164,165,188,199,200],eval_flag:[25,27],eval_freq:[135,136],eval_mod:[42,162,174,178,192,199,200],eval_model:[43,199],eval_reward:188,evalu:[0,2,25,27,39,40,41,42,43,45,46,47,93,95,101,107,121,127,131,134,136,138,149,155,157,162,173,175,179,181,187,188,194,195,197],evaluate_tim:134,evaluator1:138,evaluator1_cfg:138,evaluator2:138,evaluator2_cfg:138,evaluator_env1:138,evaluator_env2:138,evaluator_env:[82,200],evaluator_env_cfg:2,evaluator_env_num:[135,136,138,161,199,200],evaluator_episode_num:161,evaluator_it:201,evaluator_logg:134,evaluator_step:[188,201],evalul:199,evalut:197,even:[4,115,188,193,197,199],event:[11,134,153,154,161],everi:[4,27,79,120,123,124,133,135,155,165,197,201],everyth:[172,181,200,201],evn_id:120,evolut:199,exactli:[79,115,120,155],exampl:[3,8,17,20,21,23,29,33,34,37,49,50,58,62,75,76,77,78,82,88,90,92,93,95,107,114,115,119,121,122,123,125,127,128,129,130,131,132,136,140,147,149,151,152,154,155,157,162,165,166,169,171,175,178,179,181,185,187,188,189,190,192,194,197,199,200,201],exc_tb:8,exc_typ:8,exc_val:8,exce:[120,147,154,155,199],exceed:[93,147,199],except:[6,16,19,20,21,23,26,67,82,90,92,96,107,144,147,154,175,202],exception_class:[14,15],exclus:175,excut:154,execut:[17,19,20,23,33,34,43,92,95,100,127,129,140,144,147,149,151,154,155,157,165,171,172,174,177,178,181,185,186,189,192,193,194,195,199],exemplifi:132,exhaust:4,exhibit:[133,199],exist:[19,23,82,107,117,127,149,152,153,155,157,169,193,197,199],exist_ok:200,exit:[2,8,93,147,199],exp:[43,58,135,136,162,179,181,187,189,190,191],exp_nam:[107,108,136,138,187,200],expand:[154,176,183],expans:183,expect:[155,172,175,178,188,189,192,196,197],expect_entropi:191,expens:180,experi:[47,48,107,108,120,121,122,126,131,133,134,135,136,161,162,163,172,174,175,177,179,181,182,188,189,190,193,194,196,197,199,200,201],experiment:[127,152,188],expert:[49,50,52,53,54,117,118,125,162,173,180,190,199],expert_:53,expert_a:53,expert_data:[49,50,52,53,54,117,118,199],expert_data_path:[52,53,54,117,118],expert_polici:[117,199],expertpolici:199,expir:[108,123,142],explain:[124,133,157,166,197,199],explainhow:120,explan:188,exploit:[27,162,174,183,188,196,197,199],explor:[6,40,41,43,46,47,48,60,120,129,136,149,162,173,175,178,179,181,183,187,188,189,190,191,194,197,199,200,202],explos:190,expolit:197,expolr:197,exponenti:[58,171,190,200],expos:[165,180],express:[4,172,189,197],ext_arg:[107,164,165],extend:[2,43,107,121,149,177,179,180,186,197,199],extended_arg:107,extens:[154,182],extern:[149,165],extra:[45,56,71,75,79,123,124,186,195],extra_fn:71,extract:[120,159,193],extractor:199,extrins:188,ey:173,f062:134,f084:134,f1:8,f2:8,f3:8,f:[129,161,168,169,171,172,181,188,191,196,197],f_:[187,189,193],f_z:175,face:[188,190,197],facilit:[120,147,154],fact:[120,154,182],factor:[40,41,42,43,45,46,47,48,56,59,63,66,126,162,175,176,177,178,179,181,184,186,187,188,189,190,192,197],factoris:186,factoriz:186,fail:[12,14,15,20,23,85,96,101,112,135,153,154,195],failur:[21,23,117,136,153,154],fair:[118,162],fairli:199,fake:[43,45,47,179],fake_linklink:[85,202],fakelink:[82,90],fall:197,fals:[0,4,11,17,19,23,25,26,27,28,29,33,34,38,40,41,42,43,45,46,47,48,56,69,72,73,75,81,82,94,108,114,124,128,133,135,138,139,140,146,147,153,154,156,158,159,161,162,166,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,192,200],famili:194,familiar:[169,188],faq:[152,194],far:[155,165],farquhar:[174,176,177,186],fast:[138,145],faster:[75,120,144,165,197,199],faulti:167,favor:189,fc1:75,fc2:75,fc68e215:134,fc:[28,75],fc_block:[6,29,33,34,37,70,171,175,178,179,181,185,187,192],fcencod:[30,134,188],fd73:134,fe4f:134,feasibl:[117,169,173],featur:[8,28,38,45,73,75,108,114,120,147,159,163,169,173,176,184,187,188,199],feature1:152,feature2:152,feature3:152,feature4:152,fed:187,fedu:187,feed:[28,186],feedback:[154,197],feedforward:[75,133],feel:[129,152,199],femal:114,feng:169,fetch:[68,107,157,168,169,199],few:[118,161,165,172,181,188],ff1:8,ff2:8,ffline:197,ffmpeg:[135,200],fieid:[55,57,62],field:[59,63,66,78,79,133,140,149,161,173,199,200],fifo:199,fig1:183,fight:155,figur:[63,133,147,149,187,190,199,200],file:[0,2,40,41,45,46,47,84,87,88,89,93,96,100,101,102,105,107,108,125,127,132,133,134,135,136,138,140,145,149,151,157,161,163,166,167,169,187,199,200,201,202],file_help:[6,86,202],file_path:[163,199],file_to_dict:0,filenam:0,filesystem:161,filip:185,fill:[3,29,63,133,161,190],final_eval_reward:[135,148,149],final_tanh:29,find:[91,124,132,138,144,155,163,165,172,174,177,178,179,183,189,190,192,195,197,199,200],find_ab:[158,159],find_free_port:86,find_prefixsum_idx:91,finish:[25,26,101,102,125,134,146,147,155,156,157,166],finish_collector_task:101,finish_job:[25,155],finish_learn_info:101,finish_learner_task:101,finish_task_info:101,finished_task:[101,102,105],finit:197,finn:180,finsh_collector_task:101,firdau:185,fire:[4,120,135],fireresetenv:[5,120],firoiu:181,first:[3,25,27,58,63,72,75,78,79,91,96,105,107,114,118,121,131,133,135,147,149,154,155,157,160,161,163,165,166,172,173,175,178,179,180,181,187,188,189,190,192,193,195,197,199,200,201],firstli:[131,200],fit:[40,41,45,46,188,197],five:134,fix:[4,26,27,29,108,120,121,123,135,136,138,163,169,175,177,179,181,188,197,199,201],fixed_sigma_valu:29,fixed_tim:108,flag:[27,42,81,82,140,178,189,192,199],flask:[19,23,96,105,157,161],flask_fs_collector:[6,98],flask_fs_learn:[105,156,157],flaskfilesystemcollector:98,flaskfilesystemlearn:[106,156,157],flatten:82,flatten_dict:86,flexibl:[159,199],flip:126,float32:[4,130,135,136],floattensor:[33,34,37,38,55,57,59,61,62,63,66,71,75,171,175,178,179,181,185,187,190,192],flow:[115,133,167,177,184,193,194,199],fluctuat:[144,151,199],flush:108,fly:173,fn:[53,82,90,93,156,159,166],fo:[40,41,45,46,47,48],focal:74,focu:[177,199],focus:[159,197],foerster:[174,176,177,186],folder:[122,140,169,194,201,202],follow:[0,4,14,15,17,20,29,43,46,107,113,114,117,119,120,121,123,124,125,126,127,128,132,133,134,135,136,138,140,144,147,149,151,154,155,157,159,160,161,162,165,166,167,169,171,172,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,192,193,195,197,199,200,202],footbal:117,footballkaggle5thplacemodel:162,foral:[175,186],forbidden:169,forc:[25,162,169],forcibl:169,forget:174,fork:[154,167,168,169],forked_path:[168,169],form:[21,49,50,52,53,56,89,110,115,116,125,133,142,151,159,172,181,187,189,190,191,193],formal:[128,187],format:[0,27,40,41,43,45,46,49,50,53,67,68,75,77,89,114,118,124,131,135,138,147,149,152,154,156,157,166,167,185,188,190,200],formatted_total_config:[134,199],former:[124,133,149,199],formul:176,formula:[189,193],forward:[3,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,74,75,107,124,126,130,133,151,156,160,162,164,165,171,175,176,177,178,179,181,185,186,187,188,189,190,192,197,199],found:[14,15,19,85,117,120,124,133,135,136,153,154,155,159,163,165,171,185,186,188,194],four:[26,96,155,157,165,193],fourroom:188,frac:[65,172,173,175,178,181,183,184,185,186,187,189,191,192,193],fraction:92,fragment:94,frame:[4,67,120,135,199],frame_stack:[135,161],frameskip:[4,120],framestack:[5,120],framework:[110,112,113,115,154,159,177,181,186,191,194,197,199,202],free:[92,129,160,171,172,174,175,176,177,178,179,181,183,184,185,186,187,189,190,191,192,193,196,197,199],freez:[108,155],freita:172,freq:[45,107,162,164,165,184],frequenc:[43,45,47,123,162,179,184],frequent:187,friction:178,from:[0,2,4,14,15,17,19,21,23,25,26,27,29,33,39,40,41,42,43,45,46,47,48,52,53,54,58,63,64,67,68,69,75,79,82,84,87,92,93,96,102,105,107,108,112,114,115,117,118,120,121,123,124,125,126,127,128,130,132,133,134,135,136,138,142,146,147,148,149,150,151,153,154,155,157,159,161,162,163,164,165,166,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,195,197,199,200,202],front:[166,181],frozen:155,fs_type:84,ft1:8,fujimoto:192,fulfil:162,full:[81,113,117,125,136,152,159,167,199],fulli:[20,75,120,138,149,175,177,197],func1:20,func2:20,func3:20,func:[8,67,92,93,115],functool:[146,147],fundament:187,further:[4,27,41,63,82,108,120,144,154,169,185,192,195,197],fusion:188,futur:[40,41,43,45,46,47,48,56,59,63,66,120,162,175,176,177,179,184,186,187,188,193,197,199],fx:8,g:[25,27,29,43,49,50,52,53,54,79,81,91,107,108,117,118,124,126,129,133,135,144,155,157,159,160,161,162,163,166,167,169,172,174,175,176,177,186,187,193,195,199,200],g_:[128,172,177],g_t:[172,196,197],gae:[6,45,56,60,150,151,171,184,185,199,202],gae_:[45,184],gae_lambda:56,gail:[6,51,182,194],gail_irl_model:[6,51,202],gailrewardmodel:[51,118],gain:[173,175,183,199],game:[4,25,26,27,101,117,120,121,126,133,135,138,155,163,173,185,187,188,197,199],gamma:[40,41,43,45,46,47,48,56,59,63,64,66,74,128,162,171,172,174,175,176,177,178,179,181,184,186,187,189,190,191,192,193,196,197],gamma_:[187,193],gan:180,gap:[163,199],garbag:2,gate:[75,174],gather:172,gauss:[165,173,192],gaussian:[58,178,189],gaussiannois:60,gender:114,gener:[3,8,17,19,27,39,40,41,42,43,45,46,47,48,56,58,59,75,82,88,112,115,117,118,121,122,128,130,131,135,136,138,140,144,147,149,151,154,155,160,161,163,165,166,167,169,171,172,179,180,181,183,186,188,189,190,191,194,197,199,200,201],generalis:190,generalized_lambda_return:60,georg:[175,187],geq:[181,186],gervet:174,get:[2,3,4,11,12,19,20,21,25,26,27,28,38,39,40,41,45,46,48,49,50,52,53,54,56,58,68,74,75,77,79,81,82,87,88,89,90,91,92,94,95,96,101,102,105,107,108,120,121,123,126,128,129,130,133,144,146,147,148,149,153,154,155,156,157,161,162,165,166,169,172,177,179,181,185,188,194,199],get_attribut:[118,121,125,146,147,190,200],get_cached_data_it:81,get_collector_task:101,get_cuda_time_wrapp:86,get_current_episod:[95,199],get_data:[105,107,156,157],get_data_compressor:86,get_data_decompressor:86,get_data_thread:[79,145],get_env_cl:5,get_env_manager_cl:5,get_episode_info:95,get_episode_reward:[95,199],get_epsilon_greedy_fn:[60,200],get_ga:[56,199],get_gae_with_default_last_valu:56,get_group:86,get_ip:86,get_job:[27,155],get_job_info:[25,155],get_kei:26,get_latest_reward:95,get_learner_task:101,get_lstm:[6,70,133],get_master_exception_by_error:[13,16],get_master_exception_class_by_error_cod:[13,16],get_nstep_return_data:[56,128,133,199],get_operator_server_kwarg:86,get_pid:86,get_policy_update_info:96,get_random_polici:130,get_rank:[82,86,156,166],get_residual_spac:82,get_rw_file_lock:86,get_serial_collector_cl:98,get_slave_exception_by_error:[13,16],get_slave_exception_class_by_error_cod:[13,16],get_tabulate_var:89,get_tabulate_vars_hor:123,get_task_uid:[86,156,166],get_tensor_data:[6,70],get_train_sampl:[43,56,121,128,133,162,181,199],get_vec_env_set:5,get_world_s:86,getattr:[123,156],getpid:92,gfootbal:202,gif:168,git:[138,139,140,170,194,195],github:[4,63,135,136,138,139,140,188,195],gitignor:[168,169],gitlab:[168,169],give:[67,117,181,188,197],given:[2,4,14,15,19,25,26,27,29,31,33,34,43,53,58,61,63,64,67,68,74,75,83,88,96,100,105,107,112,117,120,126,131,133,136,149,157,163,165,171,172,175,178,181,183,185,188,189,190,192,197,200],global:[27,35,38,126,131,176,186,197],global_obs_shap:[38,176,186],global_st:[35,38,176,177,186],glu:[6,70],go:[17,121,173,191,193,197,199],goal:[124,138,166,188,197],godlewski:183,gonzalez:176,good:[135,155,181,188],googl:[25,117,173,183],gopher:187,gotten:4,govern:183,gpu:[0,43,96,107,122,145,151,152,154,162,166,179,194,195,199],gracefulli:195,grad:[61,68,72,107,127],grad_clip_typ:73,grad_context:181,grad_fn:[33,34,171,178,181,185,192],grad_ignore_typ:73,grad_norm_typ:73,grade:191,gradient:[43,47,66,123,125,127,162,171,174,177,178,179,180,181,182,184,185,188,189,191,192,198,199],gradual:[136,188],graepel:[186,193],grammar:166,graph:[35,37,38,43,68,133,160,167,182,199],grasp:147,grave:[171,179],gre:[127,199],great:199,greater:[27,43,58,91,179,185,187,188],greatli:[147,172,178,192,199],greedi:[58,124,162,165,175,179,187,190,197,199],greedili:190,green:[158,159,188],gregori:[174,176,177,186],grei:188,grep:[17,19],greyscal:135,grid:[134,197],ground:74,group:[75,90,92,144,161,168,169,174],group_foo:[168,169],group_num:75,group_siz:90,gru:[38,75,133,176,186],grusli:186,guarante:[107,108,178,186,192],guard:172,guassian:[42,178,192],guez:193,gui:[186,200],guid:[161,174,177,195],guidanc:173,guidelin:200,gupta:177,gym:[2,4,120,126,135,146,147,148,149,164,165,199,200],gym_env:136,gym_wrapp:136,gymfromdmenv:136,h:[65,75,124,156,174,176,177,178,180,181,186,188,189,191,192,195,199],h_:191,ha:[4,8,15,26,27,41,59,63,92,93,95,115,117,118,120,123,124,128,130,131,132,133,134,135,147,149,153,154,155,157,159,161,165,172,173,175,177,179,181,187,188,189,190,192,193,195,197,199,201],had:159,hado:187,half:[138,167,169],halfcheetah:[42,141,178,189,192],ham:71,hamming_dist:[6,70],han:197,hand:[138,157,167,194,197,199],handi:165,handl:[4,56,63,64,90,127,154,200],handwrit:133,happen:[67,92,115,133,190],harb:177,hard:[43,47,121,133,160,179,188],hardcod:[138,190],hardest:27,harlei:[171,181],hasattr:[131,156],hassabi:193,hasselt:187,hat:[171,174,175,176,184,185,188],have:[8,27,58,68,75,78,82,90,93,95,107,120,121,123,124,126,128,131,135,136,138,147,149,151,154,159,163,166,169,173,178,181,188,190,191,195,197,199,200,201],head:[6,30,32,33,34,37,38,75,134,163,166,171,173,175,176,178,179,181,184,185,186,187,188,192,199,202],head_cl:29,head_cls_map:29,head_dim:75,head_hidden_s:[37,175,179,187],head_kwarg:29,head_layer_num:[37,175,179,187],head_num:75,heartbeat:[19,23],heartbeat_check_span:19,heartbeat_span:23,heartbeat_toler:19,heat:75,heess:[172,178],height:75,hello:77,help:[4,48,52,53,54,67,120,133,149,157,167,174,176,197,199],helper:[67,156,166,200],henc:[136,188,197],her:[121,202],her_cfg:121,her_episod:121,her_model:121,her_reward_model:202,here:[19,23,39,40,41,42,43,45,46,47,88,96,118,120,123,125,126,127,128,133,142,149,153,154,157,159,160,161,162,163,166,172,178,181,187,188,192,199,200],herk:192,herrewardmodel:121,hessel:187,hessian:185,heta:58,heterogen:180,heurist:189,hex:8,hidden:[29,35,38,41,47,75,118,124,165,176,177,186],hidden_channel:75,hidden_dim:[75,118],hidden_s:[28,29,33,34,35,37,75,171,175,178,179,181,185,187,192],hidden_size_list:[28,35,38,176,186,188],hidden_st:[40,41,46,133,164,165],hiddenstatewrapp:[124,133,164,165],hierarchi:155,high:[59,121,127,135,144,150,151,171,172,178,179,180,188,192,194,199],higher:[107,154,165,188,193,197],highest:[91,107,134,179,199],highli:[96,120,159,192,193],highlight:69,hilton:184,hindsight:[121,163,199],histor:[25,26,27,133,155],histori:[129,177],historicalplay:155,ho:180,hold:[133,155,157,197],home:26,home_id:26,homogen:199,honglak:193,hoof:192,hook:[106,152,156,157,166,194,199,200],hook_cfg:[164,165],hook_map:107,hook_typ:107,hooks1:107,hooks2:107,hooks4cal:[105,156,157],hooktoregist:107,hope:[155,172,181],hopper:141,horgan:187,horizon:190,horizont:201,host:[0,17,19,23,87,92,161],hostallero:186,hostpath:152,hot:[75,187],hour:169,how:[40,41,42,43,45,46,47,48,58,95,96,108,122,128,132,152,157,161,162,163,172,174,175,176,177,178,179,181,184,186,187,188,190,192,194,197,200],howev:[56,108,117,123,125,132,134,135,136,138,162,163,169,178,179,181,185,189,190,192,197,199],hpc:[75,133,150,152,194,202],hpc_:[150,151],hpc_rl:202,html:[69,75,166,167,188],http:[4,12,14,15,17,19,20,23,42,46,53,54,63,69,75,93,136,138,139,140,154,171,172,173,175,178,179,181,183,184,185,186,187,188,189,190,192,193,195],http_engin:20,httpengin:20,httperror:[12,14,15,154],huazh:176,hub:135,huber:175,hubert:[181,193],huge:[173,183],hugo:187,human:[117,138,173,188],humancompatibleai:138,humanoid:141,hung:[174,176,177,186],hunt:178,hurt:188,hybrid:[33,178,192,194],hyper:[129,162,175,178,186,190,199,200],hypernet:38,hypernet_emb:38,hyperparamet:[190,199],hypothesi:188,i:[4,29,33,34,42,49,52,53,54,56,61,63,66,71,78,79,88,91,108,117,118,119,120,121,123,125,126,131,132,135,138,145,152,155,157,159,164,165,171,174,175,176,178,181,184,185,186,187,188,189,190,191,192,193,195,196,197,199,200,201],iain:181,ibuff:[0,101,152,199],icml:171,id:[3,8,14,15,17,19,20,23,25,26,27,40,41,42,43,45,46,47,48,95,101,102,146,147,155,168,169,172,175,176,177,178,179,181,184,186,187,189,192],idea:[117,149,159,168,169,175,185,186,188,199],ideal:[187,197],ident:[155,178,188],identif:[149,154],identifi:[27,159],idl:[20,132,154],idx:[91,94,156,172],iff:197,ignor:[42,43,45,47,63,68,78,132,140,162,166,178,179,187,189,192],ignore_:[43,47,179],ignore_coef:73,ignore_don:[42,162,178,189,192],ignore_kei:68,ignore_momentum_timestep:73,ignore_norm_typ:73,ignore_valu:73,igor:177,iit:[158,159],il:[117,133,202],il_config:117,illustr:[167,197,200],ilpolici:162,ilya:185,imag:[4,120,135,161,163,199,202],imahg:136,imit:[122,180,190,194,200],immedi:[3,8,19,147,153,154,175,193],immens:167,imodelwrapp:[124,164,165,190],impact:[181,197],impala:[66,133,182,194,202],impalapolici:181,imped:174,implement:[2,23,54,55,57,59,62,63,66,75,79,91,93,96,101,105,107,108,117,118,120,121,123,124,125,126,127,128,129,132,133,135,136,140,144,149,151,152,154,157,159,160,162,163,165,166,167,169,182,194,197,199,200],implic:181,implicit:[175,180],impliment:75,import_help:[6,86,202],import_modul:[25,86,107],import_nam:[27,31,40,41,43,45,46,96,101,105,132,133,135,136,187],importance_weight:181,imposs:172,improv:[47,48,124,131,151,171,172,173,175,176,177,178,179,181,183,187,188,193,197],in_channel:[28,75],in_featur:134,inaccuraci:192,inclu:129,includ:[0,2,33,35,38,39,40,41,42,43,45,46,47,48,63,74,75,96,101,102,107,108,115,124,127,134,135,136,144,149,155,157,159,161,163,167,169,173,174,176,177,178,184,186,187,189,190,191,192,197,199,200,202],incom:[147,149],incomplet:169,inconveni:134,incorpor:190,incorrect:167,incorrectli:123,increas:[82,118,131,135,136,151,172,181,187,188,192,199],increase_spac:82,increment:[27,54,82],increment_eval_difficulti:27,increment_or_not:27,inde:185,independ:[29,34,38,149,154,157,159,171,174,177,178,181,185,186,187,189],index:[29,38,61,63,66,91,94,156,164,165,166,167,176,186],indic:[39,40,41,42,43,45,46,47,48,95,107,108,135,149,154,167,178,180,188,189,192,195,197,199,200],individu:[75,176,177,186,197],induc:[59,117,192,193],industri:120,inevit:154,inf:[62,158,159,190],infer:[39,40,41,42,45,46,47,48,133,143,144,145,191],inferfac:[40,41,43,45,46],infinit:197,influenc:131,info:[2,3,4,25,27,40,41,43,45,46,67,81,89,95,96,102,104,105,107,108,120,123,126,134,135,147,148,149,156,157,163,164,165,166,199,200],info_dict:[39,40,41,42,43,45,46,47,48],info_templ:[148,149],inform:[0,4,12,25,26,27,35,38,62,63,75,95,96,107,127,134,135,136,140,147,149,154,155,157,160,162,172,173,174,177,180,186,188,190,195,197,199,200,201],infti:[181,191],ingredi:138,inher:133,inherit:[48,93,124,126,127,131,147,149,153,154,165,175,187,199],init:[0,2,28,29,33,34,37,39,40,41,42,43,45,46,47,48,58,75,79,88,90,91,93,95,96,100,101,102,104,105,107,124,125,133,134,146,147,148,149,162,166,169,171,175,178,179,181,185,187,192],init_fn:124,init_payoff:27,init_typ:75,init_v:[67,156,166],initi:[2,4,11,20,25,26,27,28,35,38,43,52,53,54,58,75,81,82,91,94,95,96,105,107,108,120,121,124,127,129,147,149,153,154,155,156,157,162,163,165,166,176,177,178,186,188,189,190,191,192,194,199],initiali:189,inner:114,inplac:75,input:[0,2,4,26,29,33,34,35,37,38,39,40,41,42,45,46,47,48,52,53,55,56,57,58,59,62,63,66,68,69,71,74,75,76,77,78,79,82,83,91,96,118,120,124,127,133,135,136,147,149,151,160,165,166,171,173,175,176,177,178,179,181,185,186,187,189,190,191,192,193,197,199],input_data:77,input_dim:[75,118],input_s:[35,75],input_typ:75,insensit:159,insert:[129,152,165,166,181],insid:[19,23,161,167,200],insight:188,inspect:[159,174],instabl:179,instal:[150,151,194,200],instanc:[2,25,26,27,58,74,82,83,89,94,96,105,107,108,120,123,135,147,149,153,154,165,199,202],instance_nam:[107,108,138],instanti:[27,147,153,154,155,156,157,166,194],instead:[63,72,85,107,114,117,120,129,147,161,163,167,175,178,189,190,197,199,200],instruct:162,int64:135,integ:[39,40,41,42,43,45,46,47,48,126,131,135,136],integr:[4,120,131,152,155,169,174],intellig:[173,177,194,197],intend:169,intent:[169,174],inter:[147,174,180],interact:[6,39,40,41,42,43,45,46,47,96,102,110,134,138,149,152,155,161,176,179,180,188,190,194,196,197,199,200,201,202],interaction_serial_evalu:0,interactionserialevalu:[0,101],interactor:100,intercollector:100,interest:[123,188,197],interfac:[0,2,3,4,12,25,26,27,28,33,34,35,38,40,41,45,46,49,50,52,53,54,56,58,67,68,69,73,74,75,79,81,82,83,88,91,92,93,94,95,96,100,101,102,104,105,107,108,120,126,136,147,149,152,156,157,160,163,166,171,174,175,176,177,178,179,181,183,184,185,186,187,188,192,193,199,200],interfer:184,intermedi:128,intern:[28,81,133,151,154,174,177,186],interplai:192,interpol:[42,178,189,192],interpret:174,interv:[81,107,114,115,123,147,158,159,197],intranet:154,intrins:188,intrinsic_reward:188,intrinsic_reward_typ:188,intro:152,introduc:[82,115,121,123,128,130,134,154,155,157,163,172,173,175,181,185,188,189,192,199],introduct:[114,194,197],inv_trans_fn:[63,151],invad:[135,141,187],invalid:[14,75,114,153,154,156],invers:[49,50,63,122,180,188,194],inverserl:162,invert:189,investig:[136,154],invok:92,involv:[188,193],io:188,ioanni:[179,193],ip:[2,17,19,92,157],ipc:199,iqn:[36,133,141,182,194,202],iqn_nstep_td_error:175,iqnpolici:175,irl:[118,180,194,202],irl_config:118,irl_util:118,irrelev:169,is_al:92,is_auto_alpha:189,is_avail:131,is_clos:11,is_connect:[17,153,154],is_differenti:[6,70],is_fake_link:[82,90],is_finish:95,is_open:11,is_train:135,is_trained_enough:[27,155],is_typ:[110,116,158,159],is_weight:[40,41,45,46,176,177,181,184,186],isaim2010:173,iserialcollector:[98,199],isinst:[29,37,126,127,131,166,175,179,181,187,188,190,199],issu:[4,125,136,139,140,152,166,168,169,179],issubclass:166,isw:[6,60,202],item:[3,52,55,57,62,66,68,94,108,114,115,123,127,129,146,147,156,158,159,188,191,199],iter:[29,40,41,43,45,46,47,48,52,53,54,58,67,68,73,76,79,81,102,107,108,118,119,123,129,134,155,156,157,162,163,164,165,166,172,175,176,177,179,180,181,183,184,186,187,197,199,200,201],iter_:76,iter_map:86,iterable_list:76,iteration_0:134,iteration_561:134,iteration_:200,iteraton:199,its:[4,8,19,75,78,91,93,94,115,118,120,123,124,126,129,132,133,134,147,149,153,154,155,157,163,166,173,175,177,180,188,190,191,193,197,200,201,202],itself:[8,14,15,43,96,105,135,149,154,155,157,165,179],itt:[158,159],ityp:[115,158,159],j:[91,173,174,175,176,177,178,183,184,186,187,188,189,191,192],j_:189,jacek:183,jacob:184,jaderberg:186,jakob:[174,176,177,186],jame:187,janoo:185,jayesh:177,jean:177,jiam:180,jiang:174,jie:173,jiechuan:174,job:[25,26,27,79,154,155,157,161,199],job_id:92,job_info:[25,26],job_queu:[79,145],joel:186,joell:174,john:[184,185],join:[8,19,20,23,26,79,92,105,108,138,153,154,200],joint:[176,177,184,186],jointli:[173,176],jonathan:[178,180],joseph:[176,187],joshua:174,json:[114,154],ju:186,judg:[25,27,68,72,101,147,155,159,197,199],judge_fn:82,judge_snapshot:[25,155],julian:193,jump:167,junhyuk:193,just:[63,64,115,123,127,136,142,149,153,154,157,181,195,199,200],k8:[161,194,199],k8s_helper:[6,86,202],k:[38,123,133,171,172,173,177,178,184,187,188,192,193,199],k_attr:123,kaim:75,kaiq:174,kang:186,kappa:175,karen:[181,193],karg:107,karl:[184,186],kavukcuoglu:[171,172,179,181],ke:173,keep:[68,108,115,120,123,131,133,154,158,159,167,169,177,178,179,192],keepdim:[189,190,191],kei:[3,4,21,25,26,27,29,31,33,34,35,38,39,40,41,42,43,45,46,47,48,52,53,54,56,58,67,68,75,78,82,84,94,96,105,107,108,118,121,123,124,126,128,129,132,133,147,149,153,154,155,160,163,182,194,200],kernel:75,kernel_s:75,keutzer:176,keyerror:[25,26,27,58,96,105,107,114,158,159,188],keyword:[8,92],kickoff:200,kill:[17,19,202],kim:186,kind:[114,154,160,179,181,193,199],kkt:172,kl:[172,184,185,189,191],kl_gradient:172,klimov:[184,185],know:[4,95,107,123,147,151,157,166,174,188,199,200],knowledg:[160,173,183,184,193],known:197,kochenderf:177,konrad:183,korai:[171,172,179,181],kp:[158,159],kubectl:161,kubenet:161,kubernet:161,kullback:191,kurt:176,kwarg:[4,27,42,75,83,87,88,92,94,96,107,120,124,146,147,156,164,165,166,190],kyunghwan:186,l156:131,l1:[115,158,159],l2:115,l74:63,l:[77,114,115,117,142,171,174,175,176,179,184,185,186,190,191,192],l_2:181,l_:172,label:[19,74,161,168,169,178,188,189,192],labelsmoothceloss:[6,70],lack:140,lambda:[8,41,45,56,59,63,64,66,76,124,146,147,150,151,156,171,177,184],lambda_:[66,181,191],lanctot:186,languag:167,laptop:154,larg:[93,127,135,144,147,154,169,173,174,176,185,187,188,194,197,199],larger:[123,159,175,187,188,199],largest:[48,175,187],larochel:187,larri:185,lass:181,last:[4,27,37,56,63,64,75,79,94,108,120,128,133,142,147,156,166,179,181,187,188,190,195,199,201],last_act:35,last_data:181,last_enough_step:27,last_epoch:67,last_fn_typ:[56,181],last_fram:67,last_it:[67,107,123,156,157,166,200],last_valu:56,latenc:175,later:[4,120,128,157,161,169],latest:[95,134,147],latter:[133,149,155,199],launch:[3,25,27,81,127,140,146,147,153,154,161,199,200],launch_play:[25,26],laurent:193,layer:[26,28,29,33,34,37,38,75,118,149,165,171,175,176,178,179,181,185,186,187,189,192],layer_fn:[29,33,34,37,75,171,175,178,181,185,187,192],layer_num:[29,75],layout_height:138,layout_width:138,lazi:[2,148,149,161],lazili:135,lazyfram:4,lcmp:114,ldot:171,le:172,lead:[117,188,191,197],leaf:91,leagu:[6,132,152,162,194,202],league_map:25,league_mod:162,league_typ:25,leagueexploit:155,leaguemetricenv:27,leaky_relu:75,leaner:199,learn:[4,27,29,39,40,41,42,43,45,46,47,48,56,63,74,75,96,105,107,118,119,120,121,122,123,124,125,126,127,131,133,135,136,138,149,151,154,155,156,157,160,161,162,166,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,188,189,190,191,192,193,194,196,197,199,200,201],learn_aux:[45,123,184],learn_info:[105,107,156,157,166],learn_mod:[42,138,156,162,174,178,192,199,200],learn_model:199,learnabl:189,learner0:199,learner1:138,learner2:138,learner:[0,4,6,40,41,46,47,48,66,96,101,102,104,108,118,119,121,122,125,127,132,133,134,138,145,152,155,161,162,163,164,165,166,181,190,194,200,202],learner_aggreg:202,learner_cfg:156,learner_comm:[6,106],learner_get_data_task:[156,157],learner_hook:[6,106,123,156,157,164,165,202],learner_host:[0,199],learner_it:123,learner_learn_task:[156,157],learner_logg:134,learner_map:[107,166],learner_nam:107,learner_port:0,learner_start_task:[156,157],learner_step:[105,123],learner_task:[100,104],learner_task_finish_count:101,learner_task_spac:101,learner_tb_logg:134,learner_typ:[25,107],learnercommhelp:107,learnerhook:[106,123,152,156,164,165],learnerslav:157,learnig:120,learning_r:[40,41,45,46,47,48,135,136,162,188],learning_rate_actor:[178,192],learning_rate_alpha:189,learning_rate_crit:[178,192],learning_rate_valu:189,least:[26,39,40,41,42,43,45,46,47,48,52,53,54,56,82,144,147,181,199],leav:190,lee:[173,193],left:[27,91,123,126,135,136,138,165,171,172,175,178,179,184,185,187,189,191,192,193],leftarrow:[178,189,191,192],legal:[82,130,149],legg:181,legitimaci:149,leibler:191,leibo:186,len:[40,46,56,75,78,118,119,123,126,131,133,172,181,188,189,190,199],length:[8,26,38,39,40,41,42,43,45,46,47,48,56,59,63,78,81,94,95,108,114,121,123,129,133,157,162,163,166,172,176,179,181,186,188,199],less:[101,128,155,199],let:[114,123,154,157,172,188,199],letter:166,level:[82,89,136,154,155,167,169,173,183,192],levenshtein:71,levenshtein_dist:[6,70],lever:186,leverag:[191,192],levin:190,lf:[168,169],lfunc:115,lh:199,li:128,liao:169,lib:[150,151,169],librari:140,licens:166,life:[4,120,154],light:[154,159],lik:127,like:[4,8,17,19,29,56,62,67,74,75,77,91,93,95,96,105,107,108,112,113,114,115,120,123,124,125,128,133,134,135,147,153,154,155,160,162,163,165,180,191,194,199,200,201,202],likelihood:[189,190],lil:188,lilianweng:188,lillicrap:[171,178,193],limit:[114,161,163,167,172,188,192,197],limitedspacecontain:86,limits_:179,line:[20,136,142,151,153,154,166,169,188,194,200,202],linear:[28,43,58,75,134,172,179,186,187,189,197,200],link:[20,46,82,90,118,135,136,138,166,186,187,194],linklink:[74,82,85,90],linklink_dist_help:[82,90,202],linlink:[139,140],linux:[139,140,150,151,195],lisa:166,list:[2,3,26,33,35,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,67,68,72,75,76,78,82,84,85,89,92,94,95,96,102,105,107,108,115,121,123,124,125,126,128,129,131,132,133,136,146,147,156,159,167,169,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,194,197,199],list_next_st:75,list_split:[86,133,181],lists_to_dict:[56,86,181],littl:181,live:[4,135],ll:[124,155,193],llection:[42,178,192],ln:[151,183],load:[27,40,43,45,46,67,102,105,107,108,115,117,134,155,157,161,162,163,165,166,199],load_and_record_to_csv:136,load_ckpt:[164,165],load_ckpt_before_run:[164,165,200],load_ckpt_freq:107,load_expert_d:[49,50],load_expert_data:[49,50,52,53,54],load_from_id:136,load_path:[67,136,156,166,200],load_state_dict:[40,43,45,46,67,102,108,163,200],loadckpthook:[106,164,165],loader:[110,114,152,194,202],loader_v0:114,loader_v1:114,local:[0,17,19,35,38,84,134,150,151,167,169,174,176,177,186,195,197,199],local_parallel:202,local_seri:202,locat:[75,108,126,127,160,161,165,167,199],lock:[88,134,153,154],lock_help:[6,86,202],lockcontext:[26,86],lockcontexttyp:88,lockhart:193,log:[40,41,43,45,46,68,69,89,100,107,108,118,122,127,134,138,156,157,161,165,166,169,171,172,174,177,181,188,189,190,191,194,199],log_:133,log_buff:[68,107,123,156,157,166],log_help:[6,86,202],log_pi:191,log_prob:[171,181,189],log_reduc:[164,165],log_reduce_freq:107,log_show:[164,165],log_show_after_it:[164,165],log_softmax:191,log_std:189,log_var:[123,156],logan:185,logdict:68,loggedvalu:[123,142],logger:[49,52,53,54,67,89,100,107,108,123,134,152,156,157,162,166,199],logger_prefix:67,loggerfactori:86,logginglogg:89,logic:[114,115,149,154,159,199],logit:[29,33,34,35,37,38,42,43,45,55,57,61,66,69,74,124,126,133,164,165,171,175,176,177,178,179,181,185,186,187,190,191,192],logit_new:[62,185],logit_old:[62,185],logp:171,logreducehook:[106,164,165],logshowhook:[106,123,164,165],longer:[108,114,121,155,163,173,199],longtensor:[55,57,61,62,63,66,71,74,75,181,190],look:[92,132,165,194,197,200,201],lookahead:193,loop:[121,185,194,197,199,200],lose:155,loss:[4,6,23,26,39,40,41,42,45,46,47,48,55,57,62,63,64,66,69,70,72,73,75,117,123,126,127,128,129,151,155,160,169,172,174,175,176,177,178,179,181,184,186,187,188,189,190,191,192,199,201,202],loss_:126,loss_dict:[178,189,192],loss_entropi:181,loss_polici:181,loss_tot:181,loss_valu:181,lost:[4,23,117],lot:[128,134,173,179,199],low:[135,172,173,177,178,192,199],lower:[107,130,193],lr:[39,42,45,73,123,178,189,192],lr_schduler:67,lstm:[6,38,70,124,133,150,151,174,176,186],lstm_type:[38,75,176,186],lstmforwardwrapp:[6,70],lu:174,lunarland:[187,189,190,199,202],lunarlander_dqn_create_config:187,lunarlander_dqn_default_config:187,lunarlander_env:187,lunarlander_exp:187,lunch:102,lz4:77,lz4_data_compressor:86,lz4_data_decompressor:86,m:[26,37,38,53,75,78,127,132,150,151,161,175,176,179,186,187,190,193,196,197,199,200],machin:[127,154,174,186,194,199],maciej:183,maco:[168,169,195],maddpg:177,made:[92,117,134,149,167,173],madri:185,magail:180,magnitud:187,mai:[40,41,43,45,46,47,48,85,92,95,121,123,124,125,140,151,161,165,169,175,176,177,179,184,186,187,190,197,199,200,201,202],main:[0,27,28,39,42,43,45,78,79,112,117,126,129,134,136,138,150,151,154,155,160,163,166,167,178,188,189,192,193,199,200,201],main_config:[0,127,135,136,187,199],main_ob:[47,133],main_play:27,mainexploit:155,mainli:[127,151,157,165,169,183,193,199,202],mainplay:155,maintain:[124,133,147,149,154,155,165,169,178,179,187],mainten:154,maintian:124,major:[117,169,178,193],make:[0,4,17,19,23,27,35,45,56,63,88,94,120,123,124,126,129,130,131,133,135,136,140,149,152,155,157,159,164,165,167,169,171,174,180,183,188,191,193,195,199,200],makefil:202,male:114,man:[174,176,177,186],manag:[3,17,25,100,102,104,127,130,138,139,140,143,144,149,152,154,155,161,169,190,194,199,200,202],manager_cfg:3,manager_config:[146,147],manger:190,mani:[3,40,41,42,43,45,46,47,48,62,92,95,96,108,117,120,121,124,125,130,133,134,135,157,161,162,163,165,172,173,175,176,177,178,179,181,184,185,186,187,188,189,191,192,197,199],manifest:165,manipul:120,manner:[147,180,193],manual:[82,117,147,157,169,195],manual_se:131,map:[8,12,17,19,20,21,23,75,76,78,82,115,126,151,153,154,159,175,178,193,197],map_loc:200,mapsto:193,mara:[40,176],marc:[175,186],marget_ob:133,margin:[175,177],marginalis:177,marian:186,mark:[147,175,187,195],markov:[155,196,198],marl:[40,194],martin:179,mask:[35,38,75,138,190],massiv:135,master:[6,13,15,16,21,23,75,96,112,127,152,153,157,161,168,169,173,185,193,195,202],master_address:23,master_token_invalid:[14,15],master_token_not_found:15,master_token_not_given:14,masterchannelinvalid:[13,16],masterchannelnotgiven:[13,16],mastererrorcod:[13,16],mastermastertokeninvalid:[13,16],mastermastertokennotgiven:[13,16],masterresponseexcept:[13,16],masterselftokeninvalid:[13,16],masterselftokennotgiven:[13,16],masterslavetokeninvalid:[13,16],masterslavetokennotgiven:[13,16],mastersuccess:[13,16],mastersystemshuttingdown:[13,16],mastertaskdatainvalid:[13,16],match:[14,15,26,37,133,179,199],math:[38,65,75,78,110,116,159,176,181,186,190,191],math_help:202,mathbb:[172,174,175,176,177,178,179,184,185,189,191,193],mathbf:[187,189,191,193],mathcal:[174,175,176,178,186,189,191,192],mathemat:[159,173,197],mathop:[179,186],mathrm:[171,173,175,184,191],matrix:[185,197],matteo:187,matter:[123,182,185],max:[4,17,19,23,75,82,91,108,120,123,126,130,134,135,147,162,163,166,172,175,179,180,181,184,185,186,187,188,191,192,193,199],max_:[186,196,197],max_a:[196,197],max_fram:4,max_it:[164,165],max_iter:[138,156,157,199,200],max_retri:[146,147],max_us:125,max_val:[75,82],maxandskipenv:[5,120],maxim:[177,190,191,197],maximis:197,maximum:[4,48,81,94,129,136,147,154,165,172,179,189,190,191],maxlen:[81,94],mayb:[8,133,163,195,199],mc:[41,45,85,177,184,197],mcmp:[158,159],mct:[173,182,193,194],md:202,md_dqn:126,md_space:126,mdp:[117,133,198],mdthod:135,mean:[4,8,11,12,17,19,20,23,27,40,41,43,45,46,47,48,56,58,62,69,75,79,91,107,108,117,120,123,126,129,133,134,135,136,138,144,147,149,155,162,163,171,172,175,176,177,178,179,181,184,186,187,188,189,190,191,192,197,199],mean_relative_error:[150,151],meaning:155,meantim:199,measur:[149,163,166,180,181,188],mechan:[81,129,132,147,149,157,159,163,174,199],median:199,mediat:180,meger:192,mehdi:171,member:[14,15,20,27,69,75,149,155,160,169],memcach:[84,139,140],memori:[3,94,107,133,134,136,151,152,163,199],memory_len:136,memory_len_0_dqn:136,memory_len_0_dqn_config:136,memory_len_0_dqn_create_config:136,memory_len_env:136,memoryless:197,mention:[62,154,157,160,161,162,165,193,199],mere:120,merg:[82,94,107,167,168,169,187,199,200],merge_hook:[106,156],merged_dict:82,messag:[12,19,21,23,96,153,154,157,174],meta:[96,105,134,152,199],metadata:[27,96,157],meter:189,method1:[135,136,138],method2:[135,136,138],method:[0,2,12,17,19,21,23,25,27,39,40,41,42,43,45,46,47,54,56,58,67,69,75,82,89,92,93,94,95,96,100,102,105,107,108,112,120,123,124,125,127,128,129,130,133,147,149,154,155,156,157,159,160,161,162,163,165,166,169,171,172,173,174,177,178,179,180,181,183,184,186,188,190,192,193,196,197,199,200],method_name_list:3,metric:[6,70,179,187,202],metric_env:27,mi:[158,159],micro:161,micromanag:[176,177,186],mid:[171,178,184,185,189,191],middl:[143,144,145],middlewar:[152,202],might:[48,123,128,140,162,163,167],migrat:114,mikayel:[174,176,177,186],mike:174,mimic:192,min:[82,91,108,123,126,130,134,135,163,172,175,178,180,181,185,188,189,191,192],min_:[189,192],min_val:82,mind:167,mini:[133,177,188,192],minibatch:185,miniconda:195,minigrid:188,minim:[45,117,133,172,175,186,187,188,189],minima:177,minimis:197,minimum:[19,23,48,197],minor:167,minsegmenttre:91,minu:[115,135,158,159,188],mirza:171,misconnect:154,mismatch:151,miss:[19,188],miss_num:181,misspecif:188,mistak:117,misus:115,mitig:175,mix:[38,41,63,66,177,186,194],mixer:[36,176,186],mixing_embed_dim:38,mkdir:200,mlp:[6,29,33,34,35,37,70,118,164,165,171,175,178,181,185,187,192],mlp_num:75,mmm2:141,mmm:141,mnih:[171,172,179,181],moba:185,mod:192,modayil:187,mode:[0,33,34,35,39,40,41,42,43,45,46,47,48,69,75,81,94,107,108,113,123,133,144,147,152,154,161,163,164,165,166,171,172,175,176,177,178,179,181,184,185,186,187,189,192],model1:138,model2:138,model:[0,3,6,17,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,50,52,53,54,67,72,73,82,90,93,110,111,117,118,120,121,122,126,132,134,135,136,138,149,152,155,156,162,163,164,166,169,171,172,174,175,176,177,179,180,181,182,183,184,185,186,187,188,189,190,191,193,194,198,201,202],model_info:[40,41,43,45,46],model_output:[39,40,41,42,45,46,47,129,133],model_wrap:[124,133,162,164,165,178,192,199],model_wrapp:[124,133,160,164,165,190],moder:159,modif:[118,127,169,173,183,190],modifi:[26,118,119,120,128,147,152,155,163,165,169,173,179,190,199],modul:[2,17,28,29,31,33,34,37,38,39,40,41,42,43,45,46,47,48,56,63,67,69,72,74,75,85,120,124,127,132,133,136,147,149,151,152,155,157,159,160,161,167,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,193,194,199,201,202],modular:199,modulelist:189,moethod:[41,48],mohammad:187,moment:197,momentum:[40,41,46,73,176,177,178,186,192],monitor:[41,45,62,81,107,108,123,135,152,156,157,162,166,199],monitor_interv:81,monitor_var:123,monoton:186,mont:[128,173,183,193,196,197],montezuma:[187,188],montezumareveng:135,mordatch:177,more:[4,19,26,27,28,29,33,34,37,40,41,43,45,46,47,48,73,75,79,95,114,115,117,120,121,123,124,127,128,130,131,133,136,149,154,155,156,157,159,160,161,163,165,167,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,192,193,194,197,199,200],moreov:[172,199],most:[4,43,120,123,133,135,149,155,160,162,165,173,187,191,193,194,197,199,200,201],mostli:[49,50,124,167,183,193],mothod:162,motiv:193,mount:161,mountpath:161,move:[135,140,173,183],mp4:[135,200],mpi:127,mpo:191,mr:169,mse:[63,151,188],mse_loss:[129,171,181,188,191],mseloss:190,mt:[158,159],mu:[29,33,58,172,174,178,181,189,192,196,197],mu_:[178,192],much:[129,134,167,175,176,180,181,186,187,188,193,199],mujoco:[120,148,149,152,178,189,192,197,202],mul:172,multi:[29,38,40,41,43,46,75,107,108,115,122,125,147,154,155,162,171,173,174,175,176,177,179,180,182,184,185,186,189,191,194,200],multi_buff:125,multi_discret:126,multi_gpu:[127,162],multi_head_dqn:132,multi_logits_loss:[6,70],multiag:[155,177],multiagent_particl:202,multidiscret:126,multidiscreteenv:126,multihead:[30,75],multilevel:93,multilogitsloss:[6,70],multimod:175,multimoni:138,multinomi:[69,124,175,179,187,191,199],multinomial_sampl:[164,165,188,199],multinomialsamplewrapp:[124,164,165],multipl:[0,3,20,25,26,74,79,122,126,131,147,154,160,162,174,176,181,194,199,200],multipli:[26,71,129,144,175],multiprocess:[79,140,146,147],multistep:[41,63,190],multistep_forward_view:60,multivari:189,muno:[172,175,181],must:[8,23,25,27,37,40,41,43,45,46,47,58,74,75,84,90,92,93,96,105,107,121,123,124,125,129,130,132,133,135,142,147,149,154,157,160,161,162,163,166,169,177,179,181,184,185,190,199],mutat:[25,27,155],mutate_ckpt_path:27,mutate_prob:27,mutation_result:27,mutual:108,muzero:[183,193],my:19,my_address:[17,19],my_env_manag:[146,147],my_test_project:[168,169],mycontrollablecontext:8,mycontrollableservic:8,myhook:[164,165],mykel:177,mymast:[153,154],myopic:197,myslav:[153,154],mywrapp:[164,165],n0:[33,178,192],n1:[33,71,127,178,192],n2:[33,71,127,178,192],n3:[33,178,192],n:[26,29,33,34,37,38,39,43,47,48,53,55,56,57,58,61,62,63,66,71,74,75,78,122,133,134,135,136,138,141,150,151,162,171,175,176,177,178,179,181,183,184,185,186,187,189,190,191,192,193,194,199],n_:[173,183,187],n_atom:[29,37,48,63,175,187],n_episod:[95,118,162,163,199],n_evaluator_episod:[135,136,199],n_frame:[4,120],n_head:38,n_len:172,n_output:64,n_sampl:[43,47,118,130,133,134,135,136,162,163,179,199],n_step:[39,48,150,151,187],n_t:177,nabla:174,nabla_:[171,172,174,176,177,178,181,189,192],naiv:[101,104,108,121,133,155,163,171,181,199],naive_buff:[108,163,202],naive_sp_play:155,naivebuff:199,naivecollector:98,naivereplaybuff:[138,152,199],naiveresourcemanag:[6,103],naivespplay:155,name1:132,name2:132,name:[0,3,19,33,40,41,42,43,45,46,47,48,52,56,75,77,78,82,83,85,87,88,89,92,94,96,104,107,108,114,123,124,127,132,134,136,144,149,150,151,153,154,156,157,161,162,164,165,166,168,169,172,175,176,177,178,179,181,184,186,187,188,189,192,195,197,199,200,201],name_of_hook:107,named_paramet:127,namedlist:[2,148,149],namedtupl:[3,27,39,40,41,42,43,45,46,47,55,57,59,62,63,66,82,94,101,107,129,133,148,149,171,181,185,190,199],namespac:[83,87,161],nando:172,nanta:[174,176,177,186],nardelli:[174,176,177,186],narrow:192,natur:[4,120,142,173,180,190,197],naturaltim:142,nature24270:173,navi:155,navig:167,ndarrai:[3,4,26,39,40,41,42,43,45,46,47,48,68,69,135,199],nearbi:176,nearest:75,nearestupsampl:[6,70],necessari:[3,25,27,29,33,34,35,39,40,41,42,43,45,46,47,48,96,105,107,108,149,154,156,157,169,171,172,174,177,178,181,185,188,192],necessarili:[27,197],need:[2,4,17,29,40,41,42,45,46,48,56,58,75,81,82,94,95,96,101,107,108,114,115,117,121,123,124,127,129,131,133,134,135,136,140,144,147,149,151,154,155,156,157,160,161,162,163,165,166,167,172,173,174,176,180,181,186,187,188,190,193,195,197,199,200],need_tb:89,need_text:89,neew:197,neg:[82,175,189],neglogp:69,neighbor:175,neither:[115,180],nest:[4,82,165,200],net:[35,38,45,48,75,93,173,175,176,182,186],network1:[178,192],network2:[178,192],network:[6,9,16,20,29,33,34,35,37,38,40,41,42,43,45,46,47,48,61,64,66,70,107,124,125,133,134,150,151,152,155,160,162,164,165,171,172,173,174,175,176,177,179,180,181,182,183,184,185,186,188,189,191,193,197,199,200,202],neural:[133,134,155,160,171,172,173,178,179,180,183,186,187,188,189,193,199,200,202],neurip:193,neutral:91,neutral_el:91,never:[27,117,169,188],new_connect:[17,19,20,112,153,154],new_data:[118,119,125,130,190,199,200],new_data_count:118,new_dict:82,new_episod:121,new_hook:107,new_keys_allow:82,new_loader_v0:114,new_q_valu:189,new_shap:[4,120,148,149],new_task:[17,20,112,153,154],newdata:82,next:[3,38,45,75,79,94,117,128,133,155,156,165,176,178,186,189,192,193,195,197,199,200,202],next_act:[178,189,192],next_data:[178,189,192],next_input:133,next_n_act:[63,190],next_n_dist:63,next_n_q:[63,190],next_ob:[39,40,42,43,46,48,56,94,108,126,129,163,178,181,189,192,199],next_sate_predict:188,next_stat:[35,38,75,124,133,176,177,186],nextstat:75,nf2:[158,159],nf:[158,159,161],nfqca:178,ni:29,nicola:[172,178,186],nightli:135,nine:123,nintendo:126,niuyazh:[168,169],nm:177,nn:[28,29,31,33,34,37,38,39,40,41,42,43,45,46,47,48,63,67,72,74,75,124,127,129,133,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,194],nn_modul:[6,70],nn_test_help:[6,70,202],nndarrai:135,nnode:127,no_grad:[126,133,172,178,181,188,189,191,192],node:[91,127,133,154,161,183,199],node_rank:127,nois:[29,42,48,58,69,75,124,136,165,178,179,187,192,197],noise_:192,noise_block:[6,70],noise_clip:192,noise_gener:58,noise_kwarg:192,noise_logit:69,noise_map:58,noise_mod:69,noise_net:48,noise_rang:192,noise_sigma:[42,178,192],noise_typ:[58,192],noiselinearlay:[6,29,70],noisi:[29,37,48,175,182,188],non:[91,140,152,155,175,186,188,197],none:[0,2,3,8,11,17,19,20,21,23,25,26,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,58,62,63,67,68,69,72,73,74,75,77,78,79,81,82,84,85,90,91,92,94,95,96,100,101,102,104,105,107,108,114,118,119,121,123,124,125,127,128,129,131,133,143,144,148,149,153,154,156,157,158,159,161,163,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,200],nonloc:[153,154],noop:[126,135],noop_max:[4,120],noop_reset:135,noopresetenv:[5,120,164,165],noqa:[123,156,166,188],nor:180,noreturn:0,norm:[45,75,110,114,116,152,158,184],norm_func:75,norm_typ:[28,29,33,34,37,75,171,175,178,179,181,185,187,192],normal:[4,6,28,29,33,34,37,45,62,70,84,92,117,120,121,147,151,154,162,165,171,175,178,179,181,184,185,187,188,189,191,192,199,200],normal_env:199,normalis:190,normalist:120,normalizt:75,normfunc:[115,158,159],north:138,notat:181,note:[3,4,27,67,69,96,107,120,133,135,138,149,151,155,159,161,166,167,169,181,187,188,190,191,193,197,200],noth:[19,20],notic:[64,123,128,181],notify_fail_collector_task:101,notify_fail_learner_task:101,notimplementederror:156,notion:192,novel:[186,188,192],novelti:[179,188],now:[0,26,58,68,75,95,129,132,135,138,149,151,157,165,167,181,190,199],noweight:188,nowrap:[178,189,192],np:[3,4,26,39,40,41,42,43,45,46,47,48,69,126,130,131,135,136,189,190,199],np_seed:131,nproc_per_nod:127,nstep:[43,47,48,56,63,126,128,129,135,136,143,162,175,179,187,190,199],nstep_return:190,nstep_return_data:190,ntask:127,null_data:181,null_pad:[56,133,181],null_transit:56,num:[29,33,34,37,38,40,41,46,47,48,57,63,67,75,94,102,107,134,143,144,171,175,178,181,185,187,190,192,199],num_direct:75,num_episod:136,num_first:75,num_lay:75,num_quantil:[29,37,175],num_work:[79,145,156],numba:163,number:[0,4,27,28,29,35,37,38,42,43,47,48,56,63,67,75,79,82,90,91,92,94,95,108,115,121,124,128,131,133,134,135,136,138,147,149,154,155,157,162,163,165,175,176,177,178,179,186,187,188,189,190,192,193,197,199],numer:[151,179],numpi:[3,4,26,68,69,82,131,188],numtyp:4,nvidia:161,nx:[143,144],o1:29,o2:29,o3:29,o:[145,174,176,184,188,193,196,197,201],o_:176,ob:[3,4,33,35,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,94,108,126,129,133,135,138,146,147,148,149,160,163,176,177,178,186,188,189,190,192,199],obei:[40,41,43,45,46,166,199],oberv:120,obeserv:[4,120],obj:[3,4,8,26,33,53,54,67,68,69,75,82,90,120,124,126,131,166,172,178,181,190,192],object:[2,8,11,12,14,15,17,19,20,25,27,45,49,50,58,68,76,77,81,82,83,84,92,112,115,136,149,153,154,156,160,166,176,180,184,189,191,197,200],objstor:199,obs_:199,obs_alon:[38,176],obs_along:[38,176],obs_dict:3,obs_shap:[4,28,33,34,35,37,38,127,135,136,148,149,171,175,176,177,178,179,181,185,186,187,188,192,199],obs_spac:[4,135,148,149],obscur:157,observ:[2,3,4,28,33,34,35,37,38,39,40,41,42,43,45,46,47,78,120,133,143,144,146,147,148,149,171,174,175,176,177,178,179,181,185,186,187,188,189,192,193,196,197],observation_spac:4,observationwrapp:120,obsnormenv:[5,120],obstransposewrapp:[5,120],obtain:[133,147,149,154,157,165,176,177,186,187,188,190,197],obviat:188,obviou:199,occup:180,occur:[19,20,82,90,92,147,149,151,152,194,199],odot:187,off:[40,41,43,45,46,47,48,147,161,162,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,196,197,200],offer:[0,160,161,199],offici:[169,195],offlin:[173,196,197],often:[107,120,135,160,162,163,172,183,195,197,199],oftern:135,oh:193,ointment:173,ok:115,old:[151,159,185],older:181,oleg:[184,185],omega:187,omit:[157,166,188,202],on_complet:[20,153,154],on_fail:20,on_polici:[40,41,43,45,46,47,48,128,162,172,175,176,177,179,181,184,186,187,199],onc:[3,4,42,54,81,110,116,120,136,155,157,163,165,172,178,181,192,197,199],one:[2,3,25,26,27,38,40,41,42,43,45,46,47,48,56,58,75,78,82,92,95,96,105,107,108,114,118,120,121,123,128,129,131,133,134,135,138,144,147,149,153,154,155,156,157,160,162,163,169,172,174,175,176,177,178,179,181,183,184,186,187,188,189,190,192,193,197,199,200],one_hot:[6,70],one_phase_step:27,one_vs_one_collector:202,one_vs_one_leagu:[6,24,155,202],one_vs_one_parallel_command:202,ones:[4,54,75,79,186],ones_lik:[171,181,190],onevoneevalu:138,onevsoneleagu:155,onli:[0,2,4,19,27,40,41,42,43,45,46,47,48,54,75,78,79,82,89,91,95,96,107,108,114,117,118,120,121,123,125,126,127,131,133,135,147,149,151,154,155,156,157,162,163,165,166,167,169,172,173,175,176,177,178,179,181,184,186,187,188,189,190,192,193,197,199,200,201],onlin:[19,23,117,167,173,190,197],online_net:54,onppo:188,onto:175,onward:197,op:[4,67,88,90],open:[11,95,120,129,149,167,169,195],openai:[4,120,148,149,188,200],opendilab:[135,161,195],oper:[19,27,40,43,45,46,47,59,75,78,88,91,92,115,120,121,127,133,147,149,150,152,154,157,159,160,163,165,172,174,175,178,186,194,199],operator_serv:202,operatornam:[175,185,187,192],oppon:[27,155],opportun:184,opt:[177,188],optim:[29,39,40,41,42,43,45,46,47,48,62,67,73,117,125,129,151,155,157,162,163,172,176,177,178,180,181,183,184,185,188,189,190,191,192,194,198,199],optim_typ:73,optima:197,optimiazt:200,optimis:197,optimizer_help:[6,70,202],option:[0,3,8,11,17,19,20,21,23,25,27,28,29,33,34,37,38,39,40,41,42,43,45,46,47,48,56,58,67,69,71,73,74,75,79,82,89,90,91,92,94,101,107,108,124,125,133,149,158,159,163,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,193,195,199],optioncondit:193,orchestr:[152,194],order:[19,23,26,75,88,94,115,120,131,132,135,138,147,151,154,159,161,165,169,177,178,181,188,193,199,200],ordereddict:67,ordinari:154,org:[42,46,53,54,69,75,161,171,172,173,175,178,179,181,183,184,185,186,187,188,189,190,192,193],organ:128,orgin:135,origin:[3,4,12,14,15,17,19,45,75,77,78,82,108,120,125,126,131,133,138,142,144,150,151,159,165,168,169,177,181,184,186,187,188,192,199],origin_data:77,origin_env:120,origin_model:124,origin_path:[168,169],orign:135,ornstein:[42,58,178,192],orthogon:75,os:[92,107,138,166,200],ostrovski:[175,187],other:[0,3,4,19,25,27,38,40,41,42,43,45,46,47,48,58,68,94,95,96,105,107,108,117,120,121,124,125,127,128,131,147,149,152,154,155,160,162,165,166,167,169,171,172,173,175,176,177,179,180,181,182,184,186,187,190,193,194,197,199],otherwis:[19,23,25,27,45,56,59,75,79,82,90,101,112,123,138,147,153,154,157,160,181,187,188,195],otyp:[115,158,159],ou:[164,165],ounois:60,our:[42,62,95,117,120,124,136,141,144,159,175,178,181,187,188,189,191,192,197,199,200],out:[11,63,75,78,92,108,121,132,134,138,140,154,157,163,177,188,190,193,199],out_channel:75,out_featur:134,outcom:193,outer:[78,108],outermost:[161,165],outlin:199,outperform:[144,188],output:[4,19,23,28,29,33,34,37,38,39,40,41,42,43,45,46,47,48,58,61,64,66,75,77,89,107,118,120,124,126,129,133,149,156,160,162,165,166,171,174,175,176,178,179,181,185,186,187,188,190,191,192,193,195,199],output_devic:127,output_dim:75,output_s:29,output_size_list:29,outsid:157,over:[4,63,64,120,121,123,135,157,162,178,187,188,190,192,194,195,197,199],overal:[27,174,176,177,186,188,193,199],overcook:[137,194],overcooked_ai:138,overcooked_demo_ppo_config:138,overcooked_vac:138,overcookgameenv:138,overestim:[175,179,192],overhead:188,overid:93,overlap:[75,151],overli:169,overlin:191,overload:159,overrid:[43,86,92,126,129,149,155,156,157,166,199],overridden:82,override_all_if_type_chang:82,overriden:157,overrod:126,overroidden:163,overview:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,58,59,61,62,63,64,65,66,67,68,69,71,72,73,74,75,76,77,78,79,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,100,101,102,104,105,107,108,117,120,124,126,131,152,166,182,200],overwrit:169,overwritten:[108,133],own:[56,94,115,124,125,126,129,132,133,134,138,149,154,155,157,160,162,165,169,176,188,199,200],owner:169,p:[37,38,75,127,155,161,171,173,174,175,176,178,183,185,186,187,191,196,197,199],p_:[52,175,187],p_i:175,pack:[59,75,160,199],packag:[23,82,131,150,151,167,194,195,200],pad:[75,172,181],pad_typ:75,page:[126,135,167,169,200,201],pai:[121,123,125,159,169,195,199],paid:169,pair:[53,94,117,123,129,135,147,149],paper:[4,42,46,47,75,120,125,138,155,172,173,178,181,185,186,187,188,189,192,193,199],paradigm:[174,177,186],paragraph:155,paral:147,parallel:[0,90,101,102,107,127,129,147,151,152,156,163,194],parallel_collector:132,parallel_commander_typ:101,parallel_entri:202,parallel_pipelin:199,parallelli:200,param:[73,126,127,164,165,188],paramet:[0,2,3,29,33,34,37,40,41,46,56,59,62,75,79,107,127,129,131,133,134,135,144,147,149,151,154,155,157,160,162,163,165,171,172,174,175,176,177,178,181,185,186,187,188,189,190,191,192,194,197,199,200,201],parameter:[175,178,181,189,193,196,197],parameteris:197,parameteriz:69,parametr:[29,175,187,197],parent:[27,131,149,155],parent_id:27,parikh:174,pariti:133,parsed_info:114,part:[0,38,40,43,45,46,56,62,90,100,114,115,120,124,125,126,133,136,140,149,151,155,157,160,165,167,172,176,179,181,187,191,193,197,199,201,202],partial:[123,142,146,147,174,176,177,186,197,199],particip:[90,155],particl:178,particular:[136,189,190],partit:199,partition_nam:127,pass:[3,8,17,33,34,37,56,63,64,91,92,94,96,101,102,124,132,133,135,147,149,153,154,157,159,160,162,171,173,175,178,179,181,185,187,192,199,200],past:[27,155],path:[0,2,3,25,27,40,41,43,45,46,67,84,89,96,105,107,118,132,134,136,138,139,140,155,161,167,187,195,197,199,200],pattern:[149,173,194],payoff:[6,24,25,27,152],payoff_map:26,pd:[6,70],pdeil:[6,51],pdeil_irl_model:[6,51,202],pdeilrewardmodel:51,pdf:[42,53,173,175,178,189,192],peak:[173,192],penal:175,pend:147,pendulum:[189,199,202],pendulum_td3_main:199,peng:177,peopl:[131,169],per:[40,41,43,45,46,47,48,119,122,127,134,172,175,176,177,179,181,182,184,186,194,199,201],per_collect:[40,43,46,47,48,172,175,176,179,181,186,187],per_collect_target:94,perceptron:75,perfect:183,perform:[43,73,117,128,131,135,136,138,144,149,152,154,157,165,169,173,176,179,183,184,186,187,188,190,193,194,197,199,200],period:[108,123,133,134,155,157,166,187,197,199,201],permiss:[139,169,194],permit:123,personal_info:114,personnel:154,perspect:[175,180,193],perturb:[58,136],peter:186,pfsp:[27,155],pg_loss:181,pg_rho:181,phase:[27,45,161,183,184,188,193,199],phasic:[123,125,184],phi:[172,175,177,178,181,187,189,191,192],phi_1:[189,192],phi_2:[189,192],phi_:[172,175,178,189,192],phi_i:[189,192],philip:[174,176,177,186],physic:178,pi:[128,133,171,172,175,177,180,181,184,189,191,196,197],pi_:[117,172,181,184,185,189,191,192],pi_act:[190,191],pice:82,pick:[138,190],pickl:[77,84],pictur:197,pid:92,piec:[78,79,82,94,120,162,163,165,181,199],pieter:177,pin:167,pineau:174,pinelin:173,ping:[14,15,19,23,153,154],piot:187,pip:[135,136,138,139,140,150,151,195],pipe:[110,116,199],pipelin:[0,101,121,129,132,157,160,162,194,202],piplin:[117,133,155],pit:169,pitfal:135,pkl:[117,118,161,199],pl:[158,159],place:[52,54,75,123,134,138,149,160,161,165],placehold:[40,41,42,43,45,46,47,48,172,175,176,177,178,179,181,184,186,187,189,192],plai:[25,155,162,173,179,194,199],plan:[169,183,193,197],plantuml:112,plantumlcli:112,platform:[0,200],player:[6,24,25,26,121,132,135,152,173,199,202],player_id:[25,26,27],player_info:25,player_map:27,player_typ:27,playerr:27,pleas:[2,4,17,19,23,28,29,31,33,34,35,37,38,69,76,77,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,107,115,127,128,131,140,141,142,149,154,156,157,159,165,166,167,169,172,181,188,190,195,197,199,200],plenti:[130,199],plu:[115,133,158,159],plugin:[40,41,46,48,107],pm5gv:161,pmatrix:186,pmi2:127,pmlr:[174,186],pod:161,point:[48,92,107,149,156,163,166,169,181,188,197],polci:172,polic:[132,197],polici:[0,6,39,40,41,42,43,45,46,47,48,52,61,62,64,66,82,94,96,101,105,107,117,118,119,120,121,123,124,125,126,127,128,129,130,132,134,135,136,138,143,144,146,147,150,151,152,155,156,157,160,164,165,166,171,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191,194,198,201,202],policy1:138,policy2:138,policy_0d2a6a81:134,policy_:189,policy_buff:125,policy_cfg:156,policy_data:[125,185],policy_factori:[130,202],policy_info:185,policy_kwarg:[118,121,130,190,199,200],policy_loss:[41,45,55,57,62,123,171,181,185,189],policy_output:[39,40,41,42,43,45,46,47,48,185],policy_registri:[40,41,42,43,45,46,47,48,132,162,172,175,176,177,178,179,181,184,186,187,189,192],policyfactori:130,policynet:189,polyak:[42,178,189,192],polymorph:149,pomdp:[197,202],pong:[4,135,141,145,190],pong_dqn_config:135,pong_dqn_create_config:135,pongnoframeskip:[126,135,164,165],pool:[4,94,120,155],poor:177,pop:[156,190],popular:[138,193],port:[2,17,19,23,87,92,154,157],portion:[127,133],posit:[58,94,107,128,156,157,164,165,173,188],possibl:[118,120,136,138,149,154,155,167,169,174,192,197,199],post:[75,199,200],postion:172,pot:138,potenti:[159,169,187],pow:[172,189],power:[91,112,115,154,199],pp:173,ppg:[6,44,123,125,133,135,141,182,194,202],ppgpolici:[6,44,184],ppo:[6,45,60,117,123,133,138,141,150,151,181,182,184,188,189,194,202],ppo_data:62,ppo_error:[60,185],ppo_info:[62,123],ppo_loss:[62,123,185],ppo_policy_data:185,ppo_policy_error:185,ppo_value_data:185,ppo_value_error:185,ppopolici:[138,185,188],practic:[114,154,159,179,190,194,199],prafulla:185,prajit:187,pre:[118,121,135,151,156,157,175,188,199,200],precedur:133,precis:[135,183],pred:[29,71],pred_extra:71,predecessor:193,predefin:199,predefined_config:202,predict:[29,33,34,37,39,40,41,42,43,45,46,47,48,74,75,171,174,175,178,179,181,183,185,187,188,189,192,193],predict_featur:188,predictor:188,prefer:[195,200],prefix:[67,96],prefix_op:67,prefixsum:91,preliminari:154,prelu:75,premis:167,prepar:[25,45,117,156,165,195,199],preprint:[174,176,177,180,186],preprocess:[19,35,40,41,45,46,75,199],prerequisit:194,present:[92,177,183,186,197,200],preserv:[45,108,159,163,175,184,187],press:126,pressur:81,pretrain:[27,155],pretti:89,pretty_print:[86,156,166],prev:124,prev_stat:[35,38,40,41,46,47,75,78,124,133,176,177,186],prevent:[147,159,167,169,185,190],preview:167,previou:[4,38,75,117,133,147,154,165,175,176,179,181,186,191,197],prime:[171,175,178,179,187,191,192,193],primit:193,principl:159,print:[23,72,76,78,81,82,88,89,102,108,134,135,136,142,153,154,157,162,164,165,195,199,201],print_instead:72,prior:[173,184],priori:173,priorit:[48,108,122,152,175,179,182,194,199],prioriti:[40,41,43,45,46,47,48,102,107,108,123,125,128,129,135,156,157,162,163,164,165,166,175,176,177,179,181,184,186,187,199,201],prioritizedbufferr:129,priority_:[40,41,45,46,176,177,181,184,186],priority_avg:[123,134],priority_i:[43,47,179,187],priority_info:[105,107,156,157,166],priority_is_weight:[129,162],priority_max:[123,134],priority_min:[123,134],priorityl:108,pritzel:178,privat:[154,168,169],pro:[168,169],prob:[27,69,190,191],probabilist:191,probabl:[27,69,75,129,165,172,174,175,180,185,187,191,197,199],probil:69,problem:[95,117,131,133,136,147,150,151,154,155,157,162,166,169,173,176,177,179,180,183,186,188,191,193,194,195,198,199],problemat:117,procecur:43,procedur:[127,157,163,167,195,199,200],proceed:177,proces:79,process:[15,17,19,23,40,41,42,43,45,46,56,58,67,74,75,78,79,90,96,108,110,111,116,118,121,124,126,127,129,131,133,135,138,145,147,149,152,153,154,155,156,162,165,169,173,178,180,181,188,190,192,193,196,198,200],process_transit:[43,199],processg:170,processgroup:90,processs:79,prod:189,prod_:181,produc:[61,66,68,133,144,149,183,186],product:[19,23,38,121,126,129,161,175,181],profession:173,profil:[152,163],program:[0,147,151,165,197,199],programmat:138,progress:[147,168,169,188],proj_bar:[168,169],project:[167,169,175],project_path:[150,151],promot:174,prone:[177,197],prop_nam:[123,142],propabl:163,propag:[72,92,151,172,174,189],propagatingthread:86,propcess:118,proper:[0,2,19,133,167,195,199],properli:[19,23,136,154],properti:[0,3,4,12,17,19,20,21,26,27,42,53,54,81,94,96,101,102,105,107,108,120,123,124,142,147,148,149,155,156,166,174,178,192,197],propoerti:128,proport:[129,188,190],propos:[25,47,171,173,174,175,178,179,180,184,185,186,187,188,189,190,192,193,197],proprieti:136,propto:187,protect:[23,147],protocol:174,protoss:27,proven:172,provid:[75,82,108,115,117,118,120,124,126,128,133,140,147,149,151,154,155,157,160,161,165,169,178,186,192,197,199,200],proxi:[17,187],proxim:[62,185],prv_state:75,ps:121,pseudo:[147,182,199],pseudocod:182,psi:187,pth:[25,134,200],publish:173,puct:[173,183],pull:135,pure:[68,144,173,199],push:[79,81,108,118,119,121,125,130,134,163,168,169,190,199,200],push_count:[108,163],push_data:81,push_data_count:108,pushed_in:134,put:[68,78,79,117,120,124,129,134,155,157,169,199],pwil:[6,51],pwil_irl_model:[6,51,202],pwilrewardmodel:51,py3:[150,151],py:[0,2,4,28,29,31,33,34,35,37,38,63,76,77,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,105,107,117,120,121,123,124,125,126,127,128,130,131,132,133,134,135,136,138,148,149,150,151,152,155,156,157,161,163,164,165,167,175,190,195,199,200,202],pyarrow:199,pymarl:[38,141],pypa:[139,140],pypi:195,pytest:[138,195],python3:[150,151,199,200],python:[0,40,41,43,45,46,62,127,132,135,136,150,151,159,166,167,195,199,200],pythonunbuff:[161,199],pytorch:[69,75,133,145,195,200,202],pytorch_ddp_dist_help:[6,86,127,202],pytorchlstm:[6,70],q0:[191,196],q0_a:191,q0_loss:191,q0_targ:191,q1:[194,196,197],q1_a:191,q1_loss:191,q1_targ:191,q2:[194,196,197],q3:[194,196,197],q4:[194,196,197],q5:[196,197],q6:[196,197],q7:196,q:[29,33,34,37,38,42,63,124,126,132,133,152,164,165,171,174,175,176,177,178,179,181,182,185,189,190,191,192,193,198,201],q_:[172,176,177,178,186,187,189,191,192,193,196,197],q_a:186,q_alone_network:[38,176],q_backup:191,q_data0:189,q_data1:189,q_data:189,q_dim:38,q_gather:172,q_learn:[6,32,36,43,127,133,175,179,187],q_loss:189,q_network:[38,176],q_nstep_sql_td_data:190,q_nstep_sql_td_error:190,q_nstep_td_data:[63,126,128,129,190],q_nstep_td_error:[60,126,128,129],q_nstep_td_error_with_rescal:60,q_retrac:172,q_s_a:190,q_targ:191,q_tot:38,q_twin_loss:189,q_valu:[33,35,37,38,43,47,48,57,63,126,128,129,133,150,151,162,172,175,176,177,178,179,186,187,189,192],q_value_dict:[178,192],q_value_twin:[178,192],qac:[6,32,35,36,177,178,192],qbert:[135,141,151,161,202],qbert_dqn_config:161,qbert_dqn_config_k8:161,qbert_dqn_system_config:161,qbertnoframeskip:161,qi:173,qmix:[6,32,35,36,40,44,133,141,176,182,194,202],qmixpolici:[6,44,186],qn:29,qn_output:29,qntd:[150,151],qntd_rescal:[150,151],qr:175,qrdqn:[29,36,133,141,182,194,202],qrdqn_nstep_td_error:175,qrdqnhead:30,qrdqnpolici:175,qtran:[141,186],quad:[171,172,193],qualiti:[108,134,152,197,199],quantifi:188,quantil:[29,37,175],quantile_embedding_s:[29,37,175],quantile_net:29,quantilehead:30,quantiti:[199,201],quatilehead:29,queri:[75,89],question:[149,166,197],queue:[68,79,81,96,105,154,157,163,199],queue_siz:68,quick:[154,182,194,199],quickli:[149,154,165,187],quit:[78,88,117,153,154,166,199],quotat:195,r0:195,r2d2:[6,44,150,151,179,202],r2d2polici:[6,44],r2d3:125,r:[43,156,158,159,166,173,174,175,176,178,179,186,187,188,189,190,191,192,193,196,197],r_0:172,r_:[128,171,181,185,187,191,193,196,197],r_k:172,r_t:[133,172,181,185,191,196,197],rabbat:174,race:27,radford:185,radio:154,rai:[178,189,192],rainbow:[6,29,37,44,129,133,141,175,182,194,202],rainbowdqn:[36,187],rainbowdqnpolici:[6,44,187],rainbowhead:[30,37,187],rais:[12,19,21,23,25,26,27,58,82,92,93,96,105,107,115,144,153,154,156,169,188,197],ram:[4,120],ramachandran:187,ramwrapp:[5,120],randint:[131,190],randn:[29,33,34,37,171,175,178,179,181,185,187,192],random:[0,4,8,58,69,75,82,122,130,147,149,163,178,183,187,188,190,192,194,197,199],random_:[42,178,189,192],random_act:135,random_collect_s:[130,178,192],random_data:199,random_polici:[130,199],random_token:[9,16],randomli:[17,42,104,122,155,163,178,188,189,192,194,197],randompolici:199,rang:[38,75,78,91,115,118,119,121,125,126,131,135,136,138,146,147,155,156,163,164,165,172,176,181,183,189,190,192,193,195,199,200],range_valu:[123,142],rank0:[134,156,166],rank:[82,90,107,127,156,157,166],rapid:185,rashid:[174,176,177,186],rate:[26,27,40,41,42,43,45,46,47,48,75,141,163,178,179,187,189,192,201],rather:[58,96,134,163,173,175,177,179,199],ratio:[45,62,64,74,119,145,163,172,184,185,197,199],ratio_gath:172,raw:[4,28,49,50,52,53,56,120,158,159,181],rcwmc:161,re:[53,127,173,175,191],reach:[56,59,63,101,107,134,136,147,153,154,157,163,173,188,197,199],reachabl:4,react:58,reaction:58,read:[0,84,88,105,108,132,154,155,157,165,169,188,199],read_config:1,read_config_yaml:1,read_fil:86,read_from_ceph:86,read_from_fil:86,read_from_mc:86,read_from_path:86,read_from_redi:86,read_from_redisclust:86,reader:188,readi:[161,169],readm:202,ready_ob:[3,146,147,199],real:[8,33,79,91,135,144,147,178,183,192,197],realiz:[107,154,165],realli:[135,199],realloc:151,reason:[96,117,134,140,169,179,181,187,188,190],rebas:[168,169],receiv:[17,23,81,90,96,117,129,149,154,157,174,188,197,199,200],recent:[4,108,120,173,183,191],recogn:23,recognis:120,recognit:133,recommand:160,recommend:[19,23,58,75,129,132,135,147,149,151,154,159,166,167,169,175,181,188,195,199],record:[25,26,40,41,43,45,46,102,107,108,134,142,149,155,156,160,163,166,172,199,200,201],record_target_v:190,recorddict:26,recurr:[47,133,171],recurs:[82,127,172,181],recycl:154,red:[6,51,158,159,188],red_irl_model:[6,51,202],reddi:190,redefin:180,redi:[84,85,140],redisclust:[84,85],redisu:75,redrewardmodel:51,reduc:[74,81,91,107,151,171,173,177,179,184,192,197,199],reduce_result:91,reduct:[69,129,171,181,188,190,192],reevalu:73,ref:166,refer:[2,4,28,29,31,33,34,35,37,38,40,41,42,43,45,46,47,48,53,62,63,69,75,76,77,78,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,105,107,108,117,123,126,127,128,130,133,135,136,140,141,154,155,157,160,162,165,168,169,182,189,191,194,195,197,199,200],referenc:138,reflect:[75,197],refus:[15,21,23,163],regard:[27,135,140,149,154,193],regardless:107,region:172,regist:[25,27,40,41,42,43,45,46,47,48,58,96,105,107,123,124,132,134,157,162,165,166,172,175,176,177,178,179,181,184,186,187,189,192],register_attribute_valu:[108,123,142],register_hook:[107,156,157,166],register_learn:166,register_learner_hook:[106,164,165],register_wrapp:[164,165],registr:[117,124],registri:[40,41,42,43,45,46,47,48,122,162,172,175,176,177,178,179,181,184,186,187,189,192,194,202],registry_factori:202,regrad:190,regress:[29,33,75,175,178,192],regressionhead:30,regul:[121,136,176],regular:[41,42,45,176,177,178,182,184,189,190,191],regularli:157,reinforc:[40,41,46,47,120,124,131,133,136,149,151,154,155,171,173,174,175,176,177,178,179,180,181,185,186,187,188,189,190,191,193,194,196,197,199],reinnforc:135,reinstal:[140,151],reject:154,rel:[91,165,172,187,188,189,190,193],relat:[3,4,27,91,107,108,123,124,127,131,134,140,149,151,154,157,160,162,165,167,169,176,180,188,189,191,195,197,199,200,202],relationship:[149,151,152,154,155,157,186,191,197],releas:[3,43,82,88,101,118,147,153,154,157,169,178,192,194],release_spac:82,relev:[149,151,183,193,194],reli:[173,176,177],reliabl:199,reload:19,relu:[28,29,33,34,37,75,134,171,175,178,179,181,185,187,192],remain:[81,131,133,144,157,173,192,199],remain_data_count:81,remark:187,rememb:123,remi:[172,181],remind:188,remot:[154,168,169],remov:[38,67,84,108,114,134,140,149,163,176,186,190,191,199],remove_data_count:108,remove_fil:86,renam:199,render:[4,148,149,200],reocrd:160,reorder:26,reourc:104,repali:107,repaly_buffer_idx:108,repara_:189,reparameter:[29,33,178,189,192],reparameterizationhead:30,reparametr:189,repeat:[4,29,120,144,147,151,157,178,189,192,197,199],repeatedli:197,repetit:152,replac:[3,108,149,172,179,185,193,197],replai:[2,3,6,42,47,48,79,109,118,122,133,152,155,156,157,162,166,172,173,175,178,179,181,182,189,190,191,192,194,196,197,199,200,201],replay_buff:[6,101,109,118,119,121,125,129,130,135,136,162,163,199,200,202],replay_buffer_demonstr:190,replay_buffer_idx:[108,156],replay_buffer_new:190,replay_buffer_s:[108,125,135,136,162,163],replay_path:[2,3,135,200],replay_unique_id:[108,156],replaybuff:181,replaydataset:67,replic:[75,131],replica:161,repo:[138,160,169,178,192],report:[147,168,169,188],repositori:[94,167,168,169],repres:[19,21,78,92,133,136,149,184,186,197,200],represent:[75,177,187,193,197],reprocess:149,reproduc:[108,131,200],request:[12,14,15,17,19,20,23,68,123,152,157,161,167,168,169],request_retri:[17,19,23],request_retry_wait:[17,19,23],requestexcept:[19,20,23],requir:[40,41,45,46,61,77,108,124,125,133,135,136,138,147,149,151,157,161,163,165,167,177,193,195,197,200],requires_grad:[61,127,181,188,189],requires_grad_:189,requri:167,res_block:[6,28,70],res_typ:75,resampl:187,resblock:[6,28,70],rescal:[47,63,150,151],research:[117,133,138,191,194],reset:[2,3,4,27,40,46,48,58,75,93,94,101,108,120,124,130,131,133,135,136,143,144,146,147,148,149,155,162,164,165,178,189,192,199],reset_env:[94,199],reset_nois:75,reset_param:[3,146,147],reset_paramet:75,reset_polici:[94,130,199],reset_st:124,reset_timeout:[146,147],resfcblock:[6,28,70],reshap:4,resid:157,residu:[56,75,82,101,133,173,181],residul:82,resnet:173,resolut:169,resolv:[26,169],resouc:104,resourc:[3,90,96,100,104,107,147,149,152,153,154,157],resource_info:104,resource_manag:[6,103,202],respctiv:129,respect:[3,79,92,125,134,154,169,172,174,175,178,181,188,189,190,192,197,199],respond:157,respons:[12,14,15,149,155,157,162,199],responseexcept:[13,16],rest:120,restart:[149,161],restor:[40,43,45,46],restrict:[4,184,185,199],result:[4,17,19,20,21,25,26,29,37,38,40,41,43,45,46,63,69,72,75,76,82,87,89,91,95,96,108,114,115,121,123,131,135,136,144,147,149,151,153,154,155,157,163,165,166,171,173,175,176,177,178,179,181,182,183,184,185,186,187,189,192,193,197,199,200],results_dir:136,resum:200,ret:[27,38,63,64,78,82,156,166,172,176,186],retain:144,retrac:182,retri:[17,19,23,146,147,199],retriev:[96,105,107,124,172],retry_waiting_tim:[146,147],return_:[171,181,185],return_t_plus_1:181,return_valu:8,returnkei:[33,178,192],returnn:3,returnskei:[25,33,34,35,37,39,40,41,42,43,45,46,47,48,108,171,175,177,178,179,185,187,192],reulst:123,reus:[159,165,184],reveng:[187,188],revers:[26,78,159,172,181],revert:159,review:[167,168,169,183],revisit:187,rew:[147,188],rew_shap:[4,148,149],rew_spac:[135,148,149],reward:[0,3,4,6,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,57,59,63,64,66,95,107,108,117,118,120,121,126,127,128,129,133,134,148,149,160,162,163,172,175,176,177,178,179,180,181,182,183,184,186,187,189,190,191,192,193,194,198,199,200,201,202],reward_discount:4,reward_factor:53,reward_max:134,reward_mean:[134,138,187,188,201],reward_min:134,reward_model:[0,49,50,52,53,54,118,132,188,202],reward_rang:4,reward_std:134,reward_t:53,rewardnormenv:[5,120],rewrit:[52,53,54,73,125,127,154,188],rewritten:200,rf:[150,151],rgb:[135,197],rho:[61,64,66,172,176,178,181,189,191,192],rho_:[175,181,189],rho_clip_ratio:[66,181],rho_pg_clip_ratio:[66,181],rho_t:[172,181],rich:155,richer:186,riedmil:179,right:[91,126,135,136,138,171,172,175,178,179,184,185,187,189,191,192,193],right_ok:[158,159],ring:127,rishabh:187,rl:[6,40,41,42,43,45,46,47,48,49,50,66,82,117,122,124,133,136,149,160,162,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,199,200,202],rl_tuil:[6,60],rl_util:[6,60,63,128,133,150,151,172,175,181,190,199,200,202],rl_utilr:133,rllab:[178,189,192],rllib:[141,178,189,192],rm:[4,120,150,151],rmsprop:[6,70],rnd:[182,194,202],rnd_rew:188,rnd_reward:188,rnd_reward_model:[188,202],rndnetwork:182,rndrewardmodel:182,rnn:[6,38,43,47,70,122,124,171,175,176,179,185,186,187,194],robot:[193,197],robust:[27,138,190,193,199],rock:155,rollout:[173,193],romoff:174,room:188,root:[91,140],rosin:173,round:[118,155,174],rout:197,row:[53,188],rowland:[175,187],rsampl:189,rst:167,rstep:147,rt:155,rudner:[174,176,177,186],rudolph:185,rule:[52,136,155,160,165,166,167,173,178,199],run:[0,2,3,4,19,23,25,29,34,37,68,81,92,93,105,120,131,132,134,135,136,138,140,144,146,147,149,150,151,154,156,157,161,163,165,167,169,171,175,181,183,185,187,188,194,195,197,199],run_until_ctrl_c:[153,154],runnabl:127,runningmeanstd:[5,120,188],runtim:[105,107,149,195,199],runtimeerror:92,rwlock:88,rwlockfaird:88,ryan:177,s10472:173,s1:53,s2:53,s3:[25,84],s41586:193,s:[0,2,3,17,19,23,25,26,27,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,56,58,67,69,72,75,78,79,81,82,88,89,91,92,93,94,96,101,102,105,107,108,114,117,118,121,123,124,125,129,130,131,132,133,134,135,138,140,144,145,147,155,156,157,159,161,162,163,166,167,169,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,189,190,191,192,193,196,197,199,200],s_0:[117,196,197],s_1:[117,196,197],s_2:197,s_:[128,133,171,176,177,178,184,185,187,191,196,197],s_i:181,s_n:[179,196,197],s_size:53,s_t:[128,133,179,191,196,197],sac:[42,133,141,178,182,188,191,192,194,202],sacpolici:189,safe:[26,81,108,147,172],safeti:88,sai:[173,188,197,199],said:173,same:[2,4,8,29,33,34,37,40,41,43,45,46,58,62,63,68,75,78,90,92,94,107,108,115,120,121,123,125,126,127,131,134,135,147,149,154,155,157,160,161,162,165,169,171,175,178,181,185,186,187,188,189,192,193,197,199,200],same_shap:[6,70],samller:197,sampl:[4,17,29,39,40,41,42,43,45,46,47,48,56,61,63,64,69,94,96,102,108,115,118,119,120,121,122,124,125,129,133,134,138,144,152,155,157,162,165,172,173,175,176,177,178,179,180,181,183,184,186,187,188,189,190,191,192,193,194,196,197,199,200,201],sample_act:190,sample_check:163,sample_collector:199,sample_data:108,sample_data_count:108,sample_min_limit_ratio:163,sample_rang:108,sample_s:121,sample_serial_collector:[6,98,202],samplecollector:[98,199,200],sampled_data:108,sampled_out:134,sampleddataattrmonitor:123,sampler:69,samplewrapp:124,samvelyan:[174,176,177,186],santurkar:185,sarsa:[178,189,192],satind:193,satisfi:[27,58,197],save:[0,2,3,27,34,40,43,45,46,67,84,89,90,94,96,105,107,123,124,127,133,134,147,149,156,157,163,165,166,171,185,187,197,199,201],save_cfg:[0,138,200],save_checkpoint:[25,67,107,138,156,157,166,199,200],save_ckpt:[164,165],save_ckpt_after_it:[164,165],save_ckpt_after_run:[107,156,164,165],save_ckpt_freq:107,save_config:1,save_config_pi:1,save_config_yaml:1,save_fil:86,save_file_ceph:86,save_file_redi:86,save_file_redisclust:86,save_format:0,save_path:0,save_prev_st:[124,133],saveckpthook:[106,164,165],saved_hidden_st:133,saved_hidden_state_timestep:133,sawicki:183,sb3:141,sc2:[141,199],scalabl:[66,127,136,177,180,181,194],scalar:[40,41,43,45,46,62,68,71,193],scale:[4,38,135,136,144,154,159,172,174,188,189,191,194],scale_factor:75,scaledfloatfram:[5,120],scatter:[75,150,151],scatter_connect:[6,70,150,151],scatter_typ:75,scatterconnect:[6,70],scenario:[149,163,176,180,186],scene:[4,144],schaul:187,schduler:67,schedul:[67,154,169,194],scheme:[160,177,199],schmitt:193,schrittwies:[173,193],schroeder:[174,176,177,186],schulman:[184,185],scipt:82,scissor:155,score:[134,135,138,199],scott:192,scratch:[117,169],screen:135,script:[127,161,167,202],scriptmodul:28,sea:136,search:[140,165,173,183,193,194,197],sec:142,second:[11,17,19,23,81,92,93,114,134,144,155,161,163,177,181,189,192,195,201],secondari:154,section:[82,121,123,125,130,133,165,167,169,195,197,199,200],sedol:173,see:[4,26,28,29,33,34,37,52,53,54,75,82,93,114,123,130,133,140,157,161,165,171,173,175,178,179,181,185,187,192,195,199,200],seed:[0,3,82,117,122,127,136,138,146,147,148,149,150,151,187,188,194,199,200],seek:[190,197],seem:134,seen:[157,165,188],segment:[90,91,108,163,199],segment_tre:[6,86,202],segmenttre:[6,86],seiral:117,select:[0,27,138,154,155,160,173,174,178,179,183,187,189,192,197,199],select_fn:27,self:[2,4,8,14,15,20,23,27,28,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,79,83,91,107,108,120,123,124,126,127,128,129,130,131,133,142,153,154,155,156,162,164,165,166,173,176,178,181,187,188,189,190,191,192,194,199],self_featur:38,self_feature_rang:[38,176],self_token_invalid:[14,15],self_token_not_found:15,self_token_not_given:14,selfplay1_evaluator_step:138,selfplay2_evaluator_step:138,selfplay_demo_ppo:138,selfplay_evaluator1:138,selfplay_evaluator2:138,semi:177,send:[17,19,81,100,102,105,133,134,147,152,157,197,199],send_collector_task:100,send_learn_info:[105,156,157],send_learner_task:100,send_metadata:96,send_polici:[105,156,157],send_stepdata:96,sendpolicyhook:105,senet:54,sensit:189,sent:[19,20,23,90,96,105,112,147,149,153,154,157,199],sentenc:[166,167],sep:173,separ:[3,118,121,134,151,163,166,167,172,173,177,178,184,189,190,191,192,199],seq:75,seq_len:[75,150,151],sequenc:[28,68,78,107,128,133,157,162,181,197,202],sequence_op:63,sequencetyp:[28,29,33,34,35,37,171,175,177,178,179,181,185,187,188,192],sequenci:194,sequenti:[38,75,92,134],sequential_pack:[6,70],sergei:190,seri:[133,149,154,160,197,199],serial:[40,41,43,45,46,47,48,94,101,107,108,117,127,129,138,147,157,162,163,172,175,176,177,179,181,184,186,187,194,200],serial_collector:132,serial_entri:[107,117,131,202],serial_entry_il:[117,202],serial_entry_reward_model:202,serial_entry_sqil:190,serial_pipelin:[0,107,117,125,127,130,131,132,135,136,150,151,187,199],serial_pipeline_il:117,seriou:188,serv:161,server:[2,17,19,23,154,160,161,199],servic:[8,14,152,157,161,194,202],set:[2,3,4,27,28,29,33,34,37,38,40,41,43,45,46,48,49,52,53,54,58,62,63,68,69,72,73,75,79,82,89,90,91,96,107,117,118,119,121,125,126,127,128,129,130,131,133,134,135,136,138,141,142,144,147,149,151,152,154,156,157,159,160,162,163,166,169,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,194,195,197,199],set_pkg_se:[86,131,138,200],set_set:174,setalgolin:191,setattr:[123,127,156],setkwinout:191,setlevel:89,setstretch:191,setter:[156,166],settinng:75,setup:[4,29,33,34,37,107,156,166,167,171,175,178,181,185,187,192,195,200],setup_dataload:[107,156,157,166],sever:[47,48,79,85,115,131,135,136,154,157,163,172,187,199],sh:202,shane:181,shape:[3,4,26,28,29,33,34,35,37,38,40,41,42,43,45,46,47,48,53,55,57,58,59,61,62,63,66,68,71,74,75,78,120,129,135,138,147,148,149,150,151,160,166,171,172,175,176,177,178,179,181,184,185,186,187,189,190,192],shapingin:138,share:[3,25,26,27,28,34,45,127,136,155,162,163,165,171,174,177,181,184,185,187,192],share_encod:[34,171,181,185],shared_memori:[139,140,146,147,148,149,161],shared_payoff:[6,24,202],shell:[127,195,201],shibani:185,shimon:[174,176,177,186],shmbuffer:5,shmbuffercontain:5,shogi:193,shonw:127,shoul:[62,160,162],should:[25,26,27,38,41,47,54,56,58,59,63,67,69,75,78,79,90,91,92,96,101,105,107,108,114,115,120,121,123,124,125,126,127,128,129,132,133,135,149,152,157,160,161,163,166,167,169,172,176,181,185,188,189,193,195,197,199,200],should_ev:[138,199,200],shouldn:67,show:[2,17,107,115,120,124,125,128,136,144,154,157,161,172,184,187,188,192,199,200,201],show_hook:[164,165],shown:[55,57,62,66,115,119,126,131,133,135,138,144,147,149,155,161,175,176,177,178,179,181,184,185,186,187,189,190,192,193,199,200,201,202],shuffl:75,shut:[14,15,81],shutdown:[8,14,15,19,23,102,153,154],siddharth:190,side:[49,50,52,53,54,75,82,154],sifr:193,sig_dfl:93,sigalrm:93,sigma0:75,sigma:[29,33,42,58,178,189,192],sigma_typ:[29,34,171,181,185],sign:[4,65,120,166,187],signal:[19,23,93,178,189,192,196,197],signatur:[4,52,53,54],signific:[173,197],significantli:[127,136],signl:108,silver:[171,173,175,178,179,187,193],sim:[58,172,174,175,176,178,189,191,192],simga0:75,similar:[39,40,41,42,43,45,46,47,78,115,121,133,147,154,155,160,165,178,180,181,184,188,192,195,199,200,201],similarli:[154,177],simon:193,simonyan:[173,181,193],simpl:[4,17,20,93,114,118,126,133,140,147,149,154,157,159,160,161,165,169,173,189,190,193,197,199,200],simpler:[165,185,199],simplest:[117,183],simpli:[40,43,45,46,82,127,136,159,165,178,180,181,183,192,195,197,199,200],simplic:188,simplif:193,simplifi:[114,147,159],simul:[82,144,149,183,197,199],simultan:178,simutan:118,sinc:[4,26,40,41,46,123,129,151,177,178,181,188,189,192,199],singh:193,singl:[53,73,82,115,125,126,127,135,147,152,155,174,177,178,181,192,194,197,199,200],single_step:[38,176,186],singleton:149,singletonmetaclass:86,site:[150,151,160],situat:[154,165,169,190,197],six:144,size:[4,28,29,33,34,35,37,38,40,41,43,45,46,47,53,55,57,58,59,61,62,63,64,66,71,75,78,79,105,108,118,121,123,136,145,147,151,163,171,172,175,176,177,178,179,181,185,186,187,189,190,192,199],size_averag:74,sketch:188,skip:[4,120,123],sl:114,slave:[6,13,14,16,17,19,79,96,105,112,152,153,156,157,202],slave_already_connect:15,slave_connection_refus:15,slave_disconnection_refus:15,slave_not_connect:15,slave_token_invalid:14,slave_token_not_given:14,slavechannelinvalid:[13,16],slavechannelnotfound:[13,16],slaveconnect:[16,18],slaveconnectionproxi:[16,18,19],slaveerrorcod:[13,16,19],slavemastertokeninvalid:[13,16],slavemastertokennotfound:[13,16],slaveresponseexcept:[13,16],slaveselftokeninvalid:[13,16],slaveselftokennotfound:[13,16],slaveslavealreadyconnect:[13,16],slaveslaveconnectionrefus:[13,16],slaveslavedisconnectionrefus:[13,16],slaveslavenotconnect:[13,16],slavesuccess:[13,16],slavesystemshuttingdown:[13,16],slavetaskalreadyexist:[13,16],slavetaskrefus:[13,16],sleep:[17,19,23,68,142],slice:108,slide:123,slightli:75,slow:[131,145],slowli:178,slurm:[0,92,127,154,199],slurm_dist:202,slurm_dist_multi_gpu:202,slurm_help:202,slurm_parallel:202,smac:[38,152,176,177,186,197,199,202],small:[48,143,144,145,159,163,175,181,187,188,190,192],smaller:[93,101,181,188],smallest:[48,175,187],smoo:[42,178,192],smooth:[74,182],smooth_ratio:74,snapshot:[25,27,155],snapshot_or_not:25,snapshot_play:27,snippet:[136,167,188],so:[17,19,38,62,78,82,90,92,94,107,108,114,115,120,123,125,127,130,133,134,138,149,150,151,154,155,157,163,165,169,172,176,179,186,188,191,197,199],socket:92,soft:[42,74,75,178,189,190,191,192,196],soft_argmax:[6,70],soft_q_:189,soft_q_valu:190,softargmax:[6,70],softfocalloss:[6,70],softmax:[69,187,190,191],softqnet:189,sole:173,solo:[26,101],solo_parallel_command:[6,103,202],solosharedpayoff:[26,27],solut:[117,140,172,199],solv:[95,131,133,157,162,166,172,173,174,188,193,197,199],some:[0,4,27,28,40,43,45,46,47,49,50,52,53,54,59,63,75,91,93,94,95,107,108,114,115,117,119,120,121,122,123,124,125,128,129,133,134,135,140,144,147,149,151,155,157,159,160,162,163,165,166,169,172,173,179,181,188,190,191,193,194,195,197,199,200,202],some_kei:78,some_seq:78,someth:[88,142,153,154],sometim:[4,115,120,140,152,163,166,197,199],son:186,song:180,sonnerat:186,soon:[19,23],sort:[26,79,107],soup:138,sourc:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,58,67,68,69,73,74,75,79,81,82,83,88,90,91,92,93,94,95,96,100,101,102,104,105,107,108,120,121,132,138,154,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,202],south:138,soyer:181,sp:[27,155],space:[2,3,4,33,34,37,61,66,75,82,101,120,124,126,130,133,141,148,149,160,171,172,173,175,176,177,178,179,180,181,184,185,186,187,189,190,191,192,193,198],spaceinvad:127,spaceinvaders_dqn_config_multi_gpu_ddp:127,spaceinvaders_dqn_config_multi_gpu_dp:127,spaceinvaders_dqn_main_multi_gpu_ddp:127,span:23,spars:[40,41,43,45,46,47,48,117,135,138,175,176,177,179,184,186,187,188,190,197],spatial:[75,176],spatial_s:75,speak:[147,165,191],spec:161,special:[63,64,94,134,149,155,169,187,199],specif:[27,29,94,96,107,108,118,124,135,136,140,147,149,151,154,155,156,157,159,160,161,162,163,166,167,169,178,179,189,192,193,194,195,197,199,200],specifi:[68,71,75,92,94,117,123,125,130,133,140,147,161,165,167,178,187,199,200],speech:133,speed:[58,131,147,151,152,163,172,177,179,181,187,194,195,199],speedup:151,spend:134,sphinx:167,spiningup:141,spinningup:[178,189,192],split:[56,75,82,114,123,133,172,181,184,199],split_data:181,splite:82,splitter:114,spot:27,sqil:[117,182,194],sql:190,sqlpolici:190,sqn:[133,182,194,202],sqrt:[58,65,173,183,187],squar:172,squash:189,squeez:[26,86,189],squeezebackward1:[33,34,171,178,181,185,192],src:90,src_arr:3,src_checkpoint:25,srun:[127,199],ss_loader:114,stabil:[154,155,169,172,178,191],stabl:[69,75,107,161,175,178,194],stabler:120,stack:[4,39,40,41,42,43,45,46,47,48,56,120,135,176,188,199],stackrel:181,stage:[118,120,155,173,190],stai:[78,138],stale:[108,123,163,199,201],staleness_avg:[123,134],staleness_max:[123,134],stand:[75,135,154],standard:[52,58,92,114,134,144,170,176,185,188,199],standbi:[154,157],starcraft2:[143,144,155],starcraft:[27,78,174,176,177,186],starcraft_play:[27,202],start:[8,17,19,20,23,42,43,48,58,68,84,91,92,93,96,100,102,105,107,108,120,125,132,133,135,136,149,153,154,155,156,157,162,163,165,166,169,173,175,178,179,187,189,192,194,199],start_fail:20,start_tim:[93,102],startup:154,state:[2,4,28,35,38,40,41,43,45,46,47,49,50,52,53,58,59,63,64,75,94,102,105,108,117,120,124,128,136,146,147,148,149,154,162,163,165,174,176,177,178,179,181,183,186,187,188,189,190,191,192,193,198],state_action_input:189,state_dict:[40,43,45,46,67,102,105,107,108,117,127,156,157,163,199,200],state_dict_handl:174,state_dict_mask:67,state_dim:38,state_id:124,state_info:124,state_num:[124,133],stateless:[148,149],statement:166,stationari:175,statist:[163,199],statu:[11,12,17,19,20,147,152,153,154,155,165,188],status_cod:[12,19],std:[4,62,120,188,189,199],sted:128,stefano:180,step2:187,step:[2,3,4,19,23,27,39,40,41,42,43,45,46,47,48,56,58,63,64,66,73,79,82,96,101,108,117,118,120,122,123,124,126,127,129,132,133,135,136,138,141,143,144,146,147,148,149,150,151,155,162,164,165,169,171,172,175,178,179,181,182,184,185,188,189,190,191,192,193,194,197,199,200,201],step_count:134,step_timeout:[146,147],step_wait_timeout:[146,147],stepdata:[96,105],still:[4,17,19,23,92,105,133,134,135,138,147,149,153,154,157,169,173,188],stocat:197,stochast:[180,187,188,189,190,193,196,197],stop:[68,81,93,101,153,154,190,199,200],stop_flag1:138,stop_flag2:138,stop_flag:199,stop_valu:[135,136,138,157,161,199],storag:[2,152],store:[3,40,46,69,94,96,105,108,121,133,134,147,157,161,163,178,189,192,194,197,199],storkei:188,stpe:155,str:[0,2,3,8,12,17,19,20,21,23,25,26,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,52,53,54,56,58,67,68,69,73,74,75,77,78,79,82,84,85,88,89,92,93,94,96,100,101,102,104,107,108,123,128,133,142,153,154,156,158,159,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192],straightforward:181,strategi:[27,39,40,41,45,46,47,124,129,155,165,174,175,188,189,190,192,197,200],strcutur:4,stream:[187,188],strict:[40,43,45,46,67],stride:75,string:[23,27,84,89,102,114,149,159,200],strong:27,strong_win_r:27,stronger:[58,155],strongli:[58,154],structencod:30,structur:[8,12,17,26,81,91,112,114,120,124,154,155,159,160,173,186,188,194,199,200],struggl:117,stuck:[147,177],studi:[136,173,185],style:[169,192,199],sub:[82,117,135,138,147,156,159,166,177],sub_:190,subclass:[23,68,92,107,120,149,163,165,166,199],subfold:134,subjec:172,subkei:82,submiss:167,submit:[152,167,169],submodul:199,subprocess:[3,135,143,144,147,187,190,199],subprocess_env_manag:[5,6,148,149,152,199],subprocessenvmanag:152,subsequ:[175,188,197],substanti:[167,187],substitut:75,subtl:181,subtract:[181,188],succe:[26,155],succeed:161,succes:[135,138],success:[12,14,15,19,23,26,112,136,151,153,154,157,183],successfulli:[151,155,157,169,195],suffer:[180,186,192],suffici:[140,193,197,199],suffix:200,suggest:[114,169,195],suitabl:[152,169],sum:[4,43,47,48,59,91,114,120,123,126,142,153,154,162,172,175,179,186,187,189,190,191,193,196,197,199],sum_:[91,171,173,175,177,178,179,181,183,186,187,189,191,192],sum_a:[181,191],summar:199,summari:[49,52,53,54,107,155,197],summarywrit:[49,52,53,54,89,107,108,138,188,200],sumsegmenttre:91,sunehag:186,superclass:[8,82],superhuman:[183,193],superset:199,supervis:[27,74,117,173,190,193,196,199],suport:0,suppli:161,support:[3,8,17,20,26,43,48,58,68,69,73,75,77,84,93,110,116,123,124,125,127,129,131,132,133,135,138,147,152,154,159,161,163,165,171,172,175,176,179,181,184,185,186,187,188,190,194,195,199,200,202],suppos:[95,199],sure:[17,19,23,27,45,88,123,124,129,130,133,169,188,195,199],surpass:[166,173,179],surrog:180,surround:197,suscept:192,sutton:63,sv:138,swap:114,sweep:136,swig:195,sy:169,symbol:[40,41,42,43,45,46,47,48,167,172,175,176,177,178,179,181,184,186,187,189,192],sync:[107,127,143,144,146,147,162,166,169],sync_gradi:[127,162],syncbn:75,synchron:[93,127,157,169,181,199],syncsubprocessenvmanag:[5,139,146,147,194,199],syntax:167,synthesi:134,system:[0,84,87,96,102,105,107,131,132,134,135,151,157,159,163,166,177,180,195,197,199],system_cfg:0,system_config:[161,199],system_help:[6,86,202],system_shutdown_flag:102,system_shutting_down:[14,15],t:[38,40,46,56,57,58,59,61,62,63,64,66,67,75,77,78,82,92,95,107,127,128,130,133,147,150,151,155,166,171,172,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,193,196,197,199,200],t_traj:[63,64],tabish:[174,176,177,186],tabl:[134,144,167,179,190,197,199],tabular:[89,188],tag:195,tail:163,take:[2,4,40,41,45,46,47,61,66,75,77,120,121,123,125,128,130,132,133,155,157,162,165,174,177,179,184,186,188,189,190,193,194,197,200],taken:[64,92,136,193,197],tamar:177,tamer:174,tanh:[29,189],tar:[134,200],targ:[178,184,189,192],target:[0,27,39,40,41,42,43,46,47,48,63,64,66,71,74,91,92,94,124,126,128,129,150,151,160,162,164,165,169,172,174,175,176,177,179,181,182,186,187,188,189,190,191,193,197],target_:[40,41,43,46,47,176,177,179,186],target_extra:71,target_featur:188,target_log_polici:189,target_new_data_count:118,target_ob:[47,133],target_output:[61,64,66,181],target_pi:172,target_q_act:[126,128,129,133],target_q_valu:[57,126,128,129,133,178,189,191,192],target_theta:[42,178,189,192],target_update_freq:[135,162],target_v:190,target_v_valu:191,target_valu:189,targetnetworkwrapp:[124,164,165,178,192],tarmac:174,tarun:177,task:[6,14,15,16,17,18,19,21,23,27,96,101,102,104,112,120,132,133,138,144,149,152,153,155,157,165,166,169,174,175,176,189,193,197,199],task_already_exist:15,task_count:101,task_data_invalid:14,task_id:[20,101,102],task_info:[96,156],task_refus:15,task_spac:101,taskfail:[16,22,23,96,153,154],taskrefus:[16,22,23],taskresulttyp:[16,18],taskstat:[6,103],taskstatu:[16,18,153,154],tassa:178,tate:102,tau:[29,37,117,175,177,178,186,191],tautolog:159,tb:[69,108,134,199],tb_logger:[49,52,53,54,89,107,108,118,123,125,138,156,157,166,188,200],tbd:[173,174,183,193,199],tcc:191,td3:[42,123,141,178,182,188,189,194,197,202],td3polici:192,td:[6,41,43,45,60,122,126,129,133,150,151,175,177,179,184,187,190,191,192,194,196,197,199,202],td_:[41,177],td_data:[126,178,192],td_data_twin:[178,192],td_error:[63,190],td_error_per_sampl:[63,126,128,129,178,189,190,192],td_error_per_sample0:189,td_error_per_sample1:[178,189,192],td_error_per_sample2:[178,192],td_error_per_sample_:126,td_lambda:63,td_lambda_error:60,teach:125,teacher:[160,164,165],teachernetworkwrapp:[164,165],team:169,techniqu:[186,197],tell:121,temper:197,temperatur:[183,189,191],templat:[6,32,43,127,133,147,149,160,161,167,170,171,175,176,177,178,179,181,185,186,187,192,202],tempor:[6,60,75,133,178,181,192,193,199],temporarili:147,ten:123,tend:[180,187,197],tendenc:197,tensor:[28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,53,55,56,57,58,61,62,63,64,66,68,69,71,72,74,75,78,79,84,90,94,126,127,129,160,171,172,175,176,178,179,181,185,186,187,188,189,190,192,197,199],tensor_to_list:[6,70],tensorboard:[40,41,43,45,46,89,107,108,123,134,162,163,190,199,200],tensorboardx:200,tensorflow:182,term:[58,59,154,172,174,176,189,190,196,197],termin:[4,43,45,47,59,63,64,79,89,92,136,147,151,156,162,166,178,179,189,192,193,195],terran:27,tesla:[150,151],test:[81,85,117,136,138,144,150,151,167,169,195,199,200,202],test_cach:81,test_ga:151,test_overcooked_env:138,test_serial_entry_il:117,text:[0,40,41,43,45,46,69,89,100,108,123,134,162,163,172,175,176,178,179,183,185,187,189,191,192,193,199],text_level:89,text_logg:[156,166],textbf:[176,177,186,191],textlogg:89,texttt:192,tfboard:89,tfevent:134,th:[4,120,134],than:[4,27,43,58,75,79,91,95,96,101,121,123,128,134,144,155,156,159,160,163,169,173,175,177,179,181,185,186,188,193,197,199],thei:[31,79,96,108,115,123,136,151,154,155,162,163,165,172,181,187,190,191,192,197,199,201],them:[27,55,57,62,66,75,123,124,128,130,133,154,155,163,178,181,186,190,197,199,201,202],themselv:[2,27,199,201],theoret:190,theori:174,therebi:[45,151],therefor:[29,48,117,120,121,147,154,157,159,160,163,181,187,190,192,197,199],thereof:92,theta:[58,117,171,172,174,175,178,181,184,185,186,187,189,191,192,193,196,197],theta_1:192,theta_2:192,theta_:[171,177,178,184,185,192],theta_a:172,thi:[0,4,11,17,19,20,21,23,25,26,27,29,40,41,42,43,45,46,47,48,49,50,52,53,54,56,59,61,62,66,67,69,75,78,79,81,82,90,91,92,93,94,107,108,112,114,115,117,118,119,120,121,123,124,125,126,127,129,130,131,133,134,135,136,138,142,147,149,151,152,153,155,156,157,159,161,162,163,165,166,167,169,172,174,175,176,177,178,179,180,181,184,185,186,187,188,189,190,192,193,195,197,199,200,201,202],thing:[42,75,95,121,156,166,178,192,199],think:[187,199],thirti:177,thoma:193,thore:[186,193],those:[108,123,132,157,162,181,187,200],though:[4,159],thought:174,thread:[6,9,16,19,23,26,68,79,81,88,92,96,100,102,105,108,144,152,199],thread_lock:88,three:[118,123,134,144,155,157,165,181,187,190,194,197,199],threshold:[66,175],through:[42,92,96,117,127,132,135,136,147,149,151,154,155,157,165,166,169,173,174,178,181,187,189,192,193,195,197],throughout:[135,173],throughput:[108,134,152,199],throughtput:108,thrown:[82,147,154],thruput:163,thruput_log:108,thruputcontrol:163,thu:[136,180,190,191,193,197],tian:176,tianjun:176,tianshou:[141,143,144,178,189,192],tick_tim:[156,157,166],tickmonitor:123,ticktim:142,tild:[174,189],tim:[171,174,176,177,181,186],time:[4,11,17,19,23,42,45,58,63,64,81,92,93,102,107,108,114,115,118,119,120,123,125,127,128,133,134,141,143,144,145,147,149,150,151,155,156,157,163,164,165,166,169,178,179,181,184,187,188,189,192,193,194,197,199,201],time_:[93,108,123,142],time_help:[6,86,202],time_wrap:166,time_wrapp:[93,156],timehelp:93,timelin:142,timemod:142,timeourerror:93,timeout:[11,27,81,92,93,143,144,146,147,154,195],timer:93,timespan:19,timestamp:142,timestep:[2,3,38,39,40,41,42,43,45,46,47,56,58,61,63,66,78,129,133,135,136,146,147,162,176,181,186,190,199],timestep_col:80,timewrapp:86,timewrappercuda:93,timewrappertim:86,timothi:[171,178,193],titl:173,tmp_retrac:172,to_devic:[6,70,199],to_dtyp:[6,70],to_list:[6,70],to_ndarrai:[6,70],to_tensor:[6,70,188,199],to_tensor_transit:98,to_typ:[110,116,158,159],todo:[138,166,168,169,191],togeth:[114,159,190,199],toi:126,token:[8,14,15,17],toler:[19,199],tolist:129,tom:[114,178,181,187],toni:166,too:[114,118,134,152,163,178,185,188,199],tool:[108,120,165,194,195,199,200],top:[82,172,173,197,199],torch:[6,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,53,55,56,57,58,59,61,62,63,64,66,67,68,69,71,72,74,75,78,79,82,84,93,126,127,129,131,133,134,160,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,194,199,200],torch_util:[28,29,33,34,37,40,43,45,46,67,68,69,73,74,75,107,127,133,150,151,160,171,175,178,179,181,185,187,192,199,202],torchdataload:145,torr:[174,176,177,186],tot:186,total:[27,38,41,90,94,95,127,134,176,179,181,186,188,197,199,201],total_agent_step:27,total_config:[0,134,199],total_dur:134,total_envstep_count:134,total_episode_count:134,total_loss:[40,41,43,45,46,47,48,123,129],total_loss_avg:134,total_loss_v:[150,151],total_q:[38,176,186],total_q_loss:191,total_reward:4,total_train_sample_count:134,touch:167,tow:26,toward:[172,174,197],tp:191,trace:181,trace_loss:66,track:[123,163,168,169,178],track_used_data:108,tractabl:189,trade:[41,171,177,188,199],tradeoff:188,tradit:[129,193,197,200],train:[25,27,29,31,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,62,63,90,93,105,107,117,118,119,120,121,122,124,125,126,129,130,131,132,133,136,138,149,151,152,154,155,156,161,162,163,164,165,166,172,173,174,175,176,177,179,180,181,182,184,186,187,189,190,191,193,194,195,196,197,201,202],train_config:117,train_data:[118,119,121,125,138,188,190,200],train_data_demonstr:190,train_data_new:190,train_episod:121,train_epoch:[45,184],train_it:[107,118,119,121,125,134,138,190,199,200],train_iter:[25,27],train_sample_count:134,train_tim:[107,156],train_time_v:[150,151],trainabl:160,trainsit:197,traj:[39,40,41,42,46,47,48,56,181],traj_len:94,trajactori:48,trajbuff:98,trajectori:[39,40,41,43,45,46,48,59,61,63,64,66,94,105,117,133,155,162,172,181,198,199],tran:193,trans_fn:[63,150,151],transfer:[68,75,79,147,197],transform:[6,8,14,15,38,56,68,70,82,110,115,116,151,176,186,188,193,199],transform_scalar:94,transformerlay:[6,70],transfrom:63,transit:[39,40,41,42,43,45,46,47,49,50,56,94,108,121,129,133,162,175,178,181,187,188,189,190,192,193,197,199],translate_dict_func:[9,16],transmiss:154,transops:75,transpos:[4,75,120],treat:[117,154,191],treatment:94,tree:[91,108,134,163,173,183,193,202],trfl:63,tri:117,triantafyllo:177,tribut:[42,178,192],trick:[47,182,188,189],trick_mod:162,trigger:[153,154,165,169],trough:[178,189,192],trpo:[172,180,185],truncat:[135,172,181,187,188],trust:[91,172],trust_cal:91,trust_region:172,trust_region_valu:172,truth:74,try_import_ceph:86,try_import_link:86,try_import_mc:86,try_import_redi:86,try_import_redisclust:86,ts:[143,144],tsipra:185,tt:[158,159],tune:[162,163,189,190,199],tupl:[0,2,3,4,26,40,41,43,45,46,53,58,68,69,73,75,82,107,124,133,185,188,197],turn:[110,116,124,138,147,154,163],tutori:[169,194],tuyl:186,tv:188,twin:[33,178,192],twin_:[42,178,192],twin_crit:[33,178,192],twin_q:189,two:[0,25,26,27,38,42,43,45,79,82,107,118,120,121,123,125,127,133,134,135,136,138,149,154,155,157,159,161,163,169,173,176,178,179,181,183,184,187,188,189,190,192,197,199,200,201],txjk:161,txt:134,type:[0,2,3,4,14,15,20,26,27,28,29,31,33,34,35,37,39,40,41,42,43,45,46,47,48,52,53,54,56,58,68,69,75,79,82,83,84,88,91,93,96,101,105,107,108,115,121,125,127,128,130,132,133,135,136,144,147,149,151,154,155,159,160,162,163,164,165,166,167,169,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200],type_:[0,88],type_help:[28,29,33,34,35,37,171,175,177,178,179,181,185,187,192,202],typeerror:[115,158,159],typic:[117,180],typo:167,u013548568:93,u:[127,173,175,177,183,184,186,189,191,199,200],u_:189,ubuntu:195,uc:173,ucolor:[158,159],uct:183,uer:79,uhlenbeck:[42,58,178,192],uid:92,uint8:135,ultim:197,uml:[112,167],unattain:173,unavail:138,unbias:197,unbound:189,uncertain:[151,190],uncertainti:[147,197],unchang:[4,68],unclear:191,uncontrol:159,undefin:[4,117],under:[127,136,138,144,151,165,169,172,179,197],underbrac:[176,179,191],underestim:175,underli:[183,188,193],underset:[187,191],understand:[122,149,157,169,180,188,194,197],understood:[157,165,180],unexpect:159,unexpectedli:142,unfamiliar:188,unfinish:147,unfreez:108,unhandl:92,unifi:199,uniform:[29,129,179,183],uniformli:[144,187,191,199],union:[3,4,27,33,34,35,37,38,39,40,41,42,43,45,46,47,48,58,72,75,78,79,82,89,94,96,108,123,128,131,142,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192],uniqu:[19,27,107,149,155],unit:[17,19,75,144,151,159,169,174,199],unittest:195,unix:[168,169],unknown:[183,197],unless:[147,169],unlik:[42,197,199],unnecessari:[154,199],unpredict:154,unrealist:154,unrol:[39,40,41,42,43,45,46,47,48,56,133,172,179,181,199],unroll_len:[43,47,56,133,162,172,179,181],unrollen_len:181,unseg:133,unsqueez:[172,189],until:[4,8,11,19,20,23,92,120,147,153,154,157,178,189,192,197],untrunc:181,unupdat:155,up:[3,38,75,82,92,117,126,132,133,135,138,147,154,157,160,169,178,188,192,194,197],upat:155,updat:[4,25,26,27,29,33,34,37,40,41,42,43,45,46,47,48,49,50,52,53,54,56,62,67,69,82,91,94,95,96,102,104,107,108,118,120,122,123,127,128,129,133,134,155,156,157,162,163,166,167,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,197,199,200,201],updata:69,updata_prob:69,update_:[40,46,176,186],update_active_play:[25,155],update_freq:[42,43,47,178,179,192],update_gradi:172,update_info:95,update_kwarg:[162,178,192],update_learner_info:101,update_logit:69,update_per_collect:[118,119,121,125,135,138,162,163,190,199,200],update_reward:95,update_shap:[5,120],update_theta:[40,41,46,176,177,186],update_typ:[162,178,192],upgo:[6,60,150,151,202],upgo_loss:60,upgo_return:60,upon:[47,48,187,193],upper:[130,167,183,192],upsampl:75,upstream:169,upward:179,us:[0,4,8,17,19,20,21,23,26,27,28,29,31,33,34,35,37,38,40,41,42,43,45,46,47,48,49,50,52,53,54,56,59,61,62,63,66,67,69,75,78,79,81,82,84,89,90,91,93,94,95,96,105,107,108,114,115,117,120,122,123,124,126,130,131,132,134,135,138,142,144,147,149,150,152,155,156,157,159,160,161,162,163,165,166,167,168,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,195,197,199,200,201,202],usabl:124,usag:[2,4,8,20,28,29,31,33,34,35,37,38,49,52,53,54,76,77,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,107,115,134,147,151,154,159,160,164,165,167,169,194,195,199,200],usaual:82,use_avg:[123,134],use_count:[163,199],use_cuda:[82,131,138,156,166,200],use_distribut:[156,166],use_dropout:75,use_lock:84,use_max:[123,134],use_shaped_reward:138,use_value_clip:[62,185],used_data_remov:108,useddataremov:163,user:[40,41,43,45,46,94,107,117,120,121,124,133,135,139,140,147,149,151,154,155,159,160,162,163,165,167,168,169,195,199,200],user_baz:[168,169],usernam:169,usual:[3,4,8,26,27,29,40,43,45,46,49,50,61,66,82,108,117,120,124,129,131,133,136,149,155,157,160,162,163,171,172,175,178,179,180,181,183,187,193,197,199,200],util:[6,28,29,30,32,33,34,35,37,67,79,81,98,109,123,125,126,127,131,132,133,136,138,142,144,160,163,171,175,177,178,179,181,185,187,191,192,194,199,202],uuid:20,v0:[135,188,200],v100:[150,151],v2:[168,169],v4:[126,135,161,164,165],v:[38,123,134,171,172,181,184,191,195,196,197],v_1step_td_data:[178,189,192],v_1step_td_error:[178,189,192],v_:[128,172,175,181,184,187,193,196,197],v_dim:38,v_layer_num:29,v_max:[29,37,48,175,187],v_min:[29,37,48,175,187],v_pred:172,v_valu:189,vac:[6,32,36,171,181,185],vae:199,val:[40,41,43,45,46,47,48,67,75,91,101,123,172,175,176,177,179,181,184,186,187,200],valid:[14,15,20,40,41,43,45,46,47,48,108,110,116,134,163,172,175,176,177,179,181,184,186,187,197,199],valid_count:108,valid_id:124,valu:[3,4,8,14,15,19,20,21,23,25,26,27,29,33,34,37,39,40,41,42,43,45,46,47,48,49,50,52,54,55,56,58,59,62,63,64,66,67,75,78,82,91,93,94,96,105,107,108,115,119,120,123,124,125,126,128,129,134,135,136,142,144,147,149,150,151,154,156,159,161,164,165,166,171,173,174,175,176,177,178,179,181,182,183,184,185,186,187,188,189,190,191,192,193,198,199,200,201],valuabl:[0,180,188],value_:[41,45,47,59,177,184,189],value_buff:125,value_clip:62,value_data:[125,185],value_gamma:[43,63,126,128,181,190],value_inv_transform:[60,63],value_loss:[41,45,55,57,62,123,171,181,185],value_network:189,value_new:[62,185],value_old:[62,185],value_op:63,value_rescal:[6,47,60,63,202],value_transform:[60,63],value_wight:41,valueerror:[114,115,158,159],valy:[29,37,175],van:[187,192],vanilla:[179,189],var_dict:123,vari:[40,41,43,45,46,47,48,136,167,172,175,176,177,179,181,184,186,187,189,191],variabl:[4,40,41,43,45,46,89,101,107,108,120,133,140,147,149,151,152,156,157,160,162,163,165,166,189,195],varianc:[4,45,59,121,144,171,172,184,187,192,197],variant:[133,179,187,192],variat:[173,183],varibl:75,varieti:169,variou:[0,149,165,174,179,194,197,199,200,202],vasilev:177,vdn:[176,186],vdot:186,vector:[2,33,38,43,71,75,147,175,178,192,197,199,200],vectorevalmonitor:[98,199],veloc:178,veri:[27,117,120,130,155,163,165,181,188],verif:[151,159],verifi:[108,140,151,159,188],versa:[178,192],version:[43,75,107,125,126,141,151,155,173,177,179,185,188,189,191,194,199],vert:181,vetor:135,via:[172,174,175,176,177,179,186,187,189,190,193],vice:[178,192],victor:172,video:[138,149,200],viedo:135,view:[46,108,152,165,166,173,180,186,193],viewpoint:199,viniciu:186,virtual:195,visit:[117,135,183,188,190,191],visual:[69,115,136,149,183,193],viz:69,viz_featur:69,vlad:181,vmpo:191,vol:173,volodymir:181,volodymyr:[171,172,179],volum:[82,161],volumemount:161,volumn:75,vpn:[173,182,194],vs:[25,41,63,66,141],vscode:[168,169],vtrace:[6,60,150,151,181,202],vtrace_advantag:181,vtrace_data:66,vtrace_error:[60,181],vtrace_item:181,vtrace_loss:181,vtrace_nstep_return:181,vtrace_return:181,w:[37,75,175,179,187,199],w_:175,w_entropi:181,w_t:58,w_valu:181,wa:[157,165,173,175,179,180,184,185,187,188,190,193],wai:[4,62,75,89,107,120,124,133,135,146,147,154,155,162,165,181,188,191,197,200],wait:[8,11,19,20,23,92,138,143,144,147,153,154,157],wait_for_clos:11,wait_for_open:11,wait_num:[143,144],wait_tim:93,walker2d:141,wan:186,wang:[172,176],want:[40,43,45,46,62,68,84,95,107,108,115,120,123,124,125,128,132,133,142,149,154,165,166,169,174,187,194,195,199,200],ward:181,warmup:199,warn:[118,161,194],warp:[4,120],warpfram:[5,120],warpper:200,was_real_don:4,wast:149,watchdog:[86,199],we:[4,40,41,43,45,46,58,59,62,75,82,94,95,107,114,115,117,118,121,123,124,125,126,127,128,130,131,132,133,134,136,138,144,149,151,154,155,157,160,161,162,163,165,166,167,169,172,173,175,178,181,184,187,188,189,190,191,192,197,199,200],weak:27,web:19,websit:195,weight1000:188,weight100:188,weight:[40,41,43,45,46,47,55,57,61,62,63,66,71,74,75,126,128,129,162,171,172,175,176,177,178,179,181,184,185,186,188,189,190,192],weight_decai:[73,178,192],weight_init:[6,70],weiner:58,welcom:[154,167],well:[19,25,26,115,117,129,140,163,165,167,169,173,178,188,190,191,197,199,200,201],were:[173,188,190],west:138,wether:176,what:[115,120,128,149,152,157,165,174,197,199],whatev:115,wheel:169,when:[0,2,4,17,19,20,23,26,27,29,34,40,41,42,43,45,46,47,48,59,63,66,75,79,82,84,85,89,90,92,101,102,107,115,117,121,124,127,129,131,132,133,134,135,136,140,147,149,151,152,153,155,156,157,159,163,165,167,169,171,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,193,197,199,200],whenev:[67,107],where:[0,2,33,34,37,38,45,55,57,58,59,61,62,63,66,75,82,91,117,121,128,133,135,144,163,165,171,172,174,175,176,178,179,180,181,183,185,186,187,188,189,190,192,197,199],wherea:[188,197],whether:[4,17,19,25,26,27,28,29,33,34,37,38,40,41,42,43,45,46,47,48,56,61,62,63,68,69,72,75,81,82,84,89,90,91,92,93,94,95,101,102,108,115,124,129,130,135,136,138,140,147,149,155,159,162,165,171,172,174,175,176,177,178,179,181,184,185,186,187,189,190,192,199,200],which:[0,4,12,17,19,25,26,27,38,40,41,43,45,46,47,48,49,50,52,53,54,56,58,59,61,63,66,67,68,75,78,79,81,82,91,93,95,96,105,107,108,115,117,120,121,124,125,126,127,128,129,131,133,134,135,136,138,144,147,149,151,154,155,157,159,160,161,162,163,165,166,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,197,199,202],whitelist:82,whiten:188,whiteson:[174,176,177,186],whl:[150,151],whl_name:[150,151],who:[174,199],whole:[45,90,121,127,133,160,163,172,181,184,194,195,199],whom:174,whose:[67,74,78,92,96,118,144,175,176,179,181],why:[96,134,152,197],wide:[17,166,179,200],width:[75,167],wierstra:[178,179],wildli:138,william:187,win:[26,27,141,155,169,199],win_rat:26,window:[123,168],windows10:195,winrat:155,wip:[168,169],wise:175,wiser:199,within:[135,163,165,174],without:[20,21,27,38,68,107,124,146,147,154,159,173,174,176,183,188,190,193,199],witt:[174,176,177,186],wojciech:186,wolski:185,won:[82,117],word:[25,27,58,96,105,107,181],work:[4,90,94,95,120,128,133,136,154,157,161,167,168,169,175,188,191,200,201],worker:[0,6,79,98,103,106,109,121,123,138,145,152,156,157,163,164,165,200,202],worker_id:104,worker_process:145,workflow:[157,200],workshop:173,workstat:154,world:[144,173,183,184,197],world_siz:[90,107],worth:155,would:[17,25,56,78,89,92,129,131,135,162,199],wouold:56,wrap:[4,17,67,69,75,82,90,93,107,115,120,124,126,147,162,165,166,200],wrape:[82,90],wrapped_cartpole_env:200,wrapped_env:120,wrapped_model:124,wrapped_overcookgam:138,wrapper:[4,41,67,82,90,93,107,122,126,135,136,148,149,151,152,156,162,166,190,192,194,200,202],wrapper_nam:[4,124,133,162,164,165,178,192,199],wrapper_name_map:[124,164,165],wrapper_registri:124,wrapper_typ:93,write:[88,125,132,152,169,190,199],writer:107,written:197,writtern:167,wrt:189,wsgi:161,wu:[176,177],x00:77,x00r:77,x01:77,x04:77,x04j:77,x05hello:77,x0:58,x14:77,x1e:77,x80:77,x86_64:195,x8c:77,x90:77,x94:77,x95:77,x99:77,x9ck:77,x:[4,8,28,29,33,34,35,37,53,58,65,69,75,76,77,93,115,129,133,135,156,158,159,171,175,178,179,181,183,184,185,187,188,189,192,193],x_0:172,x_1:133,x_2:133,x_3:133,x_4:133,x_5:133,x_6:133,x_:[133,172,181],x_k:172,x_t:[58,172,181],xa999:77,xac:77,xavier:75,xc9:77,xca:77,xf4:77,xf9:77,xi:187,xiaolong:176,xlab:[168,169],xu:176,xue:169,xx:132,xxpolici:123,xxx:[107,132,134,135],xxx_space:[148,149],xxxenv_xxxpolicy_main:82,xxxpolici:123,xxxx_config:132,y:[8,75,158,159,174,176,178,186,187,188,189,192],y_1for:192,y_2:192,y_:[186,192],y_t:191,yaml:[0,161,202],yang:174,ye:[25,27,159],year:[133,173],yei:15,yet:[20,56,112,147,153,154],yi:[176,177,186],yield:186,yoshua:187,yotam:181,you:[8,17,19,23,40,43,45,46,58,62,75,84,92,96,105,107,108,115,117,118,119,121,123,124,125,126,127,129,130,132,133,134,135,136,138,140,142,147,149,151,153,154,157,159,161,162,165,166,167,169,172,174,186,194,195,199,200],your:[115,120,122,123,124,125,129,132,136,138,149,154,161,165,169,188,194,195,199,200],your_ckpt_path:200,your_polici:133,your_replay_save_dir_path:200,your_rnn_model:133,your_wrapper_nam:[124,164,165],yourself:[132,149,169],yourwrapp:124,yuandong:176,yung:186,yuval:178,z:[172,175,177,186],z_:175,z_i:[175,187],z_j:175,zambaldi:186,zation:189,zerg:27,zergling_collector:202,zero:[63,75,78,91,133,138,173,179,181,188,189,190],zero_grad:[127,178,188,189,192],zeros_lik:[127,172,181],zhang:[174,176],zhihu:75,zhuanlan:75,zhuoran:174,zip:[172,188,190],ziyu:172,zlib:77,zlib_data_compressor:86,zlib_data_decompressor:86,zongq:174,zoo:[141,194],zoom:135,zsh:195},titles:["config.config","Config","envs.env","envs.env_manager","envs.env_wrappers","Env","API Doc","interaction.base.app","interaction.base.common","interaction.base","interaction.base.network","interaction.base.threading","interaction.exception.base","interaction.exception","interaction.exception.master","interaction.exception.slave","Interaction","interaction.master.connection","interaction.master","interaction.master.master","interaction.master.task","interaction.slave.action","interaction.slave","interaction.slave.slave","League","league.league","league.payoff","league.player","common.encoder","common.head","Common","common.utils","Model","template.QAC","template.VAC","template.coma","Template","template.q_learning","template.qmix","A2C","CollaQ","COMA","DDPG","DQN","Policy","PPG","QMIX","R2D2","Rainbow","Base Model","Gail","Reward Model","Pdeil","Pwil","Red","rl_utils.a2c","rl_utils.adder","rl_utils.coma","rl_utils.exploration","rl_utils.gae","RL Utils","rl_utils.isw","rl_utils.ppo","rl_tuils.td","rl_tuils.upgo","rl_tuils.value_rescale","rl_tuils.vtrace","checkpoint_helper","data_helper","distribution","Torch Utils","metric","nn_test_helper","optimizer_helper","loss.cross_entropy_loss","network.activation","utils.collection_helper","utils.compression_helper","data.collate_fn","data.dataloader","utils.data","cache","utils.default_helper","utils.design_helper","utils.file_helper","utils.import_helper","Utils","utils.k8s_helper","utils.lock_helper","utils.log_helper","utils.pytorch_ddp_dist_helper","utils.segment_tree","utils.system_helper","utils.time_helper","worker.collector.base_serial_collector","worker.collector.base_serial_evaluator","worker.collector.comm","worker.collector.episode_serial_collector","Collector","worker.collector.sample_serial_collector","worker.coordinator.comm_coordinator","worker.coordinator.commander","worker.coordinator.coordinator","Coordinator","worker.coordinator.resource_manager","worker.learner.comm","Learner","worker.learner","worker.replay_buffer","Buffer","Architecture Design","Interaction Framework","Interaction Model","Interaction Processes","Advantages","Loader Calculation Process","Loader Framework","Imitation Learning","Inverse RL","Customization 1: Dynamic Update Step","How to Customize an Env Wrapper","How to use Episode Replay Buffer?","Best Practice","Learner log","How to Customize Model Wrapper","How to use multiple buffers?","Multi-Discrete Example","How to Use Multi-GPUs to Train Your Model","N-step TD","How to Use PER(Prioritized Experience Replay)","How to randomly collect some data sample at the beginning?","Random seed","Registry","How to use RNN","How to understand training generated folders?","Atari","Bsuite","RL Environments Tutorial","Overcooked","FAQ","FAQ","Algorithm Overview","Autolog Overview","Collector Overview","Collector Overview","DataLoader Overview","Env Manager Overview","Env Manager Overview","Env Overview","Env Overview","HPC_RL Overview","DI-hpc Overview","Feature","Interaction Overview","Interaction Overview","League Overview","Learner Overview","Learner Overview","Loader Overview","Loader Overview","Model Overview","DI-orchestrator Overview","Policy Overview","Replay Buffer Overview","Wrapper & Hook Overview","Wrapper & Hook Overview","Code Comment","Documentation Contribution Guide","Git \u534f\u4f5c\u6307\u5357","Git Collaboration Guide","Developer Guide","A2C","ACER","AlphaGo","ATOC","C51","CollaQ","COMA","DDPG","DQN","GAIL","IMPALA","Hands on RL","MCTS","PPG","PPO","QMIX","Rainbow","RND","SAC","SQIL","SQN","TD3","VPN","Welcome to DI-engine\u2019s documentation!","Installation","Basic Concepts","Basic Concepts","Introduction to RL","Key Concept","Quick Start","Tensorboard and Logging demo","Tutorial-Developer"],titleterms:{"1":[119,123,125,161],"2":[123,125,161],"3":[123,161],"4":161,"5":161,"6":161,"\u4ee5\u53ca\u4f55\u6545\u4f5c\u6b64\u8bbe\u8ba1":153,"\u4ef7\u503c\u51fd\u6570":196,"\u4f18\u5316":196,"\u4f55\u4e3a\u975e\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1":153,"\u5173\u4e8e\u4f7f\u7528\u65f6\u51fa\u73b0\u7684warn":139,"\u5176\u4ed6":150,"\u52a8\u4f5c\u7a7a\u95f4":196,"\u534f\u4f5c\u6307\u5357":168,"\u534f\u4f5c\u6d41\u7a0b":168,"\u57fa\u4e8e\u6a21\u578b":196,"\u5956\u52b1":196,"\u5982\u4f55\u4f7f\u7528":150,"\u5982\u4f55\u6b63\u786e\u5c06master\u548cslave\u6574\u5408\u8fdb\u73b0\u6709\u4e1a\u52a1\u670d\u52a1\u4e2d":153,"\u5982\u4f55\u8bbe\u7f6esyncsubprocessenvmanager\u7684\u76f8\u5173\u8fd0\u884c\u53c2\u6570":139,"\u5b89\u88c5\u4e4b\u540e\u65e0\u6cd5\u4f7f\u7528di":139,"\u5b89\u88c5\u65f6\u51fa\u73b0":139,"\u5e38\u89c1\u95ee\u9898":[153,158],"\u5e94\u8be5\u5982\u4f55\u5904\u7406":153,"\u6027\u80fd\u5bf9\u6bd4":150,"\u611f\u89c9loader\u6709\u4e9b\u65f6\u5019\u5199\u8d77\u6765\u592a\u957f\u4e86":158,"\u629b\u51fa\u5f02\u5e38":153,"\u6709\u6ca1\u6709\u66f4\u597d\u7684\u89e3\u51b3\u65b9\u6848":158,"\u6982\u8ff0":[150,153,158],"\u6ca1\u6709\u6743\u9650":139,"\u6d4b\u901f\u5b9e\u9a8c":[143,145],"\u6f14\u5458":196,"\u72b6\u6001\u7a7a\u95f4":196,"\u76ee\u524d\u652f\u6301\u7684\u7b97\u5b50":150,"\u76f8\u5173\u9519\u8bef":139,"\u793a\u4f8b":158,"\u7b56\u7565":196,"\u7b56\u7565\u68af\u5ea6":196,"\u800c\u4e14\u90fd\u662f\u91cd\u590d\u7684":158,"\u8bc4\u8bba\u5bb6":196,"\u8f68\u8ff9":196,"\u9a6c\u5c14\u53ef\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"do":154,"engine\u547d\u4ee4\u884c\u5de5\u5177":139,"function":[78,115,124,196,197,199],"git\u89c4\u8303":168,"import":140,"interaction\u6a21\u5757\u9002\u5408\u4f7f\u7528\u7684\u95ee\u9898\u6709\u54ea\u4e9b":153,"loader\u548cnorm\u7684\u533a\u522b\u548c\u5173\u7cfb\u662f\u4ec0\u4e48":158,"long":159,"master\u548cslave\u5728\u53d1\u9001\u7f51\u7edc\u8bf7\u6c42\u65f6\u51fa\u73b0\u9519\u8bef":153,"master\u7aef":153,"public":[178,189,191,192],"return":[196,197],"slave\u7aef":153,A:[154,196,197],And:123,In:123,Is:159,No:140,On:199,The:[120,188,199],To:120,_iresponseinform:12,_islaveconnect:17,a2c:[39,55,171],a2c_error:55,a2cpolici:39,about:136,access:165,acer:172,action:[21,135,136,138,196,197],activ:75,activeplay:27,actor:[178,192,196,197],adam:73,adder:56,advanc:123,advancedreplaybuff:[108,163],advantag:114,after:[135,140],aggreg:200,algorithm:[135,138,141],all:159,allreduc:90,alphago:173,alphagozero:173,an:[120,154],analysi:157,api:6,app:7,ar:154,architectur:110,arrang:133,assign:161,async:79,asyncdataload:79,asyncsubprocessenvmanag:3,atari:[135,141],atoc:174,attent:75,author:188,auto_checkpoint:67,autolog:142,base:[7,8,9,10,11,12,49,157,196,197],base_comm_collector:96,base_env:2,base_env_manag:[3,146,147],base_leagu:25,base_learn:107,base_parallel_command:101,base_reward_estim:49,base_serial_collector:94,base_serial_command:101,base_serial_evalu:95,basecommand:101,basecommcollector:96,basecommlearn:[105,157],baseenv:[2,148,149],baseenvmanag:[3,146,147],baseleagu:25,baselearn:107,basenois:58,baserewardmodel:49,baseserialcommand:101,baseserialevalu:95,basic:[123,196,197],battlerecorddict:26,battlesharedpayoff:26,befor:135,begin:130,benchmark:[135,138,141,188],besid:123,best:122,better:159,between:[135,151,159],bilinearupsampl:75,binary_encod:75,block:154,broadcast:90,bsuit:136,buffer:[108,109,121,125,163,199,201],build:133,build_activ:75,build_ce_criterion:74,build_checkpoint_help:67,build_learner_hook_by_cfg:107,build_log_buff:68,build_logg:89,build_norm:75,build_time_help:93,burn:133,busi:154,c51:175,c51dqn:37,cach:81,cachepool:94,calcul:[115,188],cannot:140,categoricalpd:69,categoricalpdpytorch:69,channelshuffl:75,check:[135,138,161,195],checkpoint:200,checkpoint_help:67,checkpointhelp:67,cli:[139,140],cliprewardenv:4,code:[135,136,138,166,171,173,175,179,180,183,184,185,188,190,193,202],collabor:169,collaq:[38,40,176],collaqmultiheadattent:38,collaqpolici:40,collaqsmacattentionmodul:38,collat:78,collate_fn:78,collect:[115,130],collect_state_action_pair:53,collection_help:76,collector:[94,95,96,97,98,99,143,144,199,201],collectorslav:96,coma:[35,41,57,177],coma_error:57,comaactornetwork:35,comacriticnetwork:35,comapolici:41,comm:[96,105],comm_coordin:100,command:[101,140],commcoordin:100,comment:166,common:[8,28,29,30,31,115],comparison:151,compile_config:0,compile_config_parallel:0,compon:133,compression_help:77,comput:199,compute_importance_weight:61,concept:[196,197,199],config:[0,1,125,130,161,199,200],configur:[136,161],connect:17,connectionrefus:21,contribut:167,control:163,controllablecontext:8,controllableservic:8,conv1d_block:75,conv2d_block:75,convencod:28,coordin:[100,101,102,103,104],correctli:154,countvar:67,cpu:161,create_buff:108,create_comm_collector:96,create_comm_learn:105,create_env_manag:3,create_leagu:25,create_learn:107,create_model:31,create_noise_gener:58,create_parallel_command:101,create_payoff:26,create_play:27,create_reward_model:49,create_serial_collector:94,critic:[178,192,196,197],cross_entropy_loss:74,cudafetch:68,current:151,custom:[119,120,124,199],data:[78,79,80,130,133,163,199,202],data_help:68,datadistributedparallel:127,dataload:[79,145],dataparallel:127,dblevent:11,ddp:127,ddpg:[42,178],ddpgpolici:42,decis:197,deconv2d_block:75,deep_merge_dict:82,deep_upd:82,default_col:78,default_decol:78,default_func:8,default_get:82,default_help:82,defin:[161,200],delet:161,demo:[117,201],demostr:199,descript:136,design:[110,123,154],design_help:83,detail:188,develop:[123,130,170,194,195,202],di:[123,130,133,135,136,138,140,151,155,161,164,165,194,202],dicts_to_list:82,diff_shape_col:78,differ:[135,138,159],differnec:63,dijob:161,ding:[146,147],disconnectionrefus:21,discret:126,discretehead:29,dist:199,dist_fin:90,dist_init:90,dist_mod:90,dist_nstep_td_error:63,distribut:69,distributionhead:29,distributiontimeimag:89,doc:6,document:[167,194],doe:123,doubl:187,dp:127,dqn:[37,43,179,199],dqnpolici:43,drl:199,drqn:37,duel:187,duelinghead:29,dummy_compressor:77,dummy_decompressor:77,dure:140,dynam:119,e:123,easytim:93,encod:28,engin:[123,130,133,135,140,155,164,165,194,202],entri:199,env:[2,3,4,5,120,130,135,146,147,148,149],env_manag:[3,146,147],env_wrapp:4,envel:[148,149],envelementrunn:[148,149],environ:[135,136,137,138,161,199,200],episod:121,episode_serial_collector:97,episodecollector:97,episodereplaybuff:[108,163],episodiclifeenv:4,epsilon:200,equat:[171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,188,189,190,191,192,193],equival:114,error:[140,154],error_wrapp:82,errro_wrapp:90,estim:172,evalu:[135,199,200,201],exampl:[118,120,124,126,133,135,138,159,161],except:[12,13,14,15],execut:200,exist:154,experi:[129,143,145,187],experiment:161,explor:58,extens:[171,173,174,175,176,177,178,179,180,183,184,185,186,187,189,191,192,193],fact:[135,136,138,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193],faq:[139,140,159],fc_block:75,fcencod:28,featur:[152,194],feature1:163,feature2:163,feature3:163,feature4:163,feel:159,file_help:84,find_free_port:92,fireresetenv:4,flask_fs_collector:96,flaskfilesystemcollector:96,flaskfilesystemlearn:105,flatten_dict:82,flow:202,folder:134,form:114,format:[136,159],framestack:4,framework:[111,116],full:163,g:123,gae:59,gail:[50,118,180,199],gail_irl_model:50,gailrewardmodel:50,gaussiannois:58,gener:[120,134],generalized_lambda_return:63,get_buffer_cl:108,get_cuda_time_wrapp:93,get_data_compressor:77,get_data_decompressor:77,get_env_cl:2,get_env_manager_cl:3,get_epsilon_greedy_fn:58,get_group:90,get_ip:92,get_lstm:75,get_master_exception_by_error:14,get_master_exception_class_by_error_cod:14,get_operator_server_kwarg:87,get_pid:92,get_rank:90,get_rw_file_lock:88,get_serial_collector_cl:94,get_slave_exception_by_error:15,get_slave_exception_class_by_error_cod:15,get_task_uid:92,get_tensor_data:68,get_vec_env_set:2,get_world_s:90,git:[168,169],glu:75,gpu:[127,161],gradient:[172,196,197],graph:[171,173,174,175,176,177,178,179,180,181,183,184,185,186,188,189,190,191,192,193],greedi:200,guid:[167,169,170,194],guidanc:123,guidelin:[117,121,125,129,130],gym:136,hamming_dist:71,hand:182,head:29,her:199,hidden:133,histogram:123,historicalplay:27,hook:[107,164,165],hostpath:161,how:[120,121,123,124,125,127,129,130,133,134,136,140,151,154,199],hpc:151,hpc_rl:[150,151],i:154,ibuff:[108,163],imit:117,impala:[181,199],implement:[155,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193],import_help:85,import_modul:85,info:[130,201],initi:[133,135,200],insert:161,instal:[135,136,138,140,195],instanti:200,integr:154,interact:[7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,111,112,113,153,154],interfac:162,intro:155,introduct:[133,145,198],invers:118,iqn:[37,175],irregular:123,is_differenti:72,is_typ:115,iserialcollector:94,issu:154,isw:61,iter_map:76,k8s_helper:87,kei:[135,136,138,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,188,189,190,191,192,193,199],labelsmoothceloss:74,layout:138,lazi:135,leagu:[24,25,26,27,155],leagueexploit:27,learn:[117,187],learner:[105,106,107,123,156,157,199,201],learner_comm:105,learner_hook:107,learnerhook:[107,157],levenshtein_dist:71,limitedspacecontain:82,line:140,list_split:82,lists_to_dict:82,load:200,loadckpthook:107,loader:[115,116,158,159],lock_help:88,lockcontext:88,log:[123,200,201],log_help:89,loggedmodel:[123,142],logger:163,loggerfactori:89,logreducehook:107,logshowhook:107,loss:74,lstm:75,lstmforwardwrapp:75,lz4_data_compressor:77,lz4_data_decompressor:77,main:194,mainexploit:27,mainplay:27,make:154,manag:[146,147],markov:197,master:[14,17,18,19,20,154],masterchannelinvalid:14,masterchannelnotgiven:14,mastererrorcod:14,mastermastertokeninvalid:14,mastermastertokennotgiven:14,masterresponseexcept:14,masterselftokeninvalid:14,masterselftokennotgiven:14,masterslavetokeninvalid:14,masterslavetokennotgiven:14,mastersuccess:14,mastersystemshuttingdown:14,mastertaskdatainvalid:14,math:115,matter:188,maxandskipenv:4,mct:183,mdp:[196,197],memori:161,merge_hook:107,meta:163,method:[135,138],metric:71,middlewar:161,mirror:135,mixer:38,mlp:75,mode:[127,134,157,162,199],model:[32,49,51,112,124,127,133,160,165,178,192,196,197,199,200],modifi:161,modul:[154,200],monitor:163,mujoco:141,multi:[126,127,187,199],multi_logits_loss:74,multihead:29,multilogitsloss:74,multipl:125,multistep_forward_view:63,n:128,naivecollector:96,naivecommand:101,naivereplaybuff:[108,163],naiveresourcemanag:104,naivespplay:27,nearestupsampl:75,need:120,net:187,network:[10,75,154,178,187,192],nn:200,nn_modul:75,nn_test_help:72,noise_block:75,noiselinearlay:75,noisi:187,non:154,noopresetenv:4,norm:[115,159],normal:75,observ:[135,136,138],obsnormenv:4,obstransposewrapp:4,occur:[140,154],off:199,onc:114,one_hot:75,one_vs_one_leagu:25,onevsoneleagu:25,openai:136,oper:[140,151],optim:[196,197],optimizer_help:73,orchestr:161,origin:[135,136],other:[123,129,135,136,138,151,178,189,191,192,200],ounois:58,overcook:138,overrid:82,overview:[135,138,141,142,143,144,145,146,147,148,149,150,151,153,154,155,156,157,158,159,160,161,162,163,164,165,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,194,199],packag:140,parallel:[134,157,199],paramet:140,pattern:199,payoff:[26,155],pd:69,pdeil:52,pdeil_irl_model:52,pdeilrewardmodel:52,per:[129,187],perform:[150,151],periodicthruputmonitor:108,permiss:140,pipe:115,pipelin:[125,199,200],player:[27,155],polici:[44,133,162,172,192,196,197,199,200],ppg:[45,184],ppgpolici:45,ppo:[62,185,199],ppo_error:62,practic:122,prerequisit:195,pretty_print:89,principl:127,print:123,priorit:[129,163,187],problem:[196,197],procedur:129,process:[113,115,157,197,199],processg:169,profil:[143,144,145],propagatingthread:92,pseudo:[171,173,175,179,180,183,184,185,188,190,193],pseudocod:[172,178,189,191,192],pwil:53,pwil_irl_model:53,pwilrewardmodel:53,py:[146,147],pytorch:[150,151],pytorch_ddp_dist_help:90,pytorchlstm:75,q1:[139,140],q2:[139,140],q3:[139,140],q4:[139,140],q:[153,154,158,159,172,187,196,197],q_learn:37,q_nstep_td_error:63,q_nstep_td_error_with_rescal:63,qac:33,qmix:[38,46,186],qmixpolici:46,qrdqn:[37,175],qrdqnhead:29,qualiti:163,quantilehead:29,quick:[171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,200],r2d2:[47,133],r2d2polici:47,r2d3:199,rainbow:[48,187],rainbowdqn:37,rainbowdqnpolici:48,rainbowhead:29,ramwrapp:4,random:[131,135],random_token:8,randomli:130,rbc:199,read_config:0,read_config_yaml:0,read_fil:84,read_from_ceph:84,read_from_fil:84,read_from_mc:84,read_from_path:84,read_from_redi:84,read_from_redisclust:84,reason:120,record:123,red:54,red_irl_model:54,redrewardmodel:54,refer:[171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,190,192,193],register_learner_hook:107,registri:132,regressionhead:29,regular:192,relat:133,relationship:159,releas:195,relev:140,remove_fil:84,reparameterizationhead:29,repetit:159,replai:[108,121,129,135,163,187],replay_buff:108,request:154,res_block:75,resblock:75,resfcblock:75,resourc:161,resource_manag:104,responseexcept:12,result:188,retrac:172,reward:[51,135,136,138,188,196,197],rewardmodel:199,rewardnormenv:4,rl:[60,118,135,137,138,182,196,197,198],rl_tuil:[63,64,65,66],rl_util:[55,56,57,58,59,61,62],rmsprop:73,rnd:[188,199],rndnetwork:188,rndrewardmodel:188,rnn:[75,133],run:200,runnabl:136,runningmeanstd:4,s:[188,194],sac:[189,199],same_shap:68,sampl:[130,163],sample_serial_collector:99,samplecollector:99,sampleddataattrmonitor:108,save:[135,200],save_config:0,save_config_pi:0,save_config_yaml:0,save_fil:84,save_file_ceph:84,save_file_redi:84,save_file_redisclust:84,saveckpthook:107,scalar:123,scale:199,scaledfloatfram:4,scatter_connect:75,scatterconnect:75,seed:[131,135],segment_tre:91,segmenttre:91,send:154,sequential_pack:75,serial:[134,199],servic:154,set:[140,161,200],set_pkg_se:82,share:199,shared_payoff:26,shmbuffer:3,shmbuffercontain:3,should:154,simplifi:[164,165],singl:154,singletonmetaclass:83,slave:[15,21,22,23,154],slavechannelinvalid:15,slavechannelnotfound:15,slaveconnect:17,slaveconnectionproxi:17,slaveerrorcod:15,slavemastertokeninvalid:15,slavemastertokennotfound:15,slaveresponseexcept:15,slaveselftokeninvalid:15,slaveselftokennotfound:15,slaveslavealreadyconnect:15,slaveslaveconnectionrefus:15,slaveslavedisconnectionrefus:15,slaveslavenotconnect:15,slavesuccess:15,slavesystemshuttingdown:15,slavetaskalreadyexist:15,slavetaskrefus:15,smac:141,smooth:192,soft_argmax:75,softargmax:75,softfocalloss:74,solo_parallel_command:101,solocommand:101,some:130,sometim:159,space:[135,136,138,196,197],speed:144,sqil:[190,199],sqn:191,squeez:82,stabl:195,standard:169,start:200,state:[133,196,197],statist:123,statu:161,step:[119,128,187],storag:161,structencod:28,structur:202,submit:161,subprocess_env_manag:[3,146,147],subprocessenvmanag:[146,147],suitabl:154,support:[114,115,151],syncsubprocessenvmanag:[3,140],system_help:92,target:[178,192],task:[20,154],taskfail:21,taskrefus:21,taskresulttyp:20,taskstat:102,taskstatu:20,td3:192,td:[63,128],td_lambda_error:63,templat:[33,34,35,36,37,38,166],tempor:63,tensor_to_list:68,tensorboard:201,tensorflow:188,thi:154,thread:[11,154],throughput:163,time:[142,200],time_help:93,timestep_col:78,timewrapp:93,timewrappertim:93,to_devic:68,to_dtyp:68,to_list:68,to_ndarrai:68,to_tensor:68,to_tensor_transit:94,to_typ:115,too:159,tool:140,torch:70,train:[127,134,135,157,178,188,192,199,200],trajbuff:94,trajectori:[196,197],transform:[75,114,135],transformerlay:75,translate_dict_func:8,trick:187,try_import_ceph:85,try_import_link:85,try_import_mc:85,try_import_redi:85,try_import_redisclust:85,turn:115,tutori:[137,202],type:123,understand:134,up:[199,200],updat:119,update_shap:4,upgo:64,upgo_loss:64,upgo_return:64,us:[121,125,127,129,133,136,140,151,154],usag:127,useddataremov:108,user:[130,194],util:[31,60,70,76,77,80,82,83,84,85,86,87,88,89,90,91,92,93,96,108,200],vac:34,valid:114,valu:[172,196,197],value_inv_transform:65,value_rescal:65,value_transform:65,variabl:[123,161],vectorevalmonitor:95,verifi:136,version:195,video:135,view:[123,130,161],visual:200,vpn:193,vtrace:66,vtrace_error:66,warn:140,warpfram:4,watchdog:93,we:120,weight_init:75,welcom:194,what:[154,159],when:154,why:154,worker:[94,95,96,97,99,100,101,102,104,105,107,108,161,199],wrap:133,wrapper:[120,124,133,164,165,199],write:[130,159],your:[127,133],zlib_data_compressor:77,zlib_data_decompressor:77,zoo:[135,136,138,202]}})
\ No newline at end of file
+Search.setIndex({docnames:["api_doc/config/config","api_doc/config/index","api_doc/env/env","api_doc/env/env_manager","api_doc/env/env_wrappers","api_doc/env/index","api_doc/index","api_doc/interaction/base/app","api_doc/interaction/base/common","api_doc/interaction/base/index","api_doc/interaction/base/network","api_doc/interaction/base/threading","api_doc/interaction/exception/base","api_doc/interaction/exception/index","api_doc/interaction/exception/master","api_doc/interaction/exception/slave","api_doc/interaction/index","api_doc/interaction/master/connection","api_doc/interaction/master/index","api_doc/interaction/master/master","api_doc/interaction/master/task","api_doc/interaction/slave/action","api_doc/interaction/slave/index","api_doc/interaction/slave/slave","api_doc/league/index","api_doc/league/league","api_doc/league/payoff","api_doc/league/player","api_doc/model/common/encoder","api_doc/model/common/head","api_doc/model/common/index","api_doc/model/common/utils","api_doc/model/index","api_doc/model/template/QAC","api_doc/model/template/VAC","api_doc/model/template/coma","api_doc/model/template/index","api_doc/model/template/q_learning","api_doc/model/template/qmix","api_doc/policy/a2c","api_doc/policy/collaq","api_doc/policy/coma","api_doc/policy/ddpg","api_doc/policy/dqn","api_doc/policy/index","api_doc/policy/ppg","api_doc/policy/qmix","api_doc/policy/r2d2","api_doc/policy/rainbow","api_doc/reward_model/base_reward_estimate","api_doc/reward_model/gail_irl_model","api_doc/reward_model/index","api_doc/reward_model/pdeil_irl_model","api_doc/reward_model/pwil_irl_model","api_doc/reward_model/red_irl_model","api_doc/rl_utils/a2c","api_doc/rl_utils/adder","api_doc/rl_utils/coma","api_doc/rl_utils/exploration","api_doc/rl_utils/gae","api_doc/rl_utils/index","api_doc/rl_utils/isw","api_doc/rl_utils/ppo","api_doc/rl_utils/td","api_doc/rl_utils/upgo","api_doc/rl_utils/value_rescale","api_doc/rl_utils/vtrace","api_doc/torch_utils/checkpoint_helper","api_doc/torch_utils/data_helper","api_doc/torch_utils/distribution","api_doc/torch_utils/index","api_doc/torch_utils/metric","api_doc/torch_utils/nn_test_helper","api_doc/torch_utils/optimizer_helper","api_doc/torch_utils/torch_utils_loss","api_doc/torch_utils/torch_utils_network","api_doc/utils/collection_helper","api_doc/utils/compression_helper","api_doc/utils/data/collate_fn","api_doc/utils/data/dataloader","api_doc/utils/data/index","api_doc/utils/data/structure","api_doc/utils/default_helper","api_doc/utils/design_helper","api_doc/utils/file_helper","api_doc/utils/import_helper","api_doc/utils/index","api_doc/utils/k8s_helper","api_doc/utils/lock_helper","api_doc/utils/log_helper","api_doc/utils/pytorch_ddp_dist_helper","api_doc/utils/segment_tree","api_doc/utils/system_helper","api_doc/utils/time_helper","api_doc/worker/collector/base_serial_collector","api_doc/worker/collector/base_serial_evaluator","api_doc/worker/collector/comm","api_doc/worker/collector/episode_serial_collector","api_doc/worker/collector/index","api_doc/worker/collector/sample_serial_collector","api_doc/worker/coordinator/comm_coordinator","api_doc/worker/coordinator/commander","api_doc/worker/coordinator/coordinator","api_doc/worker/coordinator/index","api_doc/worker/coordinator/resource_manager","api_doc/worker/learner/comm_learner","api_doc/worker/learner/index","api_doc/worker/learner/learner","api_doc/worker/replay_buffer/buffer","api_doc/worker/replay_buffer/index","architecture/index","architecture/interaction/index","architecture/interaction/models","architecture/interaction/processes","architecture/loader/advantage","architecture/loader/calculation","architecture/loader/index","best_practice/IL","best_practice/IRL","best_practice/customization1_dynamic_update_step","best_practice/env_wrapper","best_practice/episode_buffer","best_practice/index","best_practice/learner_log","best_practice/model_wrapper","best_practice/multi_buffer","best_practice/multi_discrete","best_practice/multi_gpu_example","best_practice/nstep_td","best_practice/priority","best_practice/random_collect_size","best_practice/random_seed","best_practice/registry","best_practice/rnn","best_practice/training_generated_folders","env_tutorial/atari","env_tutorial/bsuite","env_tutorial/index","env_tutorial/overcooked","faq/index","faq/index_en","feature/algorithm_overview_en","feature/autolog_overview","feature/collector_overview","feature/collector_overview_en","feature/dataloader_overview","feature/env_manager_overview","feature/env_manager_overview_en","feature/env_overview","feature/env_overview_en","feature/hpc_rl_overview","feature/hpc_rl_overview_en","feature/index","feature/interaction_overview","feature/interaction_overview_en","feature/league_overview_en","feature/learner_overview","feature/learner_overview_en","feature/loader_overview","feature/loader_overview_en","feature/model_overview_en","feature/orchestrator_overview_en","feature/policy_overview_en","feature/replay_buffer_overview_en","feature/wrapper_hook_overview","feature/wrapper_hook_overview_en","guide/code_comment_en","guide/doc_contribution_en","guide/git_guide","guide/git_guide_en","guide/index","hands_on/a2c","hands_on/acer","hands_on/alphago","hands_on/atoc","hands_on/c51_qrdqn_iqn","hands_on/collaq","hands_on/coma","hands_on/ddpg","hands_on/dqn","hands_on/gail","hands_on/impala","hands_on/index","hands_on/mcts","hands_on/ppg","hands_on/ppo","hands_on/qmix","hands_on/rainbow","hands_on/rnd","hands_on/sac","hands_on/sqil","hands_on/sqn","hands_on/td3","hands_on/vpn","index","installation/index","intro_rl/basic","intro_rl/basic_en","intro_rl/index","key_concept/index","quick_start/index","quick_start/tb_demo","tutorial_dev/index"],envversion:{"sphinx.domains.c":2,"sphinx.domains.changeset":1,"sphinx.domains.citation":1,"sphinx.domains.cpp":4,"sphinx.domains.index":1,"sphinx.domains.javascript":2,"sphinx.domains.math":2,"sphinx.domains.python":3,"sphinx.domains.rst":2,"sphinx.domains.std":2,"sphinx.ext.viewcode":1,sphinx:56},filenames:["api_doc/config/config.rst","api_doc/config/index.rst","api_doc/env/env.rst","api_doc/env/env_manager.rst","api_doc/env/env_wrappers.rst","api_doc/env/index.rst","api_doc/index.rst","api_doc/interaction/base/app.rst","api_doc/interaction/base/common.rst","api_doc/interaction/base/index.rst","api_doc/interaction/base/network.rst","api_doc/interaction/base/threading.rst","api_doc/interaction/exception/base.rst","api_doc/interaction/exception/index.rst","api_doc/interaction/exception/master.rst","api_doc/interaction/exception/slave.rst","api_doc/interaction/index.rst","api_doc/interaction/master/connection.rst","api_doc/interaction/master/index.rst","api_doc/interaction/master/master.rst","api_doc/interaction/master/task.rst","api_doc/interaction/slave/action.rst","api_doc/interaction/slave/index.rst","api_doc/interaction/slave/slave.rst","api_doc/league/index.rst","api_doc/league/league.rst","api_doc/league/payoff.rst","api_doc/league/player.rst","api_doc/model/common/encoder.rst","api_doc/model/common/head.rst","api_doc/model/common/index.rst","api_doc/model/common/utils.rst","api_doc/model/index.rst","api_doc/model/template/QAC.rst","api_doc/model/template/VAC.rst","api_doc/model/template/coma.rst","api_doc/model/template/index.rst","api_doc/model/template/q_learning.rst","api_doc/model/template/qmix.rst","api_doc/policy/a2c.rst","api_doc/policy/collaq.rst","api_doc/policy/coma.rst","api_doc/policy/ddpg.rst","api_doc/policy/dqn.rst","api_doc/policy/index.rst","api_doc/policy/ppg.rst","api_doc/policy/qmix.rst","api_doc/policy/r2d2.rst","api_doc/policy/rainbow.rst","api_doc/reward_model/base_reward_estimate.rst","api_doc/reward_model/gail_irl_model.rst","api_doc/reward_model/index.rst","api_doc/reward_model/pdeil_irl_model.rst","api_doc/reward_model/pwil_irl_model.rst","api_doc/reward_model/red_irl_model.rst","api_doc/rl_utils/a2c.rst","api_doc/rl_utils/adder.rst","api_doc/rl_utils/coma.rst","api_doc/rl_utils/exploration.rst","api_doc/rl_utils/gae.rst","api_doc/rl_utils/index.rst","api_doc/rl_utils/isw.rst","api_doc/rl_utils/ppo.rst","api_doc/rl_utils/td.rst","api_doc/rl_utils/upgo.rst","api_doc/rl_utils/value_rescale.rst","api_doc/rl_utils/vtrace.rst","api_doc/torch_utils/checkpoint_helper.rst","api_doc/torch_utils/data_helper.rst","api_doc/torch_utils/distribution.rst","api_doc/torch_utils/index.rst","api_doc/torch_utils/metric.rst","api_doc/torch_utils/nn_test_helper.rst","api_doc/torch_utils/optimizer_helper.rst","api_doc/torch_utils/torch_utils_loss.rst","api_doc/torch_utils/torch_utils_network.rst","api_doc/utils/collection_helper.rst","api_doc/utils/compression_helper.rst","api_doc/utils/data/collate_fn.rst","api_doc/utils/data/dataloader.rst","api_doc/utils/data/index.rst","api_doc/utils/data/structure.rst","api_doc/utils/default_helper.rst","api_doc/utils/design_helper.rst","api_doc/utils/file_helper.rst","api_doc/utils/import_helper.rst","api_doc/utils/index.rst","api_doc/utils/k8s_helper.rst","api_doc/utils/lock_helper.rst","api_doc/utils/log_helper.rst","api_doc/utils/pytorch_ddp_dist_helper.rst","api_doc/utils/segment_tree.rst","api_doc/utils/system_helper.rst","api_doc/utils/time_helper.rst","api_doc/worker/collector/base_serial_collector.rst","api_doc/worker/collector/base_serial_evaluator.rst","api_doc/worker/collector/comm.rst","api_doc/worker/collector/episode_serial_collector.rst","api_doc/worker/collector/index.rst","api_doc/worker/collector/sample_serial_collector.rst","api_doc/worker/coordinator/comm_coordinator.rst","api_doc/worker/coordinator/commander.rst","api_doc/worker/coordinator/coordinator.rst","api_doc/worker/coordinator/index.rst","api_doc/worker/coordinator/resource_manager.rst","api_doc/worker/learner/comm_learner.rst","api_doc/worker/learner/index.rst","api_doc/worker/learner/learner.rst","api_doc/worker/replay_buffer/buffer.rst","api_doc/worker/replay_buffer/index.rst","architecture/index.rst","architecture/interaction/index.rst","architecture/interaction/models.rst","architecture/interaction/processes.rst","architecture/loader/advantage.rst","architecture/loader/calculation.rst","architecture/loader/index.rst","best_practice/IL.rst","best_practice/IRL.rst","best_practice/customization1_dynamic_update_step.rst","best_practice/env_wrapper.rst","best_practice/episode_buffer.rst","best_practice/index.rst","best_practice/learner_log.rst","best_practice/model_wrapper.rst","best_practice/multi_buffer.rst","best_practice/multi_discrete.rst","best_practice/multi_gpu_example.rst","best_practice/nstep_td.rst","best_practice/priority.rst","best_practice/random_collect_size.rst","best_practice/random_seed.rst","best_practice/registry.rst","best_practice/rnn.rst","best_practice/training_generated_folders.rst","env_tutorial/atari.rst","env_tutorial/bsuite.rst","env_tutorial/index.rst","env_tutorial/overcooked.rst","faq/index.rst","faq/index_en.rst","feature/algorithm_overview_en.rst","feature/autolog_overview.rst","feature/collector_overview.rst","feature/collector_overview_en.rst","feature/dataloader_overview.rst","feature/env_manager_overview.rst","feature/env_manager_overview_en.rst","feature/env_overview.rst","feature/env_overview_en.rst","feature/hpc_rl_overview.rst","feature/hpc_rl_overview_en.rst","feature/index.rst","feature/interaction_overview.rst","feature/interaction_overview_en.rst","feature/league_overview_en.rst","feature/learner_overview.rst","feature/learner_overview_en.rst","feature/loader_overview.rst","feature/loader_overview_en.rst","feature/model_overview_en.rst","feature/orchestrator_overview_en.rst","feature/policy_overview_en.rst","feature/replay_buffer_overview_en.rst","feature/wrapper_hook_overview.rst","feature/wrapper_hook_overview_en.rst","guide/code_comment_en.rst","guide/doc_contribution_en.rst","guide/git_guide.rst","guide/git_guide_en.rst","guide/index.rst","hands_on/a2c.rst","hands_on/acer.rst","hands_on/alphago.rst","hands_on/atoc.rst","hands_on/c51_qrdqn_iqn.rst","hands_on/collaq.rst","hands_on/coma.rst","hands_on/ddpg.rst","hands_on/dqn.rst","hands_on/gail.rst","hands_on/impala.rst","hands_on/index.rst","hands_on/mcts.rst","hands_on/ppg.rst","hands_on/ppo.rst","hands_on/qmix.rst","hands_on/rainbow.rst","hands_on/rnd.rst","hands_on/sac.rst","hands_on/sqil.rst","hands_on/sqn.rst","hands_on/td3.rst","hands_on/vpn.rst","index.rst","installation/index.rst","intro_rl/basic.rst","intro_rl/basic_en.rst","intro_rl/index.rst","key_concept/index.rst","quick_start/index.rst","quick_start/tb_demo.rst","tutorial_dev/index.rst"],objects:{"ding.config":{Config:[0,0,1,""]},"ding.config.Config":{__init__:[0,1,1,""],_file_to_dict:[0,1,1,""],file_to_dict:[0,1,1,""]},"ding.config.config":{compile_config:[0,2,1,""],compile_config_parallel:[0,2,1,""],read_config:[0,2,1,""],read_config_yaml:[0,2,1,""],save_config:[0,2,1,""],save_config_py:[0,2,1,""],save_config_yaml:[0,2,1,""]},"ding.envs.env.base_env":{BaseEnv:[2,0,1,""],get_env_cls:[2,2,1,""],get_vec_env_setting:[2,2,1,""]},"ding.envs.env.base_env.BaseEnv":{__init__:[2,1,1,""],close:[2,1,1,""],create_collector_env_cfg:[2,1,1,""],create_evaluator_env_cfg:[2,1,1,""],enable_save_replay:[2,1,1,""],info:[2,1,1,""],reset:[2,1,1,""],step:[2,1,1,""]},"ding.envs.env_manager.base_env_manager":{BaseEnvManager:[3,0,1,""],create_env_manager:[3,2,1,""],get_env_manager_cls:[3,2,1,""]},"ding.envs.env_manager.base_env_manager.BaseEnvManager":{close:[3,1,1,""],enable_save_replay:[3,1,1,""],env_info:[3,1,1,""],launch:[3,1,1,""],ready_obs:[3,3,1,""],reset:[3,1,1,""],seed:[3,1,1,""],step:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager":{AsyncSubprocessEnvManager:[3,0,1,""],ShmBuffer:[3,0,1,""],ShmBufferContainer:[3,0,1,""],SyncSubprocessEnvManager:[3,0,1,""]},"ding.envs.env_manager.subprocess_env_manager.AsyncSubprocessEnvManager":{close:[3,1,1,""],enable_save_replay:[3,1,1,""],env_info:[3,1,1,""],launch:[3,1,1,""],ready_obs:[3,3,1,""],reset:[3,1,1,""],seed:[3,1,1,""],step:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager.ShmBuffer":{fill:[3,1,1,""],get:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager.ShmBufferContainer":{fill:[3,1,1,""],get:[3,1,1,""]},"ding.envs.env_manager.subprocess_env_manager.SyncSubprocessEnvManager":{close:[3,1,1,""],enable_save_replay:[3,1,1,""],env_info:[3,1,1,""],launch:[3,1,1,""],ready_obs:[3,3,1,""],reset:[3,1,1,""],seed:[3,1,1,""],step:[3,1,1,""]},"ding.envs.env_wrappers":{ClipRewardEnv:[4,0,1,""],EpisodicLifeEnv:[4,0,1,""],FireResetEnv:[4,0,1,""],FrameStack:[4,0,1,""],MaxAndSkipEnv:[4,0,1,""],NoopResetEnv:[4,0,1,""],ObsNormEnv:[4,0,1,""],ObsTransposeWrapper:[4,0,1,""],RamWrapper:[4,0,1,""],RewardNormEnv:[4,0,1,""],RunningMeanStd:[4,0,1,""],ScaledFloatFrame:[4,0,1,""],WarpFrame:[4,0,1,""],update_shape:[4,4,0,"-"]},"ding.envs.env_wrappers.ClipRewardEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reward:[4,1,1,""]},"ding.envs.env_wrappers.EpisodicLifeEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.FireResetEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""]},"ding.envs.env_wrappers.FrameStack":{__init__:[4,1,1,""],_get_ob:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.MaxAndSkipEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.NoopResetEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""]},"ding.envs.env_wrappers.ObsNormEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.ObsTransposeWrapper":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""]},"ding.envs.env_wrappers.RamWrapper":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.RewardNormEnv":{__init__:[4,1,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],reward:[4,1,1,""],step:[4,1,1,""]},"ding.envs.env_wrappers.RunningMeanStd":{__init__:[4,1,1,""],mean:[4,3,1,""],new_shape:[4,1,1,""],reset:[4,1,1,""],std:[4,3,1,""],update:[4,1,1,""]},"ding.envs.env_wrappers.ScaledFloatFrame":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""]},"ding.envs.env_wrappers.WarpFrame":{__init__:[4,1,1,""],new_shape:[4,1,1,""],observation:[4,1,1,""]},"ding.interaction.base.common":{ControllableContext:[8,0,1,""],ControllableService:[8,0,1,""],default_func:[8,2,1,""],random_token:[8,2,1,""],translate_dict_func:[8,2,1,""]},"ding.interaction.base.common.ControllableContext":{__enter__:[8,1,1,""],__exit__:[8,1,1,""],close:[8,1,1,""],start:[8,1,1,""]},"ding.interaction.base.common.ControllableService":{__enter__:[8,1,1,""],__exit__:[8,1,1,""],close:[8,1,1,""],join:[8,1,1,""],shutdown:[8,1,1,""],start:[8,1,1,""]},"ding.interaction.base.threading":{DblEvent:[11,0,1,""]},"ding.interaction.base.threading.DblEvent":{__init__:[11,1,1,""],close:[11,1,1,""],is_close:[11,1,1,""],is_open:[11,1,1,""],open:[11,1,1,""],wait_for_close:[11,1,1,""],wait_for_open:[11,1,1,""]},"ding.interaction.exception.base":{ResponseException:[12,0,1,""],_IResponseInformation:[12,0,1,""]},"ding.interaction.exception.base.ResponseException":{__init__:[12,1,1,""],code:[12,3,1,""],data:[12,3,1,""],message:[12,3,1,""],status_code:[12,3,1,""],success:[12,3,1,""]},"ding.interaction.exception.base._IResponseInformation":{code:[12,3,1,""],data:[12,3,1,""],message:[12,3,1,""],success:[12,3,1,""]},"ding.interaction.exception.master":{MasterChannelInvalid:[14,0,1,""],MasterChannelNotGiven:[14,0,1,""],MasterErrorCode:[14,5,1,""],MasterMasterTokenInvalid:[14,0,1,""],MasterMasterTokenNotGiven:[14,0,1,""],MasterResponseException:[14,0,1,""],MasterSelfTokenInvalid:[14,0,1,""],MasterSelfTokenNotGiven:[14,0,1,""],MasterSlaveTokenInvalid:[14,0,1,""],MasterSlaveTokenNotGiven:[14,0,1,""],MasterSuccess:[14,0,1,""],MasterSystemShuttingDown:[14,0,1,""],MasterTaskDataInvalid:[14,0,1,""],get_master_exception_by_error:[14,2,1,""],get_master_exception_class_by_error_code:[14,2,1,""]},"ding.interaction.exception.master.MasterChannelInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterChannelNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterErrorCode":{CHANNEL_INVALID:[14,6,1,""],CHANNEL_NOT_GIVEN:[14,6,1,""],MASTER_TOKEN_INVALID:[14,6,1,""],MASTER_TOKEN_NOT_GIVEN:[14,6,1,""],SELF_TOKEN_INVALID:[14,6,1,""],SELF_TOKEN_NOT_GIVEN:[14,6,1,""],SLAVE_TOKEN_INVALID:[14,6,1,""],SLAVE_TOKEN_NOT_GIVEN:[14,6,1,""],SUCCESS:[14,6,1,""],SYSTEM_SHUTTING_DOWN:[14,6,1,""],TASK_DATA_INVALID:[14,6,1,""]},"ding.interaction.exception.master.MasterMasterTokenInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterMasterTokenNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterResponseException":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSelfTokenInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSelfTokenNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSlaveTokenInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSlaveTokenNotGiven":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSuccess":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterSystemShuttingDown":{__init__:[14,1,1,""]},"ding.interaction.exception.master.MasterTaskDataInvalid":{__init__:[14,1,1,""]},"ding.interaction.exception.slave":{SlaveChannelInvalid:[15,0,1,""],SlaveChannelNotFound:[15,0,1,""],SlaveErrorCode:[15,5,1,""],SlaveMasterTokenInvalid:[15,0,1,""],SlaveMasterTokenNotFound:[15,0,1,""],SlaveResponseException:[15,0,1,""],SlaveSelfTokenInvalid:[15,0,1,""],SlaveSelfTokenNotFound:[15,0,1,""],SlaveSlaveAlreadyConnected:[15,0,1,""],SlaveSlaveConnectionRefused:[15,0,1,""],SlaveSlaveDisconnectionRefused:[15,0,1,""],SlaveSlaveNotConnected:[15,0,1,""],SlaveSuccess:[15,0,1,""],SlaveSystemShuttingDown:[15,0,1,""],SlaveTaskAlreadyExist:[15,0,1,""],SlaveTaskRefused:[15,0,1,""],get_slave_exception_by_error:[15,2,1,""],get_slave_exception_class_by_error_code:[15,2,1,""]},"ding.interaction.exception.slave.SlaveChannelInvalid":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveChannelNotFound":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveErrorCode":{CHANNEL_INVALID:[15,6,1,""],CHANNEL_NOT_FOUND:[15,6,1,""],MASTER_TOKEN_INVALID:[15,6,1,""],MASTER_TOKEN_NOT_FOUND:[15,6,1,""],SELF_TOKEN_INVALID:[15,6,1,""],SELF_TOKEN_NOT_FOUND:[15,6,1,""],SLAVE_ALREADY_CONNECTED:[15,6,1,""],SLAVE_CONNECTION_REFUSED:[15,6,1,""],SLAVE_DISCONNECTION_REFUSED:[15,6,1,""],SLAVE_NOT_CONNECTED:[15,6,1,""],SUCCESS:[15,6,1,""],SYSTEM_SHUTTING_DOWN:[15,6,1,""],TASK_ALREADY_EXIST:[15,6,1,""],TASK_REFUSED:[15,6,1,""]},"ding.interaction.exception.slave.SlaveMasterTokenInvalid":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveMasterTokenNotFound":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveResponseException":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSelfTokenInvalid":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSelfTokenNotFound":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveAlreadyConnected":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveConnectionRefused":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveDisconnectionRefused":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSlaveNotConnected":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSuccess":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveSystemShuttingDown":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveTaskAlreadyExist":{__init__:[15,1,1,""]},"ding.interaction.exception.slave.SlaveTaskRefused":{__init__:[15,1,1,""]},"ding.interaction.master.connection":{SlaveConnection:[17,0,1,""],SlaveConnectionProxy:[17,0,1,""],_ISlaveConnection:[17,0,1,""]},"ding.interaction.master.connection.SlaveConnection":{__init__:[17,1,1,""],close:[17,1,1,""],connect:[17,1,1,""],disconnect:[17,1,1,""],is_connected:[17,3,1,""],new_task:[17,1,1,""],start:[17,1,1,""]},"ding.interaction.master.connection.SlaveConnectionProxy":{__init__:[17,1,1,""],close:[17,1,1,""],connect:[17,1,1,""],disconnect:[17,1,1,""],is_connected:[17,3,1,""],new_task:[17,1,1,""],start:[17,1,1,""]},"ding.interaction.master.connection._ISlaveConnection":{close:[17,1,1,""],connect:[17,1,1,""],disconnect:[17,1,1,""],new_task:[17,1,1,""],start:[17,1,1,""]},"ding.interaction.master.master":{Master:[19,0,1,""]},"ding.interaction.master.master.Master":{__contains__:[19,1,1,""],__delitem__:[19,1,1,""],__getitem__:[19,1,1,""],__init__:[19,1,1,""],_after_connect:[19,1,1,""],_after_disconnect:[19,1,1,""],_after_new_task:[19,1,1,""],_before_connect:[19,1,1,""],_before_disconnect:[19,1,1,""],_before_new_task:[19,1,1,""],_error_connect:[19,1,1,""],_error_disconnect:[19,1,1,""],_error_new_task:[19,1,1,""],join:[19,1,1,""],my_address:[19,3,1,""],new_connection:[19,1,1,""],ping:[19,1,1,""],shutdown:[19,1,1,""],start:[19,1,1,""]},"ding.interaction.master.task":{Task:[20,0,1,""],TaskResultType:[20,5,1,""],TaskStatus:[20,5,1,""]},"ding.interaction.master.task.Task":{__init__:[20,1,1,""],join:[20,1,1,""],on_complete:[20,1,1,""],on_fail:[20,1,1,""],result:[20,3,1,""],start:[20,1,1,""],status:[20,3,1,""],task:[20,3,1,""]},"ding.interaction.master.task.TaskResultType":{COMPLETED:[20,6,1,""],FAILED:[20,6,1,""]},"ding.interaction.master.task.TaskStatus":{COMPLETED:[20,6,1,""],FAILED:[20,6,1,""],IDLE:[20,6,1,""],STARTED:[20,6,1,""],STARTING:[20,6,1,""],START_FAILED:[20,6,1,""]},"ding.interaction.slave.action":{ConnectionRefuse:[21,0,1,""],DisconnectionRefuse:[21,0,1,""],TaskFail:[21,0,1,""],TaskRefuse:[21,0,1,""]},"ding.interaction.slave.action.ConnectionRefuse":{__init__:[21,1,1,""]},"ding.interaction.slave.action.DisconnectionRefuse":{__init__:[21,1,1,""]},"ding.interaction.slave.action.TaskFail":{__init__:[21,1,1,""],result:[21,3,1,""]},"ding.interaction.slave.action.TaskRefuse":{__init__:[21,1,1,""]},"ding.interaction.slave.slave":{Slave:[23,0,1,""]},"ding.interaction.slave.slave.Slave":{__init__:[23,1,1,""],_before_connection:[23,1,1,""],_before_disconnection:[23,1,1,""],_before_task:[23,1,1,""],_lost_connection:[23,1,1,""],_process_task:[23,1,1,""],join:[23,1,1,""],ping:[23,1,1,""],shutdown:[23,1,1,""],start:[23,1,1,""]},"ding.league.base_league":{BaseLeague:[25,0,1,""],create_league:[25,4,0,"-"]},"ding.league.base_league.BaseLeague":{finish_job:[25,1,1,""],get_job_info:[25,1,1,""],judge_snapshot:[25,1,1,""],save_checkpoint:[25,1,1,""],update_active_player:[25,1,1,""]},"ding.league.one_vs_one_league":{OneVsOneLeague:[25,0,1,""]},"ding.league.one_vs_one_league.OneVsOneLeague":{finish_job:[25,1,1,""],get_job_info:[25,1,1,""],judge_snapshot:[25,1,1,""],save_checkpoint:[25,1,1,""],update_active_player:[25,1,1,""]},"ding.league.player":{ActivePlayer:[27,0,1,""],HistoricalPlayer:[27,0,1,""],NaiveSpPlayer:[27,0,1,""],Player:[27,0,1,""],create_player:[27,4,0,"-"]},"ding.league.player.ActivePlayer":{__init__:[27,1,1,""],increment_eval_difficulty:[27,1,1,""]},"ding.league.player.HistoricalPlayer":{__init__:[27,1,1,""]},"ding.league.player.NaiveSpPlayer":{get_job:[27,1,1,""],increment_eval_difficulty:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.league.player.Player":{__init__:[27,1,1,""]},"ding.league.shared_payoff":{BattleRecordDict:[26,0,1,""],BattleSharedPayoff:[26,0,1,""],create_payoff:[26,4,0,"-"]},"ding.league.shared_payoff.BattleRecordDict":{__mul__:[26,1,1,""]},"ding.league.shared_payoff.BattleSharedPayoff":{__getitem__:[26,1,1,""],add_player:[26,1,1,""],get_key:[26,1,1,""],update:[26,1,1,""]},"ding.league.starcraft_player":{LeagueExploiter:[27,0,1,""],MainExploiter:[27,0,1,""],MainPlayer:[27,0,1,""]},"ding.league.starcraft_player.LeagueExploiter":{get_job:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.league.starcraft_player.MainExploiter":{get_job:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.league.starcraft_player.MainPlayer":{get_job:[27,1,1,""],is_trained_enough:[27,1,1,""],mutate:[27,1,1,""],snapshot:[27,1,1,""]},"ding.model.common.encoder":{ConvEncoder:[28,0,1,""],FCEncoder:[28,0,1,""],StructEncoder:[28,0,1,""]},"ding.model.common.encoder.ConvEncoder":{__init__:[28,1,1,""],_get_flatten_size:[28,1,1,""],forward:[28,1,1,""]},"ding.model.common.encoder.FCEncoder":{__init__:[28,1,1,""],forward:[28,1,1,""]},"ding.model.common.encoder.StructEncoder":{__init__:[28,1,1,""]},"ding.model.common.head":{DiscreteHead:[29,0,1,""],DistributionHead:[29,0,1,""],DuelingHead:[29,0,1,""],MultiHead:[29,0,1,""],QRDQNHead:[29,0,1,""],QuantileHead:[29,0,1,""],RainbowHead:[29,0,1,""],RegressionHead:[29,0,1,""],ReparameterizationHead:[29,0,1,""]},"ding.model.common.head.DiscreteHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.DistributionHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.DuelingHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.MultiHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.QRDQNHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.QuantileHead":{__init__:[29,1,1,""],forward:[29,1,1,""],quantile_net:[29,1,1,""]},"ding.model.common.head.RainbowHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.RegressionHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.head.ReparameterizationHead":{__init__:[29,1,1,""],forward:[29,1,1,""]},"ding.model.common.utils":{create_model:[31,2,1,""]},"ding.model.template":{QAC:[33,0,1,""],VAC:[34,0,1,""]},"ding.model.template.QAC":{__init__:[33,1,1,""],compute_actor:[33,1,1,""],compute_critic:[33,1,1,""],forward:[33,1,1,""]},"ding.model.template.VAC":{__init__:[34,1,1,""],compute_actor:[34,1,1,""],compute_actor_critic:[34,1,1,""],compute_critic:[34,1,1,""],forward:[34,1,1,""]},"ding.model.template.coma":{COMA:[35,0,1,""],COMAActorNetwork:[35,0,1,""],COMACriticNetwork:[35,0,1,""]},"ding.model.template.coma.COMA":{__init__:[35,1,1,""],forward:[35,1,1,""]},"ding.model.template.coma.COMAActorNetwork":{__init__:[35,1,1,""],forward:[35,1,1,""]},"ding.model.template.coma.COMACriticNetwork":{__init__:[35,1,1,""],_preprocess_data:[35,1,1,""],forward:[35,1,1,""]},"ding.model.template.q_learning":{C51DQN:[37,0,1,""],DQN:[37,0,1,""],IQN:[37,0,1,""],QRDQN:[37,0,1,""],RainbowDQN:[37,0,1,"id0"]},"ding.model.template.q_learning.C51DQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.DQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.IQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.QRDQN":{__init__:[37,1,1,""],forward:[37,1,1,""]},"ding.model.template.q_learning.RainbowDQN":{__init__:[37,1,1,"id1"],forward:[37,1,1,"id2"]},"ding.model.template.qac":{QAC:[178,0,1,""]},"ding.model.template.qac.QAC":{__init__:[178,1,1,""],compute_actor:[178,1,1,""],compute_critic:[178,1,1,""],forward:[178,1,1,""]},"ding.model.template.qmix":{CollaQ:[38,0,1,""],CollaQMultiHeadAttention:[38,0,1,""],CollaQSMACAttentionModule:[38,0,1,""],Mixer:[38,0,1,""],QMix:[38,0,1,""]},"ding.model.template.qmix.CollaQ":{__init__:[38,1,1,""],_setup_global_encoder:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.CollaQMultiHeadAttention":{__init__:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.CollaQSMACAttentionModule":{__init__:[38,1,1,""],_cut_obs:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.Mixer":{__init__:[38,1,1,""],forward:[38,1,1,""]},"ding.model.template.qmix.QMix":{__init__:[38,1,1,""],_setup_global_encoder:[38,1,1,""],forward:[38,1,1,""]},"ding.policy.a2c":{A2CPolicy:[39,0,1,""]},"ding.policy.a2c.A2CPolicy":{_forward_collect:[39,1,1,""],_forward_eval:[39,1,1,""],_forward_learn:[39,1,1,""],_get_train_sample:[39,1,1,""],_init_collect:[39,1,1,""],_init_eval:[39,1,1,""],_init_learn:[39,1,1,""],_process_transition:[39,1,1,""]},"ding.policy.acer":{ACERPolicy:[172,0,1,""]},"ding.policy.collaq":{CollaQPolicy:[40,0,1,""]},"ding.policy.collaq.CollaQPolicy":{_data_preprocess_learn:[40,1,1,""],_forward_collect:[40,1,1,""],_forward_eval:[40,1,1,""],_forward_learn:[40,1,1,""],_get_train_sample:[40,1,1,""],_init_collect:[40,1,1,""],_init_eval:[40,1,1,""],_init_learn:[40,1,1,""],_load_state_dict_learn:[40,1,1,""],_process_transition:[40,1,1,""],_reset_collect:[40,1,1,""],_reset_eval:[40,1,1,""],_reset_learn:[40,1,1,""],_state_dict_learn:[40,1,1,""],default_model:[40,1,1,""]},"ding.policy.coma":{COMAPolicy:[41,0,1,""]},"ding.policy.coma.COMAPolicy":{_data_preprocess_learn:[41,1,1,""],_forward_collect:[41,1,1,""],_forward_eval:[41,1,1,""],_forward_learn:[41,1,1,""],_get_train_sample:[41,1,1,""],_init_collect:[41,1,1,""],_init_eval:[41,1,1,""],_init_learn:[41,1,1,""],_monitor_vars_learn:[41,1,1,""],_process_transition:[41,1,1,""],default_model:[41,1,1,""]},"ding.policy.ddpg":{DDPGPolicy:[42,0,1,""]},"ding.policy.ddpg.DDPGPolicy":{_forward_collect:[42,1,1,""],_forward_eval:[42,1,1,""],_forward_learn:[42,1,1,""],_init_collect:[42,1,1,""],_init_eval:[42,1,1,""],_init_learn:[42,1,1,""],_process_transition:[42,1,1,""]},"ding.policy.dqn":{DQNPolicy:[43,0,1,""]},"ding.policy.dqn.DQNPolicy":{_forward_collect:[43,1,1,""],_forward_eval:[43,1,1,""],_forward_learn:[43,1,1,""],_get_train_sample:[43,1,1,""],_init_collect:[43,1,1,""],_init_eval:[43,1,1,""],_init_learn:[43,1,1,""],_load_state_dict_learn:[43,1,1,""],_process_transition:[43,1,1,""],_state_dict_learn:[43,1,1,""],default_model:[43,1,1,""]},"ding.policy.impala":{IMPALAPolicy:[181,0,1,""]},"ding.policy.ppg":{PPGPolicy:[45,0,1,""]},"ding.policy.ppg.PPGPolicy":{_data_preprocess_learn:[45,1,1,""],_forward_collect:[45,1,1,""],_forward_eval:[45,1,1,""],_forward_learn:[45,1,1,""],_get_batch_size:[45,1,1,""],_get_train_sample:[45,1,1,""],_init_collect:[45,1,1,""],_init_eval:[45,1,1,""],_init_learn:[45,1,1,""],_load_state_dict_learn:[45,1,1,""],_monitor_vars_learn:[45,1,1,""],_process_transition:[45,1,1,""],_state_dict_learn:[45,1,1,""],default_model:[45,1,1,""],learn_aux:[45,1,1,""]},"ding.policy.ppo":{PPOPolicy:[185,0,1,""]},"ding.policy.qmix":{QMIXPolicy:[46,0,1,""]},"ding.policy.qmix.QMIXPolicy":{_data_preprocess_learn:[46,1,1,""],_forward_collect:[46,1,1,""],_forward_eval:[46,1,1,""],_forward_learn:[46,1,1,""],_get_train_sample:[46,1,1,""],_init_collect:[46,1,1,""],_init_eval:[46,1,1,""],_init_learn:[46,1,1,""],_load_state_dict_learn:[46,1,1,""],_process_transition:[46,1,1,""],_reset_collect:[46,1,1,""],_reset_eval:[46,1,1,""],_reset_learn:[46,1,1,""],_state_dict_learn:[46,1,1,""],default_model:[46,1,1,""]},"ding.policy.r2d2":{R2D2Policy:[47,0,1,""]},"ding.policy.r2d2.R2D2Policy":{_forward_collect:[47,1,1,""],_forward_eval:[47,1,1,""],_forward_learn:[47,1,1,""],_init_collect:[47,1,1,""],_init_eval:[47,1,1,""],_init_learn:[47,1,1,""],_process_transition:[47,1,1,""]},"ding.policy.rainbow":{RainbowDQNPolicy:[48,0,1,""]},"ding.policy.rainbow.RainbowDQNPolicy":{_forward_collect:[48,1,1,""],_forward_learn:[48,1,1,""],_get_train_sample:[48,1,1,""],_init_collect:[48,1,1,""],_init_learn:[48,1,1,""]},"ding.policy.sac":{SACPolicy:[189,0,1,""]},"ding.policy.sql":{SQLPolicy:[190,0,1,""]},"ding.policy.td3":{TD3Policy:[192,0,1,""]},"ding.reward_model.base_reward_model":{BaseRewardModel:[49,0,1,""],create_reward_model:[49,4,0,"-"]},"ding.reward_model.base_reward_model.BaseRewardModel":{clear_data:[49,1,1,""],collect_data:[49,1,1,""],estimate:[49,1,1,""],load_expert_data:[49,1,1,""],train:[49,1,1,""]},"ding.reward_model.gail_irl_model":{BaseRewardModel:[50,0,1,""]},"ding.reward_model.gail_irl_model.BaseRewardModel":{__init__:[50,1,1,""],clear_data:[50,1,1,""],collect_data:[50,1,1,""],estimate:[50,1,1,""],load_expert_data:[50,1,1,""],train:[50,1,1,""]},"ding.reward_model.pdeil_irl_model":{PdeilRewardModel:[52,0,1,""]},"ding.reward_model.pdeil_irl_model.PdeilRewardModel":{__init__:[52,1,1,""],clear_data:[52,1,1,""],collect_data:[52,1,1,""],estimate:[52,1,1,""],load_expert_data:[52,1,1,""],train:[52,1,1,""]},"ding.reward_model.pwil_irl_model":{PwilRewardModel:[53,0,1,""],collect_state_action_pairs:[53,4,0,"-"]},"ding.reward_model.pwil_irl_model.PwilRewardModel":{__init__:[53,1,1,""],_get_action_distance:[53,1,1,""],_get_state_distance:[53,1,1,""],clear_data:[53,1,1,""],collect_data:[53,1,1,""],estimate:[53,1,1,""],load_expert_data:[53,1,1,""],train:[53,1,1,""]},"ding.reward_model.red_irl_model":{RedRewardModel:[54,0,1,""]},"ding.reward_model.red_irl_model.RedRewardModel":{__init__:[54,1,1,""],clear_data:[54,1,1,""],collect_data:[54,1,1,""],estimate:[54,1,1,""],load_expert_data:[54,1,1,""],train:[54,1,1,""]},"ding.rl_utils.a2c":{a2c_error:[55,4,0,"-"]},"ding.rl_utils.adder":{Adder:[56,0,1,""]},"ding.rl_utils.adder.Adder":{get_gae:[56,1,1,""],get_gae_with_default_last_value:[56,1,1,""],get_nstep_return_data:[56,1,1,""],get_train_sample:[56,1,1,""]},"ding.rl_utils.coma":{coma_error:[57,4,0,"-"]},"ding.rl_utils.exploration":{BaseNoise:[58,0,1,""],GaussianNoise:[58,0,1,""],OUNoise:[58,0,1,""],create_noise_generator:[58,4,0,"-"],get_epsilon_greedy_fn:[58,4,0,"-"]},"ding.rl_utils.exploration.BaseNoise":{__call__:[58,1,1,""],__init__:[58,1,1,""]},"ding.rl_utils.exploration.GaussianNoise":{__call__:[58,1,1,""],__init__:[58,1,1,""]},"ding.rl_utils.exploration.OUNoise":{__call__:[58,1,1,""],__init__:[58,1,1,""],reset:[58,1,1,""]},"ding.rl_utils.gae":{gae:[59,4,0,"-"]},"ding.rl_utils.isw":{compute_importance_weights:[61,4,0,"-"]},"ding.rl_utils.ppo":{ppo_error:[62,4,0,"-"]},"ding.rl_utils.td":{dist_nstep_td_error:[63,4,0,"-"],generalized_lambda_returns:[63,4,0,"-"],multistep_forward_view:[63,4,0,"-"],q_nstep_td_error:[63,4,0,"-"],q_nstep_td_error_with_rescale:[63,4,0,"-"],td_lambda_error:[63,4,0,"-"]},"ding.rl_utils.upgo":{upgo_loss:[64,4,0,"-"],upgo_returns:[64,4,0,"-"]},"ding.rl_utils.value_rescale":{value_inv_transform:[65,4,0,"-"],value_transform:[65,4,0,"-"]},"ding.rl_utils.vtrace":{vtrace_error:[66,4,0,"-"]},"ding.torch_utils.checkpoint_helper":{CheckpointHelper:[67,0,1,""],CountVar:[67,0,1,""],auto_checkpoint:[67,4,0,"-"],build_checkpoint_helper:[67,4,0,"-"]},"ding.torch_utils.checkpoint_helper.CheckpointHelper":{load:[67,1,1,""],save:[67,1,1,""]},"ding.torch_utils.checkpoint_helper.CountVar":{add:[67,1,1,""],update:[67,1,1,""]},"ding.torch_utils.data_helper":{CudaFetcher:[68,0,1,""],build_log_buffer:[68,4,0,"-"],get_tensor_data:[68,4,0,"-"],same_shape:[68,4,0,"-"],tensor_to_list:[68,4,0,"-"],to_device:[68,4,0,"-"],to_dtype:[68,4,0,"-"],to_list:[68,4,0,"-"],to_ndarray:[68,4,0,"-"],to_tensor:[68,4,0,"-"]},"ding.torch_utils.data_helper.CudaFetcher":{close:[68,1,1,""],run:[68,1,1,""]},"ding.torch_utils.distribution":{CategoricalPd:[69,0,1,""],CategoricalPdPytorch:[69,0,1,""],Pd:[69,0,1,""]},"ding.torch_utils.distribution.CategoricalPd":{entropy:[69,1,1,""],mode:[69,1,1,""],neglogp:[69,1,1,""],noise_mode:[69,1,1,""],sample:[69,1,1,""],update_logits:[69,1,1,""]},"ding.torch_utils.distribution.CategoricalPdPytorch":{entropy:[69,1,1,""],mode:[69,1,1,""],neglogp:[69,1,1,""],sample:[69,1,1,""],update_logits:[69,1,1,""]},"ding.torch_utils.distribution.Pd":{entropy:[69,1,1,""],mode:[69,1,1,""],neglogp:[69,1,1,""],noise_mode:[69,1,1,""],sample:[69,1,1,""]},"ding.torch_utils.loss.cross_entropy_loss":{LabelSmoothCELoss:[74,0,1,""],SoftFocalLoss:[74,0,1,""],build_ce_criterion:[74,4,0,"-"]},"ding.torch_utils.loss.cross_entropy_loss.LabelSmoothCELoss":{forward:[74,1,1,""]},"ding.torch_utils.loss.cross_entropy_loss.SoftFocalLoss":{forward:[74,1,1,""]},"ding.torch_utils.loss.multi_logits_loss":{MultiLogitsLoss:[74,0,1,""]},"ding.torch_utils.loss.multi_logits_loss.MultiLogitsLoss":{forward:[74,1,1,""]},"ding.torch_utils.metric":{hamming_distance:[71,4,0,"-"],levenshtein_distance:[71,4,0,"-"]},"ding.torch_utils.network.activation":{GLU:[75,0,1,""],build_activation:[75,4,0,"-"]},"ding.torch_utils.network.activation.GLU":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module":{BilinearUpsample:[75,0,1,""],ChannelShuffle:[75,0,1,""],MLP:[75,4,0,"-"],NearestUpsample:[75,0,1,""],NoiseLinearLayer:[75,0,1,""],binary_encode:[75,4,0,"-"],conv1d_block:[75,4,0,"-"],conv2d_block:[75,4,0,"-"],deconv2d_block:[75,4,0,"-"],fc_block:[75,4,0,"-"],noise_block:[75,4,0,"-"],one_hot:[75,4,0,"-"],sequential_pack:[75,4,0,"-"],weight_init_:[75,4,0,"-"]},"ding.torch_utils.network.nn_module.BilinearUpsample":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module.ChannelShuffle":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module.NearestUpsample":{forward:[75,1,1,""]},"ding.torch_utils.network.nn_module.NoiseLinearLayer":{forward:[75,1,1,""],reset_noise:[75,1,1,""],reset_parameters:[75,1,1,""]},"ding.torch_utils.network.normalization":{build_normalization:[75,4,0,"-"]},"ding.torch_utils.network.res_block":{ResBlock:[75,0,1,""],ResFCBlock:[75,0,1,""]},"ding.torch_utils.network.res_block.ResBlock":{forward:[75,1,1,""]},"ding.torch_utils.network.res_block.ResFCBlock":{forward:[75,1,1,""]},"ding.torch_utils.network.rnn":{LSTM:[75,0,1,""],LSTMForwardWrapper:[75,0,1,""],PytorchLSTM:[75,0,1,""],get_lstm:[75,4,0,"-"]},"ding.torch_utils.network.rnn.LSTM":{forward:[75,1,1,""]},"ding.torch_utils.network.rnn.LSTMForwardWrapper":{_after_forward:[75,1,1,""],_before_forward:[75,1,1,""]},"ding.torch_utils.network.rnn.PytorchLSTM":{forward:[75,1,1,""]},"ding.torch_utils.network.scatter_connection":{ScatterConnection:[75,0,1,""]},"ding.torch_utils.network.scatter_connection.ScatterConnection":{forward:[75,1,1,""]},"ding.torch_utils.network.soft_argmax":{SoftArgmax:[75,0,1,""]},"ding.torch_utils.network.soft_argmax.SoftArgmax":{forward:[75,1,1,""]},"ding.torch_utils.network.transformer":{Attention:[75,0,1,""],Transformer:[75,0,1,""],TransformerLayer:[75,0,1,""]},"ding.torch_utils.network.transformer.Attention":{forward:[75,1,1,""],split:[75,1,1,""]},"ding.torch_utils.network.transformer.Transformer":{forward:[75,1,1,""]},"ding.torch_utils.network.transformer.TransformerLayer":{forward:[75,1,1,""]},"ding.torch_utils.nn_test_helper":{is_differentiable:[72,4,0,"-"]},"ding.torch_utils.optimizer_helper":{Adam:[73,0,1,""],RMSprop:[73,0,1,""]},"ding.torch_utils.optimizer_helper.Adam":{step:[73,1,1,""]},"ding.torch_utils.optimizer_helper.RMSprop":{step:[73,1,1,""]},"ding.utils.collection_helper":{iter_mapping:[76,4,0,"-"]},"ding.utils.compression_helper":{dummy_compressor:[77,4,0,"-"],dummy_decompressor:[77,4,0,"-"],get_data_compressor:[77,4,0,"-"],get_data_decompressor:[77,4,0,"-"],lz4_data_compressor:[77,4,0,"-"],lz4_data_decompressor:[77,4,0,"-"],zlib_data_compressor:[77,4,0,"-"],zlib_data_decompressor:[77,4,0,"-"]},"ding.utils.data.collate_fn":{default_collate:[78,4,0,"-"],default_decollate:[78,4,0,"-"],diff_shape_collate:[78,4,0,"-"],timestep_collate:[78,4,0,"-"]},"ding.utils.data.dataloader":{AsyncDataLoader:[79,0,1,""]},"ding.utils.data.dataloader.AsyncDataLoader":{__init__:[79,1,1,""],__iter__:[79,1,1,""],__next__:[79,1,1,""],close:[79,1,1,""]},"ding.utils.data.structure.cache":{Cache:[81,0,1,""]},"ding.utils.data.structure.cache.Cache":{__init__:[81,1,1,""],close:[81,1,1,""],get_cached_data_iter:[81,1,1,""],push_data:[81,1,1,""],run:[81,1,1,""]},"ding.utils.default_helper":{LimitedSpaceContainer:[82,0,1,""],deep_merge_dicts:[82,4,0,"-"],deep_update:[82,4,0,"-"],default_get:[82,4,0,"-"],dicts_to_lists:[82,4,0,"-"],error_wrapper:[82,4,0,"-"],flatten_dict:[82,4,0,"-"],list_split:[82,4,0,"-"],lists_to_dicts:[82,4,0,"-"],override:[82,4,0,"-"],set_pkg_seed:[82,4,0,"-"],squeeze:[82,4,0,"-"]},"ding.utils.default_helper.LimitedSpaceContainer":{__init__:[82,1,1,""],acquire_space:[82,1,1,""],decrease_space:[82,1,1,""],get_residual_space:[82,1,1,""],increase_space:[82,1,1,""],release_space:[82,1,1,""]},"ding.utils.design_helper":{SingletonMetaclass:[83,0,1,""]},"ding.utils.design_helper.SingletonMetaclass":{__call__:[83,1,1,""]},"ding.utils.file_helper":{read_file:[84,4,0,"-"],read_from_ceph:[84,4,0,"-"],read_from_file:[84,4,0,"-"],read_from_mc:[84,4,0,"-"],read_from_path:[84,4,0,"-"],read_from_redis:[84,4,0,"-"],read_from_rediscluster:[84,4,0,"-"],remove_file:[84,4,0,"-"],save_file:[84,4,0,"-"],save_file_ceph:[84,4,0,"-"],save_file_redis:[84,4,0,"-"],save_file_rediscluster:[84,4,0,"-"]},"ding.utils.import_helper":{import_module:[85,4,0,"-"],try_import_ceph:[85,4,0,"-"],try_import_link:[85,4,0,"-"],try_import_mc:[85,4,0,"-"],try_import_redis:[85,4,0,"-"],try_import_rediscluster:[85,4,0,"-"]},"ding.utils.k8s_helper":{get_operator_server_kwargs:[87,4,0,"-"]},"ding.utils.lock_helper":{LockContext:[88,0,1,""],get_rw_file_lock:[88,4,0,"-"]},"ding.utils.lock_helper.LockContext":{__enter__:[88,1,1,""],__exit__:[88,1,1,""],__init__:[88,1,1,""]},"ding.utils.log_helper":{LoggerFactory:[89,4,0,"-"],build_logger:[89,4,0,"-"],pretty_print:[89,4,0,"-"]},"ding.utils.log_helper.LoggerFactory":{create_logger:[89,2,1,""],get_tabulate_vars:[89,2,1,""]},"ding.utils.pytorch_ddp_dist_helper":{allreduce:[90,4,0,"-"],broadcast:[90,4,0,"-"],dist_finalize:[90,4,0,"-"],dist_init:[90,4,0,"-"],dist_mode:[90,4,0,"-"],error_wrapper:[90,4,0,"-"],get_group:[90,4,0,"-"],get_rank:[90,4,0,"-"],get_world_size:[90,4,0,"-"]},"ding.utils.segment_tree":{MinSegmentTree:[91,0,1,""],SegmentTree:[91,0,1,""],SumSegmentTree:[91,0,1,""]},"ding.utils.segment_tree.MinSegmentTree":{__getitem__:[91,1,1,""],__init__:[91,1,1,""],__setitem__:[91,1,1,""],reduce:[91,1,1,""]},"ding.utils.segment_tree.SegmentTree":{__getitem__:[91,1,1,""],__init__:[91,1,1,""],__setitem__:[91,1,1,""],reduce:[91,1,1,""]},"ding.utils.segment_tree.SumSegmentTree":{__getitem__:[91,1,1,""],__init__:[91,1,1,""],__setitem__:[91,1,1,""],find_prefixsum_idx:[91,1,1,""],reduce:[91,1,1,""]},"ding.utils.system_helper":{PropagatingThread:[92,0,1,""],find_free_port:[92,4,0,"-"],get_ip:[92,4,0,"-"],get_pid:[92,4,0,"-"],get_task_uid:[92,4,0,"-"]},"ding.utils.system_helper.PropagatingThread":{join:[92,1,1,""],run:[92,1,1,""]},"ding.utils.time_helper":{EasyTimer:[93,0,1,""],TimeWrapper:[93,0,1,""],TimeWrapperTime:[93,0,1,""],WatchDog:[93,0,1,""],build_time_helper:[93,4,0,"-"],get_cuda_time_wrapper:[93,4,0,"-"]},"ding.utils.time_helper.EasyTimer":{__enter__:[93,1,1,""],__exit__:[93,1,1,""],__init__:[93,1,1,""]},"ding.utils.time_helper.TimeWrapper":{end_time:[93,1,1,""],start_time:[93,1,1,""],wrapper:[93,1,1,""]},"ding.utils.time_helper.TimeWrapperTime":{end_time:[93,1,1,""],start_time:[93,1,1,""]},"ding.utils.time_helper.WatchDog":{__init__:[93,1,1,""],start:[93,1,1,""],stop:[93,1,1,""]},"ding.worker.collector.base_serial_collector":{CachePool:[94,0,1,""],ISerialCollector:[94,0,1,""],TrajBuffer:[94,0,1,""],create_serial_collector:[94,4,0,"-"],get_serial_collector_cls:[94,4,0,"-"],to_tensor_transitions:[94,4,0,"-"]},"ding.worker.collector.base_serial_collector.CachePool":{__getitem__:[94,1,1,""],__init__:[94,1,1,""],reset:[94,1,1,""],update:[94,1,1,""]},"ding.worker.collector.base_serial_collector.ISerialCollector":{collect:[94,1,1,""],default_config:[94,1,1,""],envstep:[94,3,1,""],reset:[94,1,1,""],reset_env:[94,1,1,""],reset_policy:[94,1,1,""]},"ding.worker.collector.base_serial_collector.TrajBuffer":{__init__:[94,1,1,""],append:[94,1,1,""]},"ding.worker.collector.base_serial_evaluator":{VectorEvalMonitor:[95,0,1,""]},"ding.worker.collector.base_serial_evaluator.VectorEvalMonitor":{__init__:[95,1,1,""],get_current_episode:[95,1,1,""],get_episode_info:[95,1,1,""],get_episode_reward:[95,1,1,""],get_latest_reward:[95,1,1,""],is_finished:[95,1,1,""],update_info:[95,1,1,""],update_reward:[95,1,1,""]},"ding.worker.collector.comm.base_comm_collector":{BaseCommCollector:[96,0,1,""],create_comm_collector:[96,4,0,"-"]},"ding.worker.collector.comm.base_comm_collector.BaseCommCollector":{__init__:[96,1,1,""],_create_collector:[96,1,1,""],close:[96,1,1,""],get_policy_update_info:[96,1,1,""],send_metadata:[96,1,1,""],send_stepdata:[96,1,1,""],start:[96,1,1,""]},"ding.worker.collector.comm.flask_fs_collector":{CollectorSlave:[96,0,1,""],FlaskFileSystemCollector:[96,0,1,""]},"ding.worker.collector.comm.flask_fs_collector.CollectorSlave":{__init__:[96,1,1,""],_process_task:[96,1,1,""]},"ding.worker.collector.comm.flask_fs_collector.FlaskFileSystemCollector":{__init__:[96,1,1,""],close:[96,1,1,""],deal_with_collector_data:[96,1,1,""],deal_with_collector_start:[96,1,1,""],deal_with_resource:[96,1,1,""],get_policy_update_info:[96,1,1,""],send_metadata:[96,1,1,""],send_stepdata:[96,1,1,""],start:[96,1,1,""]},"ding.worker.collector.comm.utils":{NaiveCollector:[96,0,1,""]},"ding.worker.collector.comm.utils.NaiveCollector":{_process_task:[96,1,1,""]},"ding.worker.coordinator.base_parallel_commander":{BaseCommander:[101,0,1,""],NaiveCommander:[101,0,1,""],create_parallel_commander:[101,4,0,"-"]},"ding.worker.coordinator.base_parallel_commander.NaiveCommander":{__init__:[101,1,1,""],finish_collector_task:[101,1,1,""],finish_learner_task:[101,1,1,""],get_collector_task:[101,1,1,""],get_learner_task:[101,1,1,""],notify_fail_collector_task:[101,1,1,""],notify_fail_learner_task:[101,1,1,""]},"ding.worker.coordinator.base_serial_commander":{BaseSerialCommander:[101,0,1,""]},"ding.worker.coordinator.base_serial_commander.BaseSerialCommander":{__init__:[101,1,1,""],step:[101,1,1,""]},"ding.worker.coordinator.comm_coordinator":{CommCoordinator:[100,0,1,""]},"ding.worker.coordinator.comm_coordinator.CommCoordinator":{__del__:[100,1,1,""],__init__:[100,1,1,""],close:[100,1,1,""],send_collector_task:[100,1,1,""],send_learner_task:[100,1,1,""],start:[100,1,1,""]},"ding.worker.coordinator.coordinator":{Coordinator:[102,0,1,""],TaskState:[102,0,1,""]},"ding.worker.coordinator.coordinator.Coordinator":{__del__:[102,1,1,""],__init__:[102,1,1,""],close:[102,1,1,""],deal_with_collector_finish_task:[102,1,1,""],deal_with_collector_send_data:[102,1,1,""],deal_with_learner_finish_task:[102,1,1,""],deal_with_learner_get_data:[102,1,1,""],deal_with_learner_send_info:[102,1,1,""],error:[102,1,1,""],info:[102,1,1,""],load_state_dict:[102,1,1,""],start:[102,1,1,""],state_dict:[102,1,1,""],system_shutdown_flag:[102,3,1,""]},"ding.worker.coordinator.coordinator.TaskState":{__init__:[102,1,1,""]},"ding.worker.coordinator.resource_manager":{NaiveResourceManager:[104,0,1,""]},"ding.worker.coordinator.resource_manager.NaiveResourceManager":{__init__:[104,1,1,""],assign_collector:[104,1,1,""],assign_learner:[104,1,1,""],update:[104,1,1,""]},"ding.worker.coordinator.solo_parallel_commander":{SoloCommander:[101,0,1,""]},"ding.worker.coordinator.solo_parallel_commander.SoloCommander":{__init__:[101,1,1,""],finish_collector_task:[101,1,1,""],finish_learner_task:[101,1,1,""],get_collector_task:[101,1,1,""],get_learner_task:[101,1,1,""],notify_fail_collector_task:[101,1,1,""],notify_fail_learner_task:[101,1,1,""]},"ding.worker.learner.base_learner":{BaseLearner:[107,0,1,""],create_learner:[107,4,0,"-"]},"ding.worker.learner.base_learner.BaseLearner":{__init__:[107,1,1,""],_setup_hook:[107,1,1,""],_setup_wrapper:[107,1,1,""],call_hook:[107,1,1,""],close:[107,1,1,""],register_hook:[107,1,1,""],save_checkpoint:[107,1,1,""],setup_dataloader:[107,1,1,""],train:[107,1,1,""]},"ding.worker.learner.comm.base_comm_learner":{BaseCommLearner:[105,0,1,""],create_comm_learner:[105,4,0,"-"]},"ding.worker.learner.comm.base_comm_learner.BaseCommLearner":{__init__:[105,1,1,""],close:[105,1,1,""],get_data:[105,1,1,""],send_learn_info:[105,1,1,""],send_policy:[105,1,1,""],start:[105,1,1,""]},"ding.worker.learner.comm.flask_fs_learner":{FlaskFileSystemLearner:[105,0,1,""]},"ding.worker.learner.comm.flask_fs_learner.FlaskFileSystemLearner":{__init__:[105,1,1,""],close:[105,1,1,""],get_data:[105,1,1,""],send_learn_info:[105,1,1,""],send_policy:[105,1,1,""],start:[105,1,1,""]},"ding.worker.learner.learner_hook":{Hook:[107,0,1,""],LearnerHook:[107,0,1,""],LoadCkptHook:[107,0,1,""],LogReduceHook:[107,0,1,""],LogShowHook:[107,0,1,""],SaveCkptHook:[107,0,1,""],build_learner_hook_by_cfg:[107,4,0,"-"],merge_hooks:[107,4,0,"-"],register_learner_hook:[107,4,0,"-"]},"ding.worker.learner.learner_hook.Hook":{__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LearnerHook":{__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LoadCkptHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LogReduceHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.LogShowHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.learner.learner_hook.SaveCkptHook":{__call__:[107,1,1,""],__init__:[107,1,1,""]},"ding.worker.replay_buffer.advanced_buffer":{AdvancedReplayBuffer:[108,0,1,""]},"ding.worker.replay_buffer.advanced_buffer.AdvancedReplayBuffer":{clear:[108,1,1,""],close:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],start:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.base_buffer":{IBuffer:[108,0,1,""],create_buffer:[108,4,0,"-"],get_buffer_cls:[108,4,0,"-"]},"ding.worker.replay_buffer.base_buffer.IBuffer":{clear:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.episode_buffer":{EpisodeReplayBuffer:[108,0,1,""]},"ding.worker.replay_buffer.episode_buffer.EpisodeReplayBuffer":{__init__:[108,1,1,""],clear:[108,1,1,""],close:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],start:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.naive_buffer":{NaiveReplayBuffer:[108,0,1,""]},"ding.worker.replay_buffer.naive_buffer.NaiveReplayBuffer":{clear:[108,1,1,""],close:[108,1,1,""],count:[108,1,1,""],default_config:[108,1,1,""],load_state_dict:[108,1,1,""],push:[108,1,1,""],sample:[108,1,1,""],start:[108,1,1,""],state_dict:[108,1,1,""],update:[108,1,1,""]},"ding.worker.replay_buffer.utils":{PeriodicThruputMonitor:[108,0,1,""],SampledDataAttrMonitor:[108,0,1,""],UsedDataRemover:[108,0,1,""]},"ding.worker.replay_buffer.utils.UsedDataRemover":{add_used_data:[108,1,1,""],close:[108,1,1,""],start:[108,1,1,""]}},objnames:{"0":["py","class","Python class"],"1":["py","method","Python method"],"2":["py","function","Python function"],"3":["py","property","Python property"],"4":["py","module","Python module"],"5":["py","enum","Python enum"],"6":["py","attribute","Python attribute"]},objtypes:{"0":"py:class","1":"py:method","2":"py:function","3":"py:property","4":"py:module","5":"py:enum","6":"py:attribute"},terms:{"0":[0,4,8,12,17,19,20,23,26,27,29,33,34,38,40,41,42,43,45,46,47,48,55,56,57,58,59,62,63,64,66,68,71,73,74,75,78,79,81,82,90,91,93,107,114,115,117,120,123,126,127,128,129,130,131,133,134,135,136,138,141,142,143,144,145,146,147,150,151,153,154,155,156,158,159,161,162,163,166,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,193,195,196,197,199,200],"00":145,"0000":145,"0001":[4,135,145],"000100":[150,151],"0008":145,"001":[40,41,43,46,47,73,136,162,176,177,179,186],"001000":134,"0014312267303466797":[150,151],"0024187564849853516":[150,151],"002432107925415039":[150,151],"0024328231811523438":[150,151],"0024368762969970703":[150,151],"0034339427947998047":[150,151],"004":[143,144],"005":[42,143,144,145,178,189,192],"0067":145,"007":187,"0072":[34,171,181,185],"008":[143,144],"008758":[150,151],"008813":[150,151],"009722":[150,151],"01":[41,45,58,73,143,144,145,146,147,177,184],"01083":75,"011":173,"01224":172,"01290":189,"01561":[66,181],"01783":[55,171],"02":[143,144],"020":193,"0201":[34,171,181,185],"02275":177,"02298":187,"0235":[34,171,181,185],"02438":59,"0252":[34,171,181,185],"0295":145,"02971":[42,178],"03":[143,144],"03051":193,"03497":193,"0370":[33,178,192],"03762":75,"03852":180,"04":195,"04043":[174,176,177,186],"04416":184,"04678":53,"04931":183,"05":[48,135,143,144,145,175,187],"05296":186,"06":[29,188],"06347":[62,185],"0645836e":[150,151],"06580924987792969":[150,151],"0658106803894043":[150,151],"06581401824951172":[150,151],"06583261489868164":[150,151],"06686019897460938":[150,151],"06700":187,"06750":54,"06805300712585449":[150,151],"06887":175,"06923":175,"07":[143,144,150,151,188],"0773":[33,178,192],"07733":174,"08":[73,143,144,190],"08165":190,"08265":193,"08531":176,"09":[143,144],"0917":[33,178,192],"0927":145,"09477":192,"09729":62,"098996":134,"09936":180,"0i":176,"1":[4,8,17,19,20,23,26,27,28,29,33,34,37,40,41,42,43,45,46,47,48,56,58,59,62,63,64,65,66,68,71,74,75,76,78,79,81,82,91,93,107,114,115,118,120,122,126,127,128,130,131,133,134,135,136,138,141,142,143,144,145,146,147,149,150,151,152,153,154,156,157,158,159,162,166,167,168,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,195,196,197,199],"10":[29,37,41,42,43,45,47,48,82,108,114,115,123,125,135,136,142,143,144,151,158,159,172,173,175,177,178,179,184,187,189,192,193,195,199],"100":[43,47,73,82,118,125,131,151,154,158,159,162,164,165,179,188,199],"1000":[125,131,135,188],"10000":[42,43,117,136,162,178,179,189,192,199],"100000":[135,199],"1001":141,"10044":175,"1007":173,"100\u500d\u7684\u901f\u5ea6\u63d0\u5347":150,"100kb":147,"1017":190,"10201":141,"1024":[75,150,151],"1025":141,"1038":[173,193],"105u":[150,151],"10600":141,"10635":174,"10906u":[150,151],"10979u":[150,151],"10gi":161,"10h":141,"10m":[135,141],"11":[8,41,42,43,45,47,48,115,141,142,143,144,145,158,159,175,177,178,179,184,187,188,189,192,199],"11000":141,"11095u":[150,151],"11108":190,"1110u":[150,151],"112":[143,144],"113733u":[150,151],"11485":[46,186],"1149592":190,"1150u":[150,151],"11520":141,"11719":141,"12":[43,45,47,48,63,95,115,158,159,175,179,184,187,189,190,192,199],"120":166,"1200":141,"12000":141,"12139":141,"12230u":[150,151],"123":145,"1230":141,"1248u":[150,151],"126":145,"127":[17,20,153,154],"12729":185,"128":[4,28,29,34,35,37,43,47,75,134,135,136,145,150,151,171,175,179,181,185,187,200],"12894":188,"12894v1":188,"12950":190,"13":[43,45,47,143,144,145,150,151,179,184,189],"130":[143,144],"13015bbca192_750418_logg":134,"130u":[150,151],"1312":179,"13350u":[150,151],"13367u":[150,151],"13421u":[150,151],"13446":177,"136":145,"1364u":[150,151],"1370":141,"13705u":[150,151],"1388":190,"13h":141,"14":[43,45,47,143,144,179,184,189],"1401":141,"14247":141,"1459":141,"1479":190,"149":145,"1493":141,"1496df45":134,"14990":141,"15":[19,27,43,45,47,58,143,144,145,178,179,184],"15000":135,"1506":59,"1509":[42,178],"153":145,"153392":190,"155":190,"15510u":[150,151],"15520":141,"15627":141,"157":[143,144],"15730u":[150,151],"15780":141,"16":[8,43,47,76,145,150,151,161,179,195],"160":135,"1602":[55,171],"1611":[172,180],"162":145,"1620u":[150,151],"16245":141,"1626453528":134,"1626453748":134,"1626453750":134,"1626453752":134,"16331":141,"1639":[33,178,192],"1655u":[150,151],"1665":190,"1670":141,"16775":141,"1683":190,"1699":[158,159],"16gv100":151,"16mb":145,"17":[43,145,179],"1700":141,"17013":141,"1702":190,"1706":[75,177,186],"1707":[62,75,175,185,193],"1710":[175,187],"1750":190,"176":[143,144],"17866":141,"18":[43,63,143,144,145,150,151,179,195],"1800":141,"1801":189,"1802":[66,181,192],"1803":[46,186],"1805":174,"1806":175,"1807":180,"1810":188,"18355u":[150,151],"1850":141,"1880":141,"18906":141,"19":[43,143,144,145,179],"1902":[174,176,177,186],"19034":141,"1905":[54,190],"1911":[174,193],"1912":62,"19120u":[150,151],"19286u":[150,151],"195":199,"1950":141,"197":190,"1_t":177,"1e":[29,42,62,73,126,178,188,189,192],"1e10":138,"1e8":[190,200],"1m":[141,150,151],"1s":[146,147],"1st":53,"1step":[41,177],"1v1":155,"2":[8,11,19,23,28,29,33,37,40,41,42,43,45,46,47,48,53,58,62,63,65,73,74,75,76,78,82,91,108,114,115,126,127,128,130,133,134,135,136,138,141,142,143,144,145,149,150,151,152,153,154,155,157,158,159,160,167,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,195,196,197,199,201],"20":[40,46,89,123,135,136,141,145,164,165,176,186,190,195],"200":190,"2000":[130,141],"20000":[136,141],"2000u":[150,151],"2005":185,"2006":53,"2007":187,"2009":184,"2010":176,"2011":173,"2013":179,"2015":178,"2016":[171,172,173,180],"2017":[173,175,177,185,186,187,193],"2018":[174,175,177,180,181,186,188,189,192],"2019":[174,176,177,186,190,193],"2020":[176,184,185,187,188],"2021":[177,183],"203":173,"2032u":[150,151],"20363":141,"2037u":[150,151],"204073u":[150,151],"2044":145,"2047u":[150,151],"204976u":[150,151],"2082":141,"20distribut":69,"20m":188,"210":135,"2103":183,"2104":177,"2143u":[150,151],"2153u":[150,151],"2197":141,"22":[142,143,144],"2229":141,"2274u":[150,151],"22h":161,"23":114,"230":173,"2300":141,"233":[20,21,153,154,158,159],"2333":[17,20],"235u":[150,151],"238":190,"23900":190,"2390608":190,"2396":141,"2399u":[150,151],"24":8,"240":4,"240u":[150,151],"246u":[150,151],"247700":190,"247u":[150,151],"24h":141,"25":[27,76,143,144,158,159],"25000":[42,178,189,192],"250000":135,"253u":[150,151],"254u":[150,151],"256":[75,150,151,189],"25769":[150,151],"257u":[150,151],"2592":[143,144],"25m":141,"26":[138,145],"2609":141,"261u":[150,151],"264u":[150,151],"265u":[150,151],"266u":[150,151],"2682144":190,"269u":[150,151],"27":[115,143,144,145],"276":145,"277":190,"278250":190,"2796":145,"2860":141,"28h":141,"29":[143,144,180],"2906u":[150,151],"29383u":[150,151],"296":145,"2976":[143,144],"2c07ac22512a16715cc759f0072be43a5d12ae45":63,"2d":[75,135,195],"2e8879e3":134,"2e9":27,"2ep":65,"2h":141,"2m":141,"2nd":53,"3":[8,23,27,29,33,37,38,40,41,42,43,45,46,47,48,58,75,76,78,82,108,114,115,119,126,127,128,130,132,133,134,135,136,138,141,143,144,145,149,150,151,152,153,154,156,157,158,159,162,171,172,173,175,176,177,178,179,181,184,186,187,188,189,192,195,196,197,199,201,202],"30":[4,120,135,143,144,195],"300":[143,144],"3000":[143,144],"30000":161,"309u":[150,151],"31":[143,144,145],"3100":141,"310u":[150,151],"311":[143,144],"311u":[150,151],"3120":141,"31376":190,"314":117,"32":[28,29,37,38,115,125,135,145,172,175,176,179,181],"32085405":75,"32436":190,"325u":[150,151],"328u":[150,151],"329":145,"32g":[150,151],"32gv100":[150,151],"33":142,"3350":145,"34":145,"3472":141,"34879333":75,"35":[27,143,144,145,191],"354":173,"3581":141,"35856":190,"3589":141,"359":173,"36":145,"3607f1428aaa_907961":134,"3620":141,"368u":[150,151],"36u":[150,151],"3700":141,"3880":141,"3882":141,"388u":[150,151],"3898u":[150,151],"389u":[150,151],"38h":141,"39":[143,144,145],"393u":[150,151],"394u":[150,151],"39693u":[150,151],"3980":141,"3982":[141,145],"3e":189,"3h":141,"3s5z":[141,199],"4":[4,29,33,34,37,42,43,47,48,68,75,76,78,82,96,114,115,120,126,127,129,133,134,135,138,141,143,144,145,146,147,149,150,151,152,158,159,171,172,175,178,179,181,183,185,187,188,189,192,193,199,201],"40":145,"400":138,"4000":[135,141],"407":[143,144],"40k":188,"40kb":145,"41":145,"420u":[150,151],"422u":[150,151],"423u":[150,151],"424u":[150,151],"4250":141,"426298":[150,151],"4388":141,"44":[143,144],"45":[143,144],"4525":[139,140],"4565":180,"4570":141,"4573":180,"459u":[150,151],"463u":[150,151],"467":[143,144],"47":[143,144],"474u":[150,151],"480u":[150,151],"482":190,"4890b4c5":134,"49":[143,144,145],"4923":145,"4927":141,"4955":145,"4a1b":134,"4a1d":134,"4c94":134,"4e29":134,"4e9":27,"4eabd5218e3d0da5e7aafcbf48ea0df2daded1bddf0b8724fde1569aa78f24a7":8,"4ebb":134,"4ep":65,"4f38":134,"4h":141,"5":[8,17,19,23,26,27,29,40,41,42,43,45,46,47,48,62,73,75,76,95,115,118,126,135,136,138,141,143,144,145,149,150,151,152,153,154,155,158,159,172,175,176,177,178,179,181,184,186,187,188,189,192,199,200],"50":[143,144,145,155,190],"500":135,"5007":141,"5087":145,"50969u":[150,151],"51":[29,37,48,143,144,145,175,187],"5116":141,"512":[135,150,151],"5179u":[150,151],"519":[143,144],"51923u":[150,151],"5198u":[150,151],"52":[143,144,145],"520":[143,144],"5208":141,"5214u":[150,151],"5219":145,"5274":145,"5319":141,"53805":190,"54":[143,144],"5429u":[150,151],"545":[143,144],"5489":141,"55":[8,141,143,144],"550":173,"555":[143,144],"559u":[150,151],"56":145,"5602":179,"561u":[150,151],"5652u":[150,151],"5653u":[150,151],"5677u":[150,151],"567u":[150,151],"57":[135,187],"5700":141,"571u":[150,151],"577":[143,144],"5784":141,"58":145,"5850":141,"5860u":[150,151],"5890u":[150,151],"59":145,"5930u":[150,151],"5940u":[150,151],"5h":141,"5kb":145,"5m":141,"6":[8,37,40,41,42,43,45,46,47,48,115,126,127,129,133,135,138,141,143,144,145,149,150,151,152,172,173,175,176,177,178,179,181,184,186,187,188,189,192,195,199],"60":[143,144,145,146,147],"61":[143,144,173],"6127":145,"62":[143,144,145],"622":141,"627":141,"62810u":[150,151],"63":[143,144],"64":[8,28,29,33,34,35,37,38,43,47,114,118,134,136,143,144,145,150,151,162,171,175,178,179,181,185,187,192,200],"64mb":145,"65":[143,144],"65850u":[150,151],"66":161,"67":[143,144,145],"692":141,"69232":141,"693":195,"693664":190,"6h":141,"6m":141,"7":[40,41,42,43,45,46,47,48,115,133,141,143,144,145,158,159,172,175,176,177,178,179,181,184,186,187,189,192,195],"70":[27,143,144,145],"703":[143,144],"71":[143,144],"72":145,"7235":19,"7236":[17,19,23],"73":[143,144],"7307":141,"7335":145,"74":[143,144],"7403":145,"7441":145,"749u":[150,151],"7530":145,"755":141,"75f9fa602388_614285_logg":134,"76":[141,145],"765848":190,"77":[143,144],"7703":145,"776u":[150,151],"7968":141,"7h":141,"7m":151,"7ms\u964d\u4f4e\u52308":150,"8":[37,40,41,42,43,45,46,47,48,62,63,75,115,126,135,136,141,143,144,145,151,156,158,159,161,162,166,171,172,175,176,177,178,179,184,186,187,189,192,195,200],"80":[143,144,145,161],"80000":190,"8080":[153,154],"8088":[153,154],"81":145,"812":141,"81368019":93,"8142":145,"82":[143,144,145],"8200":141,"82da":134,"82u":[150,151],"83016":190,"8311u":[150,151],"83u":[150,151],"84":[4,37,127,135,143,144,179,199],"840":141,"8421":145,"845367u":[150,151],"84x84":[4,120],"852u":[150,151],"861429u":[150,151],"8645":145,"88":[143,144],"8815":134,"8825":145,"8843":145,"8858":134,"8929":[158,159],"8af5":134,"8af829f03845_711157_logg":134,"8d50":134,"8m":[150,151],"8s":161,"8x8":188,"9":[40,41,42,43,45,47,48,63,73,76,141,145,151,172,175,176,177,178,179,184,187,189,192],"90":[143,144],"900u":[150,151],"9124":145,"92":[143,144],"9258":173,"9268":145,"93":[143,144],"9365":145,"938":141,"9381":145,"94":[143,144],"944":141,"9451":134,"9496":141,"95":[43,45,47,48,66,136,162,175,179,181,184,187,188],"9525":145,"95u":[150,151],"96":[135,188],"960":141,"9625":145,"9670":145,"9684":145,"97":[43,48,59,128,136,162,175,179,187,200],"9750":141,"98":[143,144],"98873u":[150,151],"989":141,"99":[40,41,45,46,56,59,73,135,176,177,181,184,186,188],"990":141,"997":47,"999":[43,47,48,73,175,179,187,188],"9h":141,"\u015bwiechowski":183,"\u03b8":188,"\u03b8_":188,"\u4e00\u4e2a\u7b80\u5355\u7684\u4f8b\u5b50":153,"\u4e00\u4e2a\u7b80\u5355\u7684demo":142,"\u4e00\u4e9b\u8f83\u590d\u6742\u7684\u60c5\u5f62\u53ef\u4ee5\u4f7f\u7528":168,"\u4e00\u5b9a\u662f\u5b8c\u6210\u4e86":146,"\u4e00\u5f8b\u4f7f\u7528":148,"\u4e00\u65e6coordinator\u53d1\u6765\u4efb\u52a1":156,"\u4e00\u6837":146,"\u4e00\u6b21\u5b9e\u9a8c\u5305\u62ec50\u6b21\u6570\u636e\u5904\u7406":145,"\u4e00\u6b65\u6240\u9700\u7684\u65f6\u95f4":143,"\u4e00\u79cd\u662f\u901a\u8fc7\u5b66\u5230\u7684model\u751f\u6210\u4e00\u4e9b\u4eff\u771f\u8f68\u8ff9":196,"\u4e00\u79cd\u7ecf\u5178\u7684\u65b9\u6cd5\u662f":196,"\u4e00\u822c\u4f7f\u7528\u8005\u5ffd\u7565\u5373\u53ef":139,"\u4e00\u822c\u5305\u62ec":148,"\u4e00\u822c\u5305\u62ec\u7ef4\u5ea6":148,"\u4e00\u822c\u5728\u73af\u5883\u5f00\u59cb\u5b9e\u9645\u8fd0\u884c\u524d\u8c03\u7528":148,"\u4e00\u822c\u5c06\u73af\u5883\u4e2d\u6240\u6709\u6709\u6548\u52a8\u4f5c":196,"\u4e00\u822c\u5efa\u8bae\u628a\u65b0\u7684\u4ee3\u7801\u5e93\u653e\u5230\u5404\u81ea\u7684\u5c0f\u7ec4":168,"\u4e00\u822c\u60c5\u51b5\u4e0b\u4e5f":168,"\u4e00\u822c\u6765\u8bf4":[146,164],"\u4e00\u822c\u7684\u73af\u5883\u4f1a\u4f7f\u7528\u5b9e\u503c\u5411\u91cf":196,"\u4e00\u822c\u7684\u8fd0\u884c\u5373\u53ef\u5b8c\u6210":153,"\u4e00\u822c\u8868\u793a\u4e3a":196,"\u4e00\u822c\u9700\u8981\u5728":148,"\u4e00\u822c\u975e\u5f00\u53d1\u8005\u65e0\u9700\u6307\u5b9a\u8be5\u9009\u9879":139,"\u4e00\u8282":168,"\u4e00\u8fb9\u53bb\u8bad\u7ec3actor\u7f51\u7edc":196,"\u4e09\u4e2a\u65b9\u6cd5hook\u4e2d\u9700\u8981\u7528\u5230\u7684\u65b9\u6cd5":156,"\u4e09\u8005\u7684\u6570\u636e\u8bfb\u53d6\u901f\u5ea6\u53ca\u6574\u4f53\u8bad\u7ec3\u6548\u7387\u4e3a":145,"\u4e0a":[143,158],"\u4e0a\u4e00\u4e2a":145,"\u4e0a\u56fe\u5373\u5c55\u793a\u4e86coordinator\u548ccomm":156,"\u4e0a\u7684\u6240\u6709\u51fd\u6570\u5c06\u4f1a\u88ab\u8c03\u7528":164,"\u4e0a\u7684\u8fd0\u884c\u7ed3\u679c\u5982\u4e0b":150,"\u4e0b":[150,168,196],"\u4e0b\u4ee5\u65b9\u4fbf\u67e5\u770b":164,"\u4e0b\u662f\u5426\u5171\u4eab\u6a21\u578b\u672c\u8eab":164,"\u4e0b\u7684":168,"\u4e0b\u9762\u7684\u4ee3\u7801\u63d0\u4f9b\u4e86\u4e00\u4e2a\u7b80\u5355\u6837\u4f8b":139,"\u4e0b\u9762\u7684\u7ae0\u8282\u6211\u4eec\u4f1a\u66f4\u8be6\u7ec6\u5730\u4ecb\u7ecd\u5f3a\u5316\u5b66\u4e60\u4e2d\u5b66\u4e60\u7b56\u7565\u7684\u65b9\u6cd5":196,"\u4e0d\u4f1a\u8fd4\u56de\u5b50\u73af\u5883\u7684":146,"\u4e0d\u4f20\u5165\u53c2\u6570\u65f6\u9ed8\u8ba4":146,"\u4e0d\u5229\u4e8e\u521d\u5b66\u8005\u4e0a\u624b\u7b49\u539f\u56e0":164,"\u4e0d\u540c\u6216\u65b0\u589e\u7684\u5c5e\u6027":146,"\u4e0d\u540c\u6216\u65b0\u589e\u7684\u65b9\u6cd5":146,"\u4e0d\u540c\u7684\u73af\u5883\u4e2d\u53ef\u80fd\u5b58\u5728\u5176\u4ed6\u96be\u4ee5\u5904\u7406\u7684\u5956\u52b1\u51fd\u6570":196,"\u4e0d\u540c\u7684\u73af\u5883\u6240\u5141\u8bb8\u7684\u52a8\u4f5c\u7a7a\u95f4\u4e0d\u540c":196,"\u4e0d\u5b9c\u5728\u8282\u70b9\u4e0a\u5206\u6563\u7b97\u529b":153,"\u4e0d\u662ftypeerror":158,"\u4e0d\u7136\u901a\u8fc7\u629b\u51fa":153,"\u4e0d\u8981\u628a\u4e0d\u5b8c\u6574\u7684":168,"\u4e0d\u8981\u628a\u4efb\u4f55\u4e0e\u9879\u76ee\u5b9e\u73b0\u65e0\u5173\u7684\u6587\u4ef6\u7b7e\u5165":168,"\u4e0d\u8981\u76f4\u63a5\u4f7f\u75280\u6216\u7f3a\u7701\u7b49\u5bb9\u6613\u78b0\u649e\u7684\u503c":153,"\u4e0d\u8981\u76f4\u63a5\u4f7f\u7528master\u7c7b\u521b\u5efamaster\u7aef":153,"\u4e0d\u8981\u76f4\u63a5\u4f7f\u7528slave\u7c7b\u521b\u5efaslave\u7aef":153,"\u4e0d\u96be\u53d1\u73b0":145,"\u4e0e":[143,145,148,156,158],"\u4e0e\u4e4b\u7c7b\u4f3c\u7684\u4e5f\u6709\u7c7b\u4f3c\u51e0\u4e2a\u4efb\u52a1\u6a21\u5f0f":153,"\u4e0e\u4f7f\u7528":164,"\u4e0e\u503c\u51fd\u6570\u7684\u65b9\u6cd5\u76f8\u6bd4":196,"\u4e0e\u57fa\u4e8e\u503c\u51fd\u6570\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u4e0d\u540c":196,"\u4e0e\u76d1\u7763\u5b66\u4e60":196,"\u4e0eslave\u7c7b\u4f3c":153,"\u4e14":145,"\u4e14\u4e3a\u8fd9\u4e2aissu":168,"\u4e14\u4e3a\u8fd9\u4e2aissue\u6253\u4e0a\u76f8\u5e94label":168,"\u4e14\u4fdd\u7559\u539f\u503c":158,"\u4e14\u5728\u5927\u89c4\u6a21\u73af\u5883\u6216\u957f":143,"\u4e14\u5728\u9700\u8981\u7684\u65f6\u5019\u5b9e\u73b0\u8bf8\u5982":153,"\u4e14\u5efa\u8bae\u5b9e\u73b0":153,"\u4e14\u6ee1\u8db3":196,"\u4e14\u968f\u7740\u73af\u5883\u89c4\u6a21\u4e0e\u6570\u636e\u6d41\u538b\u529b\u7684\u589e\u5927":145,"\u4e14\u9700\u8981\u65b9\u4fbf\u4e1a\u52a1\u5c42\u8c03\u5ea6\u7ba1\u7406\u7684\u5b9e\u9645\u9700\u6c42":153,"\u4e24\u4e2a\u6846\u67b6\u4e2d":143,"\u4e24\u4e2a\u7c7b\u6784\u6210\u5b8c\u6574\u7684\u73af\u5883\u5143\u7d20":148,"\u4e24\u4e2a\u90e8\u5206\u7684\u4e0d\u540c\u4e5f\u9020\u6210\u4e86\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u533a\u522b":196,"\u4e24\u79cd\u60c5\u51b5":156,"\u4e24\u8005\u533a\u522b\u662f\u4ec0\u4e48":196,"\u4e2a\u73af\u5883":143,"\u4e2a\u8bad\u7ec3\u6837\u672c":143,"\u4e2d":[139,145,148,156,164],"\u4e2d\u4f1a\u5728comm":156,"\u4e2d\u4f1a\u6839\u636e":148,"\u4e2d\u4f7f\u7528":164,"\u4e2d\u4f7f\u7528\u7684":164,"\u4e2d\u4f7f\u7528\u81ea\u5b9a\u4e49\u7684":164,"\u4e2d\u53d6\u51fa\u6570\u636e":156,"\u4e2d\u53d6\u51fa\u6570\u636e\u8bf7\u6c42":156,"\u4e2d\u53ea\u5bf9\u5e38\u7528\u7684":164,"\u4e2d\u53ea\u7ef4\u62a4\u901a\u7528\u7684\u72b6\u6001\u53d8\u91cf":148,"\u4e2d\u5b50\u73af\u5883\u7684":146,"\u4e2d\u5b50\u73af\u5883\u7684\u6570\u91cf":146,"\u4e2d\u5b9a\u4e49\u7684":164,"\u4e2d\u5b9e\u73b0":164,"\u4e2d\u5b9e\u73b0\u9759\u6001\u51fd\u6570":148,"\u4e2d\u6307\u5b9a":146,"\u4e2d\u6307\u5b9a\u6700\u5927":146,"\u4e2d\u6307\u5b9a\u7684":146,"\u4e2d\u6709\u4e86\u6570\u636e\u4fe1\u606f":156,"\u4e2d\u7528\u5230":164,"\u4e2d\u7684":[143,145,148],"\u4e2d\u7684\u4efb\u610f\u53d8\u91cf\u8fdb\u884c\u64cd\u4f5c":164,"\u4e2d\u7684\u6570\u636e\u4ece":145,"\u4e2d\u7684\u6587\u4ef6\u65f6":168,"\u4e2d\u7684\u952e\u5bf9\u5e94\u7684\u5b50\u73af\u5883":146,"\u4e2d\u76f4\u63a5\u5bf9":164,"\u4e2d\u7ee7\u7eed\u5bfb\u627e":164,"\u4e2d\u83b7\u53d6\u4e00\u4e2a\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5e76\u6267\u884c":145,"\u4e2d\u83b7\u53d6\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5e76\u6267\u884c":145,"\u4e2d\u83b7\u53d6\u8bad\u7ec3\u4fe1\u606f":156,"\u4e2d\u8bbe\u7f6e":150,"\u4e2d\u8fd4\u56de":148,"\u4e2d\u8fd4\u56de\u4e0a\u8ff0hook":156,"\u4e2d\u8fd9\u4e9b\u53c2\u6570\u7684\u8bbe\u7f6e\u548c\u9ed8\u8ba4\u503c\u5982\u4e0b":146,"\u4e32\u884c\u6ca1\u6709":156,"\u4e32\u884cpipelin":156,"\u4e3a\u4e00\u6279\u6570\u636e\u6570\u91cf":145,"\u4e3a\u4e00\u79cd\u65b9\u4fbf\u6613\u7528\u4e14\u6613\u914d\u7f6e\u7684\u65e5\u5fd7\u67b6\u6784":142,"\u4e3a\u4e86\u63d0\u5347\u6027\u80fd":150,"\u4e3a\u4e86\u65b9\u4fbf\u5730\u5bf9\u73af\u5883\u7c7b\u7684\u8f93\u5165\u8f93\u51fa\u505a\u4e00\u4e9b\u64cd\u4f5c\u6216\u8005\u9002\u914d":164,"\u4e3a\u4e86\u65b9\u4fbf\u5bf9\u4efb\u52a1\u903b\u8f91\u7684\u5b9e\u73b0":153,"\u4e3a\u4e86\u65b9\u4fbf\u5bf9\u529f\u80fd\u7684\u6269\u5c55":153,"\u4e3a\u4e86\u66f4\u597d\u5730\u7406\u89e3\u5404\u79cd\u5f3a\u5316\u5b66\u4e60\u7684\u65b9\u6cd5":196,"\u4e3a\u4e86\u66f4\u8be6\u7ec6\u5730\u4ecb\u7ecd\u5f3a\u5316\u5b66\u4e60\u7684\u7406\u8bba\u7ec6\u8282\u4e0e\u6280\u672f":196,"\u4e3a\u4e86\u907f\u514d\u6b67\u4e49":158,"\u4e3a\u4ec0\u4e48\u8981\u4f7f\u7528replai":196,"\u4e3a\u4f8b":156,"\u4e3a\u4fdd\u6301fork\u4ee3\u7801\u5e93\u548c\u539f\u4ee3\u7801\u5e93\u540c\u6b65":168,"\u4e3a\u5176\u589e\u52a0\u65b0\u7684\u5b57\u6bb5":148,"\u4e3a\u52a8\u4f5c\u52a0\u4e0a\u6307\u5b9a\u79cd\u7c7b":164,"\u4e3a\u56de\u62a5\u51fd\u6570":196,"\u4e3a\u5c06\u4e00\u6279\u6570\u636e\u5206\u5272\u5f00\u540e\u7684\u4e00\u5757\u6570\u636e\u6570\u91cf":145,"\u4e3a\u5df2\u7ecf\u6ce8\u518c\u7684\u4efb\u610f":164,"\u4e3a\u5e76\u884c\u8bad\u7ec3\u8bbe\u7f6edataload":156,"\u4e3a\u6027\u80fd\u8bc4\u6d4b\u521b\u5efa\u76f8\u5e94\u7684\u73af\u5883\u914d\u7f6e\u6587\u4ef6":148,"\u4e3a\u6298\u6263\u56e0\u5b50":196,"\u4e3a\u6570\u636e\u6536\u96c6\u521b\u5efa\u76f8\u5e94\u7684\u73af\u5883\u914d\u7f6e\u6587\u4ef6":148,"\u4e3a\u65b9\u4fbf\u7ba1\u7406\u5404\u5b50\u73af\u5883\u7684\u72b6\u6001\u5e76\u4fbf\u4e8e":146,"\u4e3a\u6709\u9650\u7684\u52a8\u4f5c\u96c6":196,"\u4e3a\u6709\u9650\u7684\u72b6\u6001\u96c6":196,"\u4e3a\u72b6\u6001\u8f6c\u79fb\u6982\u7387":196,"\u4e3a\u73af\u5883\u8fdb\u7a0b\u53d1\u9001\u52a8\u4f5c\u547d\u4ee4":146,"\u4e3a\u9632\u6b62\u6709\u4e9b\u5b50\u73af\u5883\u56e0\u8fde\u63a5\u95ee\u9898\u77ed\u6682\u5730\u62a5\u9519":146,"\u4e3b\u6253\u901a\u7528\u6027":142,"\u4e3b\u8981\u5206\u4e3a\u5982\u4e0b\u51e0\u4e2a\u5b50\u6a21\u5757":156,"\u4e3b\u8981\u662f\u5728":164,"\u4e3b\u8981\u662f\u9488\u5bf9di":150,"\u4e3b\u8981\u8868\u73b0\u4e3a\u8ba1\u65f6\u76f8\u5173\u7684":164,"\u4e3e\u4f8b\u5982\u4e0b":153,"\u4e4b\u524d":164,"\u4e4b\u540e":[164,168],"\u4e4b\u540e\u4f1a\u81ea\u52a8":146,"\u4e4b\u5916":143,"\u4e4b\u95f4\u7684\u987a\u5e8f":145,"\u4e58\u4ee5":143,"\u4e5f\u5373\u7b2c\u4e00\u5f20\u987a\u5e8f\u56fe\u4e2d\u88ab\u7565\u53bb\u7684\u90e8\u5206":156,"\u4e5f\u53ef\u4ee5\u5bf9\u4e0d\u540c\u7684\u7b56\u7565\u7a7a\u95f4\u4e2d\u627e\u5230\u6700\u4f18\u7b56\u7565":196,"\u4e5f\u53ef\u4ee5\u628a\u8fd9\u4e9b\u505a\u5230\u4e00\u534a\u7684":168,"\u4e5f\u53ef\u4ee5\u7406\u89e3\u4e3a":145,"\u4e5f\u53ef\u4f9b\u66f4\u8fdb\u4e00\u6b65\u7684\u5c01\u88c5":142,"\u4e5f\u53ef\u5b9a\u4e49\u76f8\u5e94\u7684\u529f\u80fd\u7c7b":153,"\u4e5f\u5c06\u6309\u7167\u4ece\u4e0a\u81f3\u4e0b\u7684\u987a\u5e8f\u5c55\u793a\u4e09\u4e2a":145,"\u4e5f\u5c31\u662f\u8ba1\u7b97\u5f97\u5230\u52a8\u4f5c\u4e0a\u7b56\u7565\u68af\u5ea6":196,"\u4e5f\u5e76\u975e":145,"\u4e5f\u5fc5\u987b\u7b49\u5f85":145,"\u4e5f\u662f\u5173\u952e\u6240\u5728":142,"\u4e5f\u662f\u6700\u5e38\u89c1\u7684\u5e38\u89c1\u6a21\u578b":196,"\u4e5f\u66f4\u5efa\u8bae\u5404\u4f4d\u4f7f\u7528\u8005\u5145\u5206\u5229\u7528\u8fd9\u4e00\u7279\u6027":158,"\u4e5f\u8bb8\u8981\u82b1\u8d39\u76f8\u5f53\u7684\u7cbe\u529b":164,"\u4e5f\u9075\u5faa":148,"\u4e86":164,"\u4e86\u5f85\u4f18\u5316\u7684\u7b56\u7565\u9501\u51b3\u5b9a\u7684\u51b3\u7b56\u5e8f\u5217\u8f68\u8ff9":196,"\u4e8c\u8fdb\u5236\u5e93\u6587\u4ef6\u7b49":168,"\u4e92\u76f8\u72ec\u7acb":148,"\u4e94\u90e8\u5206":148,"\u4ea4\u7531learner":156,"\u4ea4\u7ed9\u7528\u6237\u5728":164,"\u4ea4\u901a":196,"\u4ec0\u4e48\u662fexplor":196,"\u4ec0\u4e48\u662fmodel":196,"\u4ec0\u4e48\u662fon":196,"\u4ec0\u4e48\u662fonlin":196,"\u4ec0\u4e48\u662fvalu":196,"\u4ec5\u4ec5\u9700\u8981\u7ecf\u9a8c\u5c31\u53ef\u4ee5\u6c42\u89e3\u6700\u4f18\u7b56\u7565":196,"\u4ec5\u4fdd\u7559expire\u65f6\u95f4\u5185\u7684\u6570\u636e":142,"\u4ec5\u5305\u542b\u4e3a\u7406\u89e3\u540e\u8ff0\u5de5\u4f5c\u6d41\u7a0b\u6240\u5fc5\u987b\u7684\u90e8\u5206":156,"\u4ec5\u5b9a\u4e49\u540d\u5b57name\u548c\u4f18\u5148\u5ea6prior":156,"\u4ec5\u652f\u6301mse":150,"\u4ece":[145,156],"\u4ece\u4ee3\u7801\u53ef\u4ee5\u770b\u51fa":164,"\u4ece\u65b0\u5f00\u59cb\u521b\u5efa\u4e00\u4e2a\u4ed3\u5e93":168,"\u4ece\u667a\u80fd\u4f53\u63a5\u6536\u5230\u6570\u636e\u7684\u5904\u7406\u51fd\u6570":148,"\u4ece\u786c\u76d8\u8bfb\u53d6\u8bad\u7ec3\u6570\u636e\u81f3\u5185\u5b58":145,"\u4ece\u800c\u53ef\u4ee5\u5bf9\u65b0\u7684\u6837\u672c\u8fdb\u884c\u9884\u6d4b":196,"\u4ece\u800c\u5b9e\u73b0\u5feb\u901f\u4fee\u6539\u4ee3\u7801\u7684\u529f\u80fd":164,"\u4ece\u800c\u5f97\u5230\u76f8\u5e94\u7684":148,"\u4ece\u800c\u63d0\u9ad8\u4e86data":196,"\u4ece\u800c\u9020\u6210\u4e0d\u53ef\u9884\u671f\u7684\u7ed3\u679c":153,"\u4ece\u800c\u964d\u4f4e\u52a0\u901f\u6bd4":150,"\u4ed3\u5e93\u5185\u4ee5\u9632\u6b62\u5de5\u4f5c\u4e22\u5931":168,"\u4ee3\u7801\u4f5c\u8005\u53ef\u4ee5\u5728\u4e00\u6bb5\u4ee3\u7801\u4e2d\u7684\u4efb\u610f\u4f4d\u7f6e\u66b4\u9732\u51fa\u94a9\u5b50":164,"\u4ee3\u7801\u5408\u5e76\u6210\u529f\u540e":168,"\u4ee3\u7801\u7ed3\u6784":156,"\u4ee5\u4e0a\u4e09\u4e2a\u65f6\u95f4\u5747\u4f1a\u5728\u539f\u503c\u7684":143,"\u4ee5\u4e0b\u4e3a\u4e00\u4e2a":146,"\u4ee5\u4e0b\u53ea\u5217\u51fa\u4e0e":146,"\u4ee5\u4e0b\u662f\u4e00\u4e9b\u5177\u4f53\u7684\u7b80\u5355\u4f8b\u5b50":158,"\u4ee5\u4e0b\u662f\u4e0a\u8ff0\u65e5\u5fd7\u6a21\u578b\u7684\u8c03\u7528\u4f8b\u5b50":142,"\u4ee5\u4e0b\u6d41\u7a0b\u53ef\u4ee5\u7406\u89e3\u4e3a\u4e00\u6761\u6570\u636e\u4ece\u78c1\u76d8\u6587\u4ef6\u5230":145,"\u4ee5\u4e0b\u7b80\u79f0":145,"\u4ee5\u4f5c\u4e3abaselin":145,"\u4ee5\u4f9b\u53c2\u8003":196,"\u4ee5\u4fbf\u63d0\u524d\u7ec8\u6b62\u8fd0\u884c":146,"\u4ee5\u4fdd\u8bc1\u76f8\u5173\u529f\u80fd\u80fd\u591f\u6b63\u5e38\u8fdb\u884c":164,"\u4ee5\u53ca":[150,164],"\u4ee5\u53ca\u5404\u79cd\u6570\u636e\u6d41\u538b\u529b\u4e0b":145,"\u4ee5\u53ca\u5982\u4f55\u5229\u7528\u8f68\u8ff9\u6570\u636e\u6765\u66f4\u65b0\u5b66\u4e60\u76ee\u6807\u4e24\u4e2a\u90e8\u5206":196,"\u4ee5\u53ca\u5f53\u524d\u7684\u5956\u52b1\u6709\u5173":196,"\u4ee5\u53ca\u667a\u80fd\u4f53\u91c7\u53d6\u7684\u7b56\u7565":196,"\u4ee5\u53ca\u76f8\u5173\u6570\u636e\u5b57\u6bb5":142,"\u4ee5\u5b9e\u73b0\u5bf9":164,"\u4ee5\u5b9e\u73b0\u7cbe\u786e\u6355\u6349\u548c\u5904\u7406\u95ee\u9898":153,"\u4ee5\u786e\u4fdd\u5f53\u53d1\u751f\u8bef\u8fde\u7684\u65f6\u5019\u53ef\u4ee5\u7acb\u523b\u5f97\u5230\u53cd\u9988":153,"\u4ee5\u7ee7\u7eed\u8fd0\u884c":146,"\u4ee5\u8fbe\u5230\u5728\u4e00\u4e2a\u6bd4\u8f83\u957f\u671f\u7684\u65f6\u95f4\u6bb5\u5185\u5e73\u5747\u83b7\u5f97\u7684\u53cd\u9988\u6700\u597d":196,"\u4ee5\u8fdb\u7a0b\u95f4\u901a\u4fe1\u7684\u65b9\u5f0f\u5bf9\u73af\u5883\u8fdb\u884c\u7ba1\u7406\u548c\u8fd0\u884c":146,"\u4ee5\u907f\u514d\u6f5c\u5728\u7684\u7cfb\u7edf\u7ea7":168,"\u4ee5\u907f\u514d\u7cfb\u7edf\u4f7f\u7528\u9884\u671f\u5916\u7684\u8fd0\u7b97\u91cd\u8f7d":158,"\u4ee5\u9632\u5176\u4ed6\u540c\u4e8b\u8e29\u96f7":168,"\u4efb\u4f55\u4e00\u4e2a\u8f83\u5927\u7684\u4ee3\u7801\u6539\u52a8\u6216\u529f\u80fd\u66f4\u65b0":168,"\u4efb\u52a1":143,"\u4f18\u52bf\u66f4\u52a0\u660e\u663e":145,"\u4f18\u70b9":196,"\u4f1a":146,"\u4f1a\u4f18\u5148\u8c03\u7528":164,"\u4f1a\u5230\u4e0b\u4e00\u5c42\u7684":164,"\u4f1a\u53d1\u9001":156,"\u4f1a\u5728\u66f4\u4e0a\u4e00\u5c42\u53bb\u5bfb\u627e":164,"\u4f1a\u5728\u73af\u5883\u7ba1\u7406\u5668\u4e2d\u5f00\u542f":143,"\u4f1a\u5b58\u5728\u4e00\u5b9a\u7684\u6570\u503c\u7cbe\u5ea6\u6ce2\u52a8":150,"\u4f1a\u5bf9\u73b0\u6709\u5927\u91cf\u8282\u70b9\u8fdb\u884c\u8fde\u63a5":153,"\u4f1a\u88ab\u6807\u8bb0\u4e3a":146,"\u4f20\u5165":146,"\u4f20\u5165\u8bad\u7ec3\u6570\u636e":156,"\u4f20\u7edfdp\u7684\u4f5c\u7528\u6709\u9650":196,"\u4f20\u9012":158,"\u4f2a\u5e76\u884c":146,"\u4f46\u4f5c\u4e3a\u53c2\u6570\u4f20\u9012\u7ed9learner":156,"\u4f46\u5728\u5e76\u884cpipeline\u4e2d\u5e94\u5f53\u5b9e\u4f8b\u5316comm":156,"\u4f46\u57fa\u672c\u4e0d\u5f71\u54cd\u5e38\u89c4\u8bad\u7ec3":150,"\u4f46\u5982\u679c\u4f7f\u7528\u590d\u6570\u53ef\u4ee5\u4f7f\u67d0\u5c40\u90e8\u4ee3\u7801\u5757\u903b\u8f91\u66f4\u6e05\u6670":148,"\u4f46\u5bf9\u4e8e\u5e76\u884cpipeline\u6765\u8bf4":156,"\u4f46\u662f":168,"\u4f46\u662f\u5bf9\u4e8e\u5f3a\u5316\u5b66\u4e60\u95ee\u9898":196,"\u4f46\u662f\u6536\u655b\u901f\u5ea6\u4e0e\u7a33\u5b9a\u6027\u4e0d\u5982on":196,"\u4f46\u662fexploration\u592a\u591a":196,"\u4f46\u6ce8\u610f\u5fc5\u987b\u5305\u542b\u4e0a\u8ff0\u4e94\u4e2a\u5b57\u6bb5":148,"\u4f46\u8981\u6ce8\u610f":150,"\u4f46\u8fd8\u6709\u4e00\u4e9b\u95ee\u9898\u5c1a\u672a\u89e3\u51b3":156,"\u4f46learner\u7684\u521b\u5efa\u662f\u5728comm":156,"\u4f4d\u7f6e\u6dfb\u52a0\u4e86\u540d\u79f0\u4e3a":164,"\u4f4e\u81f31":145,"\u4f5c\u4e3a\u52a8\u4f5c":164,"\u4f7f\u5956\u52b1\u6700\u5927\u5316":196,"\u4f7f\u5f97\u4ee3\u7801\u66f4\u52a0\u4f18\u7f8e":158,"\u4f7f\u5f97\u5728\u957f":143,"\u4f7f\u5f97\u6536\u76ca\u6700\u5927":196,"\u4f7f\u5f97\u73af\u5883\u7684\u8c03\u7528\u66f4\u4e3a\u7b80\u5355\u6613\u61c2":148,"\u4f7f\u5f97\u7c7b\u53ef\u4ee5\u901a\u8fc7":153,"\u4f7f\u5f97\u8bad\u7ec3\u66f4\u52a0\u7a33\u5b9a":196,"\u4f7f\u73af\u5883\u53ef\u4ee5\u4fdd\u5b58\u8fd0\u884c\u8fc7\u7a0b\u4e3a\u89c6\u9891\u6587\u4ef6":148,"\u4f7f\u7528":[150,164,168],"\u4f7f\u7528\u53c2\u8003\u4e0b\u4e00\u8282":164,"\u4f7f\u7528\u5e76\u884c\u7684\u65b9\u5f0f\u8fd0\u884c\u591a\u4e2a\u73af\u5883\u7684\u7ba1\u7406\u5668":146,"\u4f7f\u7528\u5faa\u73af\u4e32\u884c\u7684\u65b9\u5f0f\u8fd0\u884c\u591a\u4e2a\u73af\u5883\u7684\u7ba1\u7406\u5668":146,"\u4f7f\u7528\u65b0\u7248\u672c\u65f6":150,"\u4f7f\u7528\u76f8\u540c\u7684\u8fdb\u7a0b\u6570":145,"\u4f7f\u7528\u8005\u53ef\u4ee5\u901a\u8fc7di":150,"\u4f7f\u7528\u88c5\u9970\u6a21\u5f0f\u5b9e\u73b0":148,"\u4f7f\u7528gpu\u8fdb\u884c\u6570\u636e\u63a8\u65ad":145,"\u4f7f\u7528shared_memory\u65f6":146,"\u4f8b\u5982":[148,150,158,164,168,196],"\u4f8b\u5982\u5728\u5904\u4e8e\u5171\u540c\u5185\u7f51\u7684100\u53f0gpu\u670d\u52a1\u5668\u4e0a\u8fd0\u884c\u4e00\u4e2a\u5177\u5907\u89c4\u6a21\u7684\u8bad\u7ec3\u4efb\u52a1":153,"\u4f8b\u5982\u5728\u81ea\u5df1\u7684\u5de5\u4f5c\u673a":153,"\u4f8b\u5982\u5728\u914d\u5907gpu\u7684\u9ad8\u914d\u5de5\u4f5c\u7ad9":153,"\u4f8b\u5982\u5f53\u6620\u5c04\u5173\u7cfb\u6709\u91cd\u53e0\u65f6":150,"\u4f8b\u5982\u6253\u5f00\u5176\u4ed6\u6a21\u62df\u5668\u5ba2\u6237\u7aef":148,"\u4f8b\u5982\u73af\u5883\u4e2d\u667a\u80fd\u4f53\u7684\u6570\u91cf":148,"\u4f8b\u5982\u8bad\u7ec3\u7684\u6a21\u578b\u6587\u4ef6":168,"\u4f8b\u5982\u8bbe\u7acbstart":153,"\u4f8b\u5982\u8fd0\u884c\u8be5\u76ee\u5f55\u4e0b\u7684test_ga":150,"\u4f8b\u5982dns\u6545\u969c":153,"\u4f9bloggedmodel\u4f7f\u7528":142,"\u4f9d\u636e\u4e0d\u540c\u7684":146,"\u4f9d\u636e\u9700\u6c42\u5b9e\u73b0\u5176\u4e2d\u7684":164,"\u4f9d\u636e\u9700\u6c42\u5b9e\u73b0\u6240\u9700\u8981\u7684":164,"\u4f9d\u6b21":168,"\u4f9d\u6b21\u6253\u5370\u51faforward\u65b9\u6cd5\u8c03\u7528\u60c5\u51b5":[164,165],"\u4f9d\u7136\u7531base":156,"\u4fbf\u4e8e\u4f7f\u7528\u8005\u5bf9\u6570\u636e\u6536\u96c6\u548c\u6027\u80fd\u8bc4\u6d4b\u8bbe\u7f6e\u4e0d\u540c\u7684\u73af\u5883\u53c2\u6570":148,"\u4fbf\u4e8e\u8c03\u8bd5\u548c\u53ef\u89c6\u5316":148,"\u4fbf\u53ef\u4ee5\u901a\u8fc7":164,"\u4fbf\u56de\u5230\u4e86\u6d41\u7a0b2":156,"\u4fbf\u56de\u5230\u4e86\u6d41\u7a0b3":156,"\u4fdd\u5b58\u6a21\u578b":156,"\u4fdd\u5b58\u6a21\u578b\u5230\u68c0\u67e5\u70b9":164,"\u4fdd\u62a4\u548c":146,"\u4fdd\u6301\u8ffd\u8e2a\u539f\u59cb\u4ee3\u7801\u5e93\u7684":168,"\u4fdd\u6301\u957f\u671f\u5f85\u673a\u72b6\u6001":153,"\u4fe1\u606f\u7684\u8bbf\u95ee\u96c6\u4e2d\u5728":148,"\u4fee\u6539\u4e4b\u540e\u7684\u5404\u4e2a":148,"\u4fee\u6539\u73b0\u6709\u4ee3\u7801":168,"\u500d\u5de6\u53f3":143,"\u503c\u4e3a":148,"\u503c\u51fd\u6570\u53ef\u4ee5\u5229\u7528\u52a8\u6001\u89c4\u5212\u7684\u65b9\u6cd5\u5f97\u5230":196,"\u503c\u51fd\u6570\u65e0\u6cd5\u7528\u4e00\u5f20\u8868\u683c\u6765\u8868\u793a":196,"\u503c\u5f97\u6ce8\u610f\u7684\u662f":153,"\u503c\u5f97\u6ce8\u610f\u7684\u6709\u4ee5\u4e0b\u51e0\u70b9":153,"\u505a\u4e86\u5c01\u88c5":164,"\u5143\u7d20\u7c7b\u8be6\u7ec6\u4fe1\u606f":148,"\u5148\u5b66\u4e60\u4e00\u4e2a\u73af\u5883\u6a21\u578b":196,"\u5148\u901a\u8fc7\u67d0\u79cd\u7b56\u7565\u91c7\u6837\u5927\u91cf\u7684\u6570\u636e":196,"\u5168\u79f0\u662f":150,"\u5173\u4e8e":148,"\u5173\u4e8echannel":153,"\u5173\u95ed\u73af\u5883":146,"\u5173\u95ed\u76f8\u5e94\u7684":168,"\u5173\u95edcomm":156,"\u5176\u4e2d":[143,145,148,158,196],"\u5176\u4e2d\u524d\u8005\u4ee3\u8868\u9759\u6001\u4e0d\u53d8\u7684\u4fe1\u606f":148,"\u5176\u4e2d\u5c31\u5305\u542b\u4e86learner\u8bf7\u6c42\u7684":156,"\u5176\u4e2d\u67d0\u4e9b\u952e\u503c\u5bf9\u4f1a\u6709\u76f8\u5173\u4f9d\u8d56\u8981\u6c42":148,"\u5176\u4e2d\u6bcf\u4e00\u4e2a\u8fed\u4ee3\u5728\u83b7\u53d6\u6570\u636e\u540e":156,"\u5176\u4ed6\u540c\u4e8b\u4e5f\u53ef\u4ee5\u5728\u8be5mr\u4e0bcomment":168,"\u5176\u4ee3\u7801\u5fc5\u987b\u662f\u786e\u4fdd\u80fd\u591f":168,"\u5176\u4f20\u8f93\u6027\u80fd\u548c\u7a33\u5b9a\u6027\u5fc5\u7136\u8d85\u8fc7\u57fa\u4e8ehttp\u670d\u52a1\u7684interact":153,"\u5176\u4f59\u4e94\u7ec4":143,"\u5176\u5177\u4f53\u542b\u4e49\u5982\u4e0b":146,"\u5176\u5185\u7f6e\u8fc7\u671f\u673a\u5236":142,"\u5176\u521d\u59cb\u5316\u65f6\u9700\u63d0\u4f9b\u6bcf\u4e2a":146,"\u5176\u57fa\u672c\u7528\u6cd5\u4e3a\u7ee7\u627floggedmodel\u7c7b":142,"\u5176\u6301\u6709\u4e00\u4e2abase":156,"\u5176\u672c\u8d28\u662f\u5229\u7528master":156,"\u5176\u6982\u5ff5\u7c7b\u4f3c\u4e8e\u65e0\u7ebf\u7535\u9891\u9053":153,"\u5176\u7528\u6765\u652f\u6491\u4e00\u4e2a\u65e5\u5fd7\u6a21\u578b\u7684\u8bb0\u5f55\u65b9\u5f0f":142,"\u5176\u952e\u6307\u5b9a\u4e86\u9700\u8981\u8fd0\u884c":146,"\u5176master\u4e3acoordinator\u4e2d\u7684\u53d8\u91cfmast":156,"\u5177\u4f53\u5173\u7cfb\u7528\u4e0b\u56fe\u5c31\u80fd\u5f88\u597d\u89e3\u91ca":196,"\u5177\u4f53\u539f\u56e0\u53ca\u89e3\u51b3\u65b9\u6cd5\u5982\u4e0b":139,"\u5177\u4f53\u539f\u56e0\u53ef\u53c2\u89c1":139,"\u5177\u4f53\u5982\u4e0b":[150,164],"\u5177\u4f53\u5b9e\u73b0":148,"\u5177\u4f53\u6765\u8bf4":[142,153],"\u5177\u4f53\u7684\u5f00\u53d1\u8005\u9700\u8981\u505a\u597d\u672c\u5730\u7684\u4ee3\u7801\u98ce\u683c\u68c0\u67e5\u548c\u5355\u5143\u6d4b\u8bd5":168,"\u5177\u4f53\u7ec6\u8282\u53ef\u4ee5\u53c2\u8003":168,"\u5185\u5bb9\u4e3a\u73af\u5883\u7684":146,"\u5185\u90e8":143,"\u518d\u5230\u6700\u540e\u65ad\u5f00\u8fde\u63a5\u7684\u8fc7\u7a0b":156,"\u518d\u5230coordinator\u542f\u52a8comm":156,"\u518d\u5b66\u4e60\u4e00\u4e2a\u6a21\u578b\u6765\u6700\u5c0f\u5316\u8bef\u5dee":196,"\u518d\u5c06\u5176\u79fb\u52a8\u56de\u6765":139,"\u518d\u66f4\u65b0\u7b56\u7565":196,"\u518d\u6839\u636e\u503c\u51fd\u6570\u6539\u8fdb\u7b56\u7565":196,"\u518d\u6839\u636e\u5b66\u4e60\u5230\u7684\u73af\u5883\u6a21\u578b\u505a\u503c\u51fd\u6570":196,"\u518d\u7531comm":156,"\u51b2\u7a81\u89e3\u51b3\u540e":168,"\u51b3\u5b9a\u4e86\u667a\u80fd\u4f53\u9762\u5bf9\u4e0d\u540c\u7684\u73af\u5883\u72b6\u6001\u65f6\u91c7\u53d6\u7684\u52a8\u4f5c":196,"\u51cf\u4e8c":158,"\u51fd\u6570":164,"\u51fd\u6570\u4e2d":142,"\u51fd\u6570\u4ee5\u660e\u786e\u8eab\u4efd":158,"\u51fd\u6570\u53ef\u4ee5\u5c06\u4efb\u610f\u7c7b\u578b":158,"\u51fd\u6570\u53ef\u4ee5\u5c06loader\u7c7b\u578b\u8f6c\u4e3anorm":158,"\u51fd\u6570\u5c31\u662f\u7531\u6b64\u88ab\u521b\u9020\u51fa\u6765\u7684":164,"\u51fd\u6570\u6216\u8005\u504f\u51fd\u6570":146,"\u5206\u4e3a\u591a\u4e2a\u5b50\u4efb\u52a1":145,"\u5206\u522b\u4e3a":[145,164],"\u5206\u522b\u4e3a\u4efb\u52a1\u4e0b\u8fbe\u7aef\u548c\u4efb\u52a1\u6267\u884c\u7aef":153,"\u5206\u522b\u662f":[145,164],"\u5206\u522b\u7b80\u5199\u4e3a":143,"\u5206\u652f":168,"\u5206\u652f\u7684":168,"\u5206\u652f\u7684\u7a33\u5b9a\u6027":168,"\u5207\u5fcc\u6ee5\u7528\u7ee7\u627f":153,"\u5217\u8868":168,"\u5217\u8868\u5143\u7ec4":158,"\u5219":[145,148],"\u5219\u4ee5json\u683c\u5f0f\u8fd4\u56de\u4e24\u8005\u7684\u548c":153,"\u5219\u4f1a\u6839\u636e\u4f18\u5148\u7ea7\u5927\u5c0f\u6765\u987a\u5e8f\u6267\u884c":[164,165],"\u5219\u5728\u8be5\u7ebf\u7a0b\u4e2d\u5c06\u6570\u636e\u4ece":145,"\u5219\u5c06\u65b0\u4efb\u52a1\u52a0\u5165\u4efb\u52a1\u961f\u5217":153,"\u5219\u6267\u884c\u4efb\u52a1":153,"\u5219\u6267\u884c\u5982\u4e0b\u7684\u547d\u4ee4\u5373\u53ef\u5220\u9664":150,"\u5219\u628a\u4ee3\u7801\u4ed3\u5e93\u521b\u5efa\u5728\u81ea\u5df1\u7684\u7528\u6237\u540d\u4e0b":168,"\u5219\u62d2\u7edd\u65b0\u4efb\u52a1\u8bf7\u6c42":153,"\u5219\u62d2\u7edd\u8be5\u4efb\u52a1\u8bf7\u6c42":153,"\u5219\u76f4\u63a5\u653e\u7f6e\u5728":145,"\u5219\u8868\u660e\u8d8b\u5411\u4e8e":196,"\u5219\u8be5\u8fdb\u7a0b\u8d1f\u8d23\u6267\u884c\u6240\u6709\u7684\u6570\u636e\u8bfb\u53d6\u4efb\u52a1":145,"\u5219\u8bf4\u660e\u5b89\u88c5\u6210\u529f":150,"\u521b\u5efa\u65b0\u4ee3\u7801\u4ed3\u5e93":168,"\u521b\u5efabase":156,"\u521d\u59cb\u5316":[146,148,156],"\u521d\u59cb\u5316\u4e86":146,"\u521d\u59cb\u5316\u4f60\u7684\u4ee3\u7801\u4ed3\u5e93":168,"\u521d\u59cb\u5316\u540e\u5e76\u4e0d\u4f1a\u7acb\u5373\u5b9e\u4f8b\u5316\u6bcf\u4e2a\u73af\u5883":146,"\u521d\u59cb\u5316\u5b50\u73af\u5883\u72b6\u6001\u7ba1\u7406\u6240\u9700\u7684\u8d44\u6e90":146,"\u521d\u59cb\u5316\u6240\u6709\u5b50\u73af\u5883":146,"\u521d\u59cb\u5316\u8fd0\u884c\u6bcf\u4e2a\u5b50\u73af\u5883\u7684\u8fdb\u7a0b":146,"\u5224\u65ad":145,"\u5224\u65ad\u662f\u5426\u4e3aint\u6784\u6210\u7684list":158,"\u5224\u65ad\u662f\u5426\u5305\u542b2":158,"\u5224\u65ad\u662f\u5426\u5927\u4e8e1\u4e14\u4e0d\u5927\u4e8e10":158,"\u5224\u65adx":158,"\u5229\u7528\u6570\u636e\u8bad\u7ec3\u8fd9\u4e00\u8fc7\u7a0b":156,"\u5229\u7528\u7b56\u7565\u68af\u5ea6\u8fdb\u884c\u7b56\u7565\u51fd\u6570\u53c2\u6570\u7684\u66f4\u65b0":196,"\u5229\u7528\u7ebf\u6027\u6216\u975e\u7ebf\u6027\u51fd\u6570\u5bf9\u7b56\u7565\u8fdb\u884c\u8868\u793a":196,"\u5229\u7528epsilon\u8d2a\u5a6a\u7b56\u7565\u91c7\u6837\u52a8\u4f5c":164,"\u5230\u4e8c\u8005\u5efa\u7acb\u901a\u4fe1\u8fde\u63a5":156,"\u5230\u5b9e\u9645\u4efb\u52a1\u5206\u914d\u4e0e\u6267\u884c":156,"\u5230\u5efa\u7acb\u8fde\u63a5":156,"\u5230\u6700\u7ec8\u4e8c\u8005\u5173\u95ed\u901a\u4fe1\u8fde\u63a5\u7684\u6d41\u7a0b":156,"\u524d":168,"\u524d\u8f93\u5165\u4e0a\u4e00\u6b21\u8fed\u4ee3\u7684\u8f93\u51fa\u9690\u72b6\u6001":164,"\u529f\u80fd\u4e0a\u4ee3\u66ff\u5e38\u89c1\u73af\u5883\u4e2d\u7684":148,"\u529f\u80fd\u540c\u4e0a\u8bf4\u660e":148,"\u52a0\u4e00":158,"\u52a0\u901f\u8fd0\u884c":146,"\u52a1\u5fc5":168,"\u52a8\u4f5c\u7a7a\u95f4\u4e00\u822c\u4e3a\u5b9e\u503c\u5411\u91cf\u533a\u95f4":196,"\u52a8\u4f5c\u7a7a\u95f4\u4e0e\u8fde\u7eed":196,"\u52a8\u4f5c\u7a7a\u95f4\u53c8\u5206\u4e3a\u79bb\u6563":196,"\u52a8\u6001\u89c4\u5212":196,"\u52a8\u6001\u8c03\u6574\u81ea\u5df1\u63a5\u4e0b\u6765\u7684\u52a8\u4f5c":196,"\u5305\u542b\u4ee5\u4e0b\u8fdb\u7a0b\u6216\u7ebf\u7a0b":145,"\u5305\u542b\u591a\u4e2a":145,"\u5305\u542b\u6b63\u5728\u8fd0\u884c\u5176\u4ed6\u547d\u4ee4\u6216\u5df2\u7ecf\u5b8c\u6210":146,"\u5305\u62ec\u6a21\u578b\u66f4\u65b0":156,"\u5305\u62ecnorm":158,"\u533a\u95f4\u9a8c\u8bc1":158,"\u534f\u4f5c\u5f00\u53d1\u6d41\u7a0b\u7684\u5efa\u8bae":168,"\u5355\u4f4d":[143,145],"\u5355\u4f4d\u4e3a\u6b21":142,"\u5355\u4f4d\u4e3a\u79d2":142,"\u5355\u673a\u5206\u5e03\u5f0f":153,"\u5355\u673a\u8f7b\u578b":153,"\u5373":[148,196],"\u537350\u6b21\u8fed\u4ee3":145,"\u5373\u4e0d\u4f7f\u7528\u591a\u8fdb\u7a0b":145,"\u5373\u4e3a":153,"\u5373\u4ee5\u6b21\u6570\u4e3a\u5355\u4f4d\u7684\u65f6\u95f4":142,"\u5373\u4f1a\u81ea\u52a8\u542f\u7528hpc_rl\u76f8\u5173\u7b97\u5b50":150,"\u5373\u5224\u65ad\u8fd0\u884c\u73af\u5883\u662f\u5426\u5df2\u521b\u5efa":148,"\u5373\u53ef\u4ece\u4e2d\u91c7\u6837\u51fa\u6837\u672c\u4ee5\u66f4\u65b0\u6a21\u578b\u53c2\u6570":196,"\u5373\u53ef\u5b8c\u6210\u8fde\u63a5":153,"\u5373\u53ef\u5f00\u59cb\u4ee3\u7801\u5f00\u53d1":168,"\u5373\u540c\u4e00\u65f6\u523b\u5404\u8fdb\u7a0b":145,"\u5373\u548c":145,"\u5373\u5728":156,"\u5373\u5728\u5355\u4e2a\u5177\u5907\u6216\u4e0d\u5177\u5907gpu\u7684\u666e\u901a\u8ba1\u7b97\u673a\u4e0a\u8fdb\u884c\u8bad\u7ec3\u4efb\u52a1":153,"\u5373\u5728\u5355\u4e2a\u7b97\u529b\u8f83\u9ad8\u7684\u8ba1\u7b97\u673a\u6216\u96c6\u7fa4\u4e0a\u8fdb\u884c\u8bad\u7ec3\u4efb\u52a1":153,"\u5373\u5728\u591a\u4e2a\u8ba1\u7b97\u8282\u70b9\u4e0a\u8fdb\u884c\u534f\u540c\u8bad\u7ec3\u4efb\u52a1":153,"\u5373\u5b9e\u9645\u4efb\u52a1\u7684\u5206\u914d\u4e0e\u6267\u884c\u8fc7\u7a0b":156,"\u5373\u5f53\u67d0\u4e2a\u73af\u5883\u8fd0\u884c\u81f3":146,"\u5373\u65f6\u523bt\u7684\u771f\u5b9e\u56de\u62a5":196,"\u5373\u751f\u6210\u7684\u6570\u636e":196,"\u5373\u7cfb\u7edf\u65f6\u95f4":142,"\u5373\u88c5\u9970\u5668":164,"\u5373\u8c03\u7528":146,"\u5373\u91cd\u5199\u8be5\u65b9\u6cd5":148,"\u5373\u91cd\u5199\u8be5\u65b9\u6cd5\u7b49\u4ef7\u4e8e\u8c03\u7528\u7236\u7c7b\u7684\u8be5\u65b9\u6cd5\u4ee5\u53ca\u5b9e\u73b0\u81ea\u8eab\u9700\u8981\u68c0\u67e5\u7684\u90e8\u5206":148,"\u5373float":158,"\u5373slave\u8282\u70b9":153,"\u539f\u8ba1\u5212\u7528\u4e8e\u914d\u7f6e\u6570\u636e\u7684\u8f6c\u5316\u4e0e\u9a8c\u8bc1":158,"\u53bb\u6389\u8be5\u9009\u9879\u91cd\u65b0\u5b89\u88c5\u5373\u53ef":139,"\u53bb\u8c03\u7528":164,"\u53c2\u6570\u5168\u90e8\u5b58\u5728":153,"\u53c2\u6570\u5316\u7684\u7b56\u7565\u51fd\u6570":196,"\u53c2\u6570\u5316\u884c\u4e3a\u4ef7\u503c\u51fd\u6570":196,"\u53c2\u6570\u5982\u4e0b\u8868":143,"\u53c2\u6570\u65f6":146,"\u53c2\u7167":145,"\u53ca\u6bcf\u4e00\u4e2a\u8fed\u4ee3\u524d\u540e\u6267\u884c\u4e00\u4e9b\u51fd\u6570":156,"\u53cd\u5411\u4f20\u64ad":150,"\u53cd\u590d\u91cd\u65b0\u5206\u914d\u5185\u5b58\u4f1a\u9020\u6210\u4e00\u5b9a\u7684\u65f6\u95f4\u635f\u8017":150,"\u53d1\u751f\u5f02\u5e38\u7684\u5b50\u73af\u5883":146,"\u53d1\u9001":[145,146],"\u53d1\u9001\u4efb\u52a1":156,"\u53d1\u9001\u7ed9\u667a\u80fd\u4f53\u6570\u636e\u7684\u5904\u7406\u51fd\u6570":148,"\u53d6\u503c\u60c5\u51b5":148,"\u53d6\u51fa\u8bad\u7ec3\u4fe1\u606f":156,"\u53d6\u540e45\u6b21\u7684\u5e73\u5747\u503c\u4f5c\u4e3a\u5355\u6b21\u5b9e\u9a8c\u7ed3\u679c":145,"\u53d6\u5f97\u4e86\u6bd4\u80a9\u4eba\u7c7b\u751a\u81f3\u8d85\u8d8a\u4eba\u7c7b\u7684\u6210\u5c31":196,"\u53d8\u57fa":168,"\u53e6\u4e00\u79cd\u57fa\u4e8e\u4ef7\u503c\u51fd\u6570\u7684\u65b9\u6cd5\u5219\u4e0d\u4e00\u5b9a\u9700\u8981\u7b56\u7565\u51fd\u6570":196,"\u53e6\u4e00\u79cd\u65b9\u6cd5\u5219\u662f\u76f4\u63a5\u8fdb\u884c\u7b56\u7565\u7a7a\u95f4\u4e0a\u7684\u641c\u7d22":196,"\u53e6\u4e00\u79cd\u662f\u901a\u8fc7\u5b66\u5230\u7684model\u76f4\u63a5\u4f18\u5316\u7b56\u7565":196,"\u53ea\u53ef\u4ee5\u4ece\u6709\u9650\u6570\u91cf\u7684\u52a8\u4f5c\u4e2d\u8fdb\u884c\u9009\u62e9":196,"\u53ea\u662f\u4e00\u5c42":148,"\u53ea\u6709\u5728\u4e00\u6bb5\u8f68\u8ff9\u8fc7\u540e\u624d\u4f1a\u83b7\u53d6\u5956\u52b1":196,"\u53ea\u8981\u7ed9":146,"\u53ea\u8bbe\u7f6e\u53c2\u6570":148,"\u53ea\u9700\u8981\u7ee7\u627fbasetime\u5e76\u5b9e\u73b0tim":142,"\u53ef\u4ee5":168,"\u53ef\u4ee5\u4ece":156,"\u53ef\u4ee5\u4f20\u5165":146,"\u53ef\u4ee5\u4f7f\u7528\u6570\u636e\u4eff\u771f\u548c\u91c7\u6837\u6a21\u578b":196,"\u53ef\u4ee5\u50cf\u539f\u672c\u7684":164,"\u53ef\u4ee5\u5229\u7528\u8499\u7279\u5361\u6d1b\u7684\u65b9\u6cd5\u6216\u8005\u65f6\u95f4\u5dee\u5206\u7684\u65b9\u6cd5\u5f97\u5230":196,"\u53ef\u4ee5\u52a0\u901f\u4f20\u9012\u73af\u5883\u8fd4\u56de\u7684\u5927\u5411\u91cf\u6570\u636e":146,"\u53ef\u4ee5\u53c2\u8003\u4ee5\u4e0b\u987a\u5e8f\u56fe\u5e2e\u52a9\u7406\u89e3":156,"\u53ef\u4ee5\u53d1\u73b0":143,"\u53ef\u4ee5\u5728\u672c\u5730\u5c06\u539f\u4ee3\u7801\u5e93\u6dfb\u52a0\u81f3":168,"\u53ef\u4ee5\u5728\u672c\u5730\u6309\u7167\u81ea\u5df1\u7684\u5de5\u4f5c\u8282\u594f":168,"\u53ef\u4ee5\u5927\u5927\u7b80\u5316":146,"\u53ef\u4ee5\u5b9e\u73b0\u591a\u4e2a":146,"\u53ef\u4ee5\u5bf9":164,"\u53ef\u4ee5\u5e2e\u52a9\u6211\u4eec\u89e3\u51b3\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u4e2d\u6837\u672c\u6548\u7387\u7684\u95ee\u9898":196,"\u53ef\u4ee5\u5f97\u5230\u6700\u4f18\u72b6\u6001\u503c\u51fd\u6570\u4e0e\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u7684\u8d1d\u5c14\u66fc\u65b9\u7a0b":196,"\u53ef\u4ee5\u6307\u5b9a\u662f\u5426\u4f7f\u7528shared_memori":139,"\u53ef\u4ee5\u6309\u7167\u5982\u4e0b\u89c4\u5219\u5f97\u5230\u65b0\u7684model":164,"\u53ef\u4ee5\u63a5\u6536\u8bad\u7ec3\u6570\u636e":156,"\u53ef\u4ee5\u65b9\u4fbf\u5730\u5bf9\u51fd\u6570\u7684\u8f93\u5165\u8f93\u51fa\u8fdb\u884c\u64cd\u4f5c":164,"\u53ef\u4ee5\u662f\u6240\u9700\u8981\u4f7f\u7528\u7684\u4efb\u4f55":164,"\u53ef\u4ee5\u770b\u5230\u8bad\u7ec3\u65f6\u95f4\u4ece9":150,"\u53ef\u4ee5\u7b80\u5316\u4e3a":158,"\u53ef\u4ee5\u7b80\u5355\u5730\u7406\u89e3\u4e3a":164,"\u53ef\u4ee5\u7ba1\u7406\u591a\u4e2a\u76f8\u540c\u7c7b\u578b\u4e0d\u540c\u914d\u7f6e\u7684\u73af\u5883":146,"\u53ef\u4ee5\u8003\u8651\u91cd\u7528":158,"\u53ef\u4ee5\u81ea\u5df1\u5b9a\u4e49time\u7c7b":142,"\u53ef\u4ee5\u89c6\u4e3a\u5bf9\u4e0d\u540c\u5177\u4f53\u4e1a\u52a1\u7684\u4e00\u79cd\u6807\u8bc6":153,"\u53ef\u4ee5\u8ba1\u7b97\u6700\u4f18\u7684\u7b56\u7565":196,"\u53ef\u4ee5\u901a\u8fc7":164,"\u53ef\u4ee5\u901a\u8fc7\u5728\u94a9\u5b50\u5185\u4f7f\u5f97\u5916\u90e8\u51fd\u6570\u5728\u88ab\u8c03\u7528\u7684\u65f6\u5019":164,"\u53ef\u4ee5\u901a\u8fc7\u5982\u4e0b\u65b9\u5f0f\u6765\u6784\u5efa\u5c5e\u4e8e\u81ea\u5df1\u7684":153,"\u53ef\u4ee5\u901a\u8fc7\u5982\u4e0b\u7684\u65b9\u5f0f\u6765\u6784\u5efa\u5c5e\u4e8e\u81ea\u5df1\u7684":153,"\u53ef\u4ee5\u901a\u8fc7\u8f93\u5165\u547d\u4ee4\u7684\u65b9\u5f0f\u624b\u52a8\u5173\u95edcomm":156,"\u53ef\u4ee5\u907f\u514d\u9677\u5165\u65e0\u9650\u5faa\u73af":196,"\u53ef\u4f7f\u7528":168,"\u53ef\u5728":146,"\u53ef\u5728\u5165\u53e3\u7a0b\u5e8f\u6700\u5f00\u59cb\u5904\u52a0\u4e0a\u4e00\u884c\u4ee3\u7801":150,"\u53ef\u80fd\u4f1a\u51fa\u73b0\u67d0\u4e9b\u4e0d\u5339\u914d\u95ee\u9898":150,"\u53ef\u80fd\u4f1a\u975e\u5e38\u5927":143,"\u53ef\u88ab\u4e32\u884cpipeline\u6216":156,"\u53ef\u88ab\u5e76\u884cpipeline\u8c03\u7528":156,"\u53ef\u9009\u7c7b\u578b":158,"\u53ef\u901a\u8fc7":[146,150],"\u5404\u72b6\u6001\u95f4\u7684\u8f6c\u6362\u5173\u7cfb\u5982\u56fe\u793a":146,"\u540c":146,"\u540c\u65f6\u6211\u4eec\u8fd8\u53d1\u73b0":145,"\u540c\u65f6\u65b0\u5f00\u4e00\u4e2a":168,"\u540c\u65f6\u6b22\u8fce\u9605\u8bfb\u6e90\u4ee3\u7801":153,"\u540c\u65f6\u83b7\u53d6\u73af\u5883\u4e2d\u7684\u4fe1\u606f":146,"\u540c\u65f6\u8c03\u7528\u5404\u5b50\u73af\u5883\u7684":146,"\u540c\u65f6\u8fd0\u884c":146,"\u540c\u6b65":156,"\u540c\u6b65\u4e0a\u6e38\u4ee3\u7801":168,"\u540c\u7ec4\u4ed3\u5e93\u63a8\u8350\u7528\u65b0\u5206\u652f":168,"\u540c\u7ec4\u6210\u5458\u4f1a\u76f4\u63a5\u6709\u8bbf\u95ee\u548c\u7f16\u8f91\u7684\u6743\u9650":168,"\u540d\u79f0":164,"\u540e":145,"\u540e\u4fdd\u5b58\u8be5\u6b21\u7684\u8f93\u51fa\u9690\u72b6\u6001\u4e3a\u4e0b\u4e00\u6b21\u505a\u51c6\u5907":164,"\u540e\u7eed\u4f1a\u8003\u8651\u8fdb\u4e00\u6b65\u4ecb\u7ecd":153,"\u540e\u8005\u8d1f\u8d23\u8fd0\u884c\u65f6\u53d8\u5316\u7684\u4fe1\u606f":148,"\u5426\u5219":145,"\u5426\u5219\u5373\u4f7f\u6570\u636e\u8bfb\u53d6\u8fde\u63a5\u5b8c\u6bd5":145,"\u5426\u5219\u5c06\u5176\u901a\u8fc7\u7ba1\u9053\u53d1\u56de\u7ed9":145,"\u5426\u5219\u5c06\u5bfc\u81f4\u65e0\u6cd5\u6b63\u5e38\u5efa\u7acb\u8fde\u63a5":153,"\u5426\u5219\u8fd4\u56de":146,"\u5426\u5219comm":156,"\u547d\u4ee4":146,"\u547d\u4ee4\u7684\u5b50\u73af\u5883":146,"\u548c":[143,146,147,148,153,164,168],"\u548c\u4e8b\u4ef6":153,"\u548c\u56de\u62a5\u8003\u8651\u5728\u5185\u7684\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u79f0\u4e3a\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"\u548c\u63d0\u4f9b\u53ef\u80fd\u7684\u591a\u6001\u673a\u5236":148,"\u548c\u6700\u65b0\u8fd4\u56de\u7684":146,"\u548c\u8fd4\u56de\u7684":146,"\u56db\u90e8\u5206":148,"\u56de\u8c03\u51fd\u6570":156,"\u56de\u8c03\u51fd\u6570\u7531comm":156,"\u56e0\u4e3a\u4f7f\u7528\u52a8\u6001\u89c4\u5212\u9700\u8981\u5b8c\u5907\u7684\u73af\u5883\u6a21\u578b":196,"\u56e0\u4e3a\u5355\u673a\u5206\u5e03\u5f0f\u73af\u5883\u4e0b\u5b8c\u5168\u53ef\u4ee5\u901a\u8fc7fork\u5f00\u542f\u5b50\u8fdb\u7a0b\u7684\u65b9\u5f0f\u542f\u52a8\u5404\u7aef":153,"\u56e0\u4e3a\u5728\u591a\u673a\u73af\u5883\u4e0b\u5f00\u542ffork\u6216\u8005\u57fa\u4e8e\u8fdc\u7a0b\u542f\u52a8\u6765\u542f\u52a8\u8bad\u7ec3\u4efb\u52a1\u662f\u4e0d\u73b0\u5b9e\u7684":153,"\u56e0\u4e3a\u5b58\u5728\u521b\u5efa\u6a21\u578b\u5b9e\u4f8b\u4f46\u4e0d\u8fd0\u884c\u7684\u4f7f\u7528\u573a\u666f":148,"\u56e0\u4e3a\u76ee\u524d\u4ec5\u652f\u6301\u90e8\u5206\u8fd0\u884c\u73af\u5883":150,"\u56e0\u4e3a\u8fd9\u4e24\u4e2a\u7b97\u6cd5\u4e0d\u9700\u8981\u7b97\u6cd5\u5efa\u6a21\u5177\u4f53\u73af\u5883":196,"\u56e0\u4e3a\u8fd9\u4f1a\u5bfc\u81f4master":153,"\u56e0\u6b64":[153,196],"\u56e0\u6b64\u5229\u7528\u7b56\u7565\u6570\u636e\u4e5f\u53ef\u4ee5\u5b66\u4e60\u5230\u73af\u5883\u7684\u4fe1\u606f":196,"\u56e0\u6b64\u53ef\u4ee5\u5b89\u5168\u5730\u7ee7\u7eed\u8c03\u7528\u8fd9\u4e9b\u5b50\u73af\u5883\u7684":146,"\u56e0\u6b64\u5f3a\u5316\u5b66\u4e60\u4e2d":196,"\u56e0\u6b64\u63d0\u51fa\u4e86\u57fa\u4e8e\u7b56\u7565\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5":196,"\u56e0\u6b64\u9700\u8981\u77e5\u9053\u6570\u636e\u7684\u5177\u4f53\u5c3a\u5bf8":150,"\u56e0\u6b64offlin":196,"\u56e0\u800c\u5fc5\u987b\u57fa\u4e8einteraction\u6784\u5efa\u670d\u52a1\u4f53\u7cfb":153,"\u56f4\u68cb":196,"\u5728":[148,150,153,156,164],"\u572860":145,"\u5728\u4e00\u4e9b\u5e38\u89c1\u7684\u5f3a\u5316\u5b66\u4e60\u4efb\u52a1\u4e2d":148,"\u5728\u4e00\u4e9b\u60c5\u51b5\u4e0b":196,"\u5728\u4e0a\u9762\u505a\u4fee\u6539":168,"\u5728\u4e0d\u540c\u8f93\u5165\u5c3a\u5bf8\u4e0b\u5747\u670910":150,"\u5728\u4e32\u884c\u4e0e\u5e76\u884c\u4e24\u4e2a\u7248\u672c\u4e2d":156,"\u5728\u4e86\u8fd9\u91cc":156,"\u5728\u4ecb\u7ecdflaskfilesystemlearner\u524d":156,"\u5728\u4ee5\u4e0a\u7684model":196,"\u5728\u4f7f\u7528":146,"\u5728\u4f7f\u7528fork\u65b9\u5f0f\u65f6":168,"\u5728\u503c\u51fd\u6570\u7684\u65b9\u6cd5\u4e2d":196,"\u5728\u5185\u90e8\u5b9a\u4e49loggedvalue\u7684descriptor":142,"\u5728\u521b\u5efa\u597d\u4ee3\u7801\u4ed3\u5e93\u5e76":168,"\u5728\u521d\u59cb\u5316":164,"\u5728\u533b\u7597":196,"\u5728\u5404\u79cd\u89c4\u6a21\u7684\u73af\u5883\u4e0b":145,"\u5728\u5b8c\u6210\u4e86\u5bf9\u73af\u5883\u7684\u5efa\u6a21\u540e":196,"\u5728\u5b8c\u6210\u53d1\u8d77\u7684":168,"\u5728\u5b9e\u4f8b\u5185\u90e8\u6839\u636e\u8bad\u7ec3batch\u6837\u672c\u6570\u7ef4\u62a4\u5bf9\u5e94\u7684\u9690\u72b6\u6001":164,"\u5728\u5b9e\u9645\u4f7f\u7528\u7684\u65f6\u5019\u8bf7":153,"\u5728\u5e76\u884c\u8bad\u7ec3\u6a21\u5f0f\u4e2d":156,"\u5728\u5f00\u59cb\u5199\u4ee3\u7801\u4e4b\u524d":168,"\u5728\u5f3a\u5316\u5b66\u4e60\u4e2d":196,"\u5728\u6211\u4eec\u7684autolog\u4e2d":142,"\u5728\u67d0\u4e2a\u4f4d\u7f6e\u63d2\u5165\u4e00\u4e2a\u65b0\u7684\u65b9\u6cd5":164,"\u5728\u6b64\u4f4d\u7f6e\u6ce8\u518c\u7684":164,"\u5728\u6b64\u60c5\u51b5\u4e0b":164,"\u5728\u72b6\u6001":196,"\u5728\u73b0\u5b9e\u5e94\u7528\u4e2d":196,"\u5728\u7a0b\u5e8f\u4e2d":164,"\u5728\u7ed9\u5b9a\u4e00\u4e2amdp\u5b8c\u5907\u73af\u5883\u7684\u60c5\u51b5\u4e0b":196,"\u5728\u7f16\u8f91":168,"\u5728\u8bad\u7ec3\u4efb\u52a1\u7684\u6bcf\u4e2a":164,"\u5728\u8bad\u7ec3\u7a0b\u5e8f\u8fd0\u884c\u4e4b\u524d\u8bfb\u53d6\u68c0\u67e5\u70b9":164,"\u5728\u8bad\u7ec3\u7a0b\u5e8f\u8fd0\u884c\u5b8c\u5168\u4e4b\u540e\u4fdd\u5b58\u6a21\u578b":164,"\u5728\u8c03\u7528\u8fc7":146,"\u5728\u8fd9\u6837\u7684\u4e00\u4e2ademo\u4e2d":142,"\u5728\u8fdb\u884c\u6bcf\u4e00\u4e2a":168,"\u5728\u914d\u7f6e\u6587\u4ef6\u7684env\u5b57\u6bb5\u6dfb\u52a0manager\u5b57\u6bb5":139,"\u5728\u957f":143,"\u5728\u9759\u6001\u73af\u5883\u5143\u7d20\u63a5\u53e3\u57fa\u7840\u4e0a":148,"\u5728__regist":142,"\u5728coordinator\u53d1\u6765\u4efb\u52a1\u4e4b\u524d":156,"\u5728di":[153,164],"\u5728model":196,"\u5728mr\u6216issue\u91cc\u63cf\u8ff0\u4ee3\u7801\u6539\u52a8\u5bf9\u5e94\u7684\u5de5\u4f5c\u5185\u5bb9":168,"\u5728python\u7ec8\u7aef\u4e2d\u5982\u679c\u53ef\u4ee5\u6210\u529f":150,"\u5728qbert\u4e0a\u4f7f\u7528dqn\u7b97\u6cd5\u65f6":150,"\u5747\u5feb\u4e8e":143,"\u5747\u662f\u6765\u81ea":146,"\u5747\u7ee7\u627f\u81eabasetime\u7c7b":142,"\u5757":145,"\u57fa\u4e8e":153,"\u57fa\u4e8e\u4ef7\u503c\u51fd\u6570":196,"\u57fa\u4e8e\u8fd9\u4e2a\u6846\u67b6\u4e0b\u7684\u5404\u79cd\u7b97\u6cd5":196,"\u57fa\u4e8e\u9519\u8bef\u4ee3\u7801":153,"\u57fa\u672c\u4f7f\u7528\u65b9\u6cd5\u7684\u5c0f\u4f19\u4f34\u4eec\u4e00\u4e9b\u89c4\u8303":168,"\u57fa\u7840\u7ec4\u4ef6":158,"\u57fa\u7c7b\u5b9a\u4e49":156,"\u5904\u7406":168,"\u5904\u7406\u6210learner\u9700\u8981\u7684\u683c\u5f0f":156,"\u5904\u7406\u6570\u636e\u7684\u65f6\u95f4":145,"\u5904\u7406master\u53d1\u6765\u7684task":156,"\u5904\u7684\u671f\u671b\u503c":196,"\u5904\u83b7\u53d6\u5230\u6570\u636e\u6216\u6570\u636e\u4efb\u52a1":145,"\u590d\u6742\u73af\u5883\u6216\u5927\u6570\u91cf\u73af\u5883\u7684\u8fd0\u884c\u63a8\u8350\u91c7\u7528":146,"\u5916\u754c\u8bbe\u5b9a\u7684\u662f\u79cd\u5b50\u7684\u79cd\u5b50":148,"\u591a\u673a\u89c4\u6a21\u5316\u5206\u5e03\u5f0f":153,"\u591a\u8fdb\u7a0b":145,"\u591a\u8fdb\u7a0bmultiprocessing\u542f\u52a8\u7684\u4e0a\u4e0b\u6587":139,"\u5927\u5927\u7f29\u77ed\u4e86":145,"\u5956\u52b1\u51fd\u6570\u4e5f\u4f1a\u53d1\u751f\u53d8\u5316":196,"\u5956\u52b1\u51fd\u6570\u7531\u5f53\u524d\u7684\u72b6\u6001\u4e0e\u667a\u80fd\u4f53\u7684\u52a8\u4f5c\u51b3\u5b9a":196,"\u5982":139,"\u5982\u4f55\u4e0e\u5916\u754c\u901a\u4fe1\u7b49\u7b49":156,"\u5982\u52a0\u8f7d\u6a21\u578b":156,"\u5982\u5728atari\u6e38\u620f\u4e0esmac\u661f\u9645\u6e38\u620f\u4e2d\u4e3a\u79bb\u6563\u7684\u52a8\u4f5c\u7a7a\u95f4":196,"\u5982\u5b89\u88c5\u76ee\u5f55\u5728":150,"\u5982\u6570\u636e\u600e\u4e48\u83b7\u5f97":156,"\u5982\u65e0\u7279\u6b8a\u9700\u6c42\u53ef\u4ee5\u76f4\u63a5\u8c03\u7528":148,"\u5982\u6709\u9700\u8981":142,"\u5982\u679c":153,"\u5982\u679c\u4e0d\u52a0\u8fd8\u539f\u7684\u6548\u679c":158,"\u5982\u679c\u4e3a\u771f":148,"\u5982\u679c\u4f60\u8fd8\u4e0d\u719f\u6089":168,"\u5982\u679c\u4f7f\u7528\u8005\u4f9d\u7136\u60f3\u8981\u5728":148,"\u5982\u679c\u540c\u4e00\u4f4d\u7f6e\u88ab\u6ce8\u518c\u4e86\u591a\u4e2ahook":[164,165],"\u5982\u679c\u5728\u5f53\u524d\u5c42\u6ca1\u6709\u627e\u5230\u5bf9\u5e94\u7684\u51fd\u6570\u65b9\u6cd5":164,"\u5982\u679c\u5bf9":146,"\u5982\u679c\u5c06\u6a21\u578b\u7684\u521b\u5efa\u653e\u5728":148,"\u5982\u679c\u6211\u4eec\u53ef\u4ee5\u8ba1\u7b97\u51fa\u6bcf\u4e2a\u72b6\u6001\u6216\u8005\u91c7\u53d6\u67d0\u4e2a\u884c\u52a8\u4e4b\u540e\u6536\u76ca":196,"\u5982\u679c\u662f\u4fee\u590d":168,"\u5982\u679c\u662f\u53ef\u53d8\u8f93\u5165\u5c3a\u5bf8":150,"\u5982\u679c\u662f\u6253\u7b97\u6dfb\u52a0\u65b0\u529f\u80fd":168,"\u5982\u679c\u662f\u81ea\u5b9a\u4e49\u7684":164,"\u5982\u679c\u662f\u81ea\u5df1\u5f00\u53d1\u4f7f\u7528":168,"\u5982\u679c\u6709\u5219\u76f4\u63a5reset\u5df2\u6709\u73af\u5883":148,"\u5982\u679c\u6b63\u5728\u6267\u884c\u7684\u4efb\u52a1\u5df2\u7ecf\u8fbe\u5230\u6700\u5927\u6570\u91cf":153,"\u5982\u679c\u6ca1\u6709\u5219\u8fdb\u884c\u521b\u5efa\u518dreset":148,"\u5982\u679c\u6ca1\u6709\u5b9a\u4e49\u7684\u8bdd":164,"\u5982\u679c\u7528\u6237\u9700\u8981\u6dfb\u52a0\u65b0\u7684":148,"\u5982\u679c\u8981\u4e3amaster\u505a\u66f4\u591a\u529f\u80fd\u62d3\u5c55\u7684\u8bdd":153,"\u5982\u679c\u8981\u5f15\u5165\u8fd9\u4e9b\u6587\u4ef6":168,"\u5982\u679c\u9700\u8981\u4fee\u6539\u7684\u8bdd":164,"\u5982\u679c\u9700\u8981\u81ea\u5b9a\u4e49":148,"\u5982\u679cexploitation\u592a\u591a":196,"\u5982\u679cslave\u7aef\u7a7a\u95f2":153,"\u5982\u6b64\u4e00\u6765":164,"\u5982\u72b6\u6001\u7a7a\u95f4\u6216\u52a8\u4f5c\u7a7a\u95f4\u4e0d\u4e3a\u79bb\u6563\u7a7a\u95f4\u65f6":196,"\u5982\u7a00\u758f\u5956\u52b1":196,"\u5982\u8981\u4f7f\u7528\u5219\u5fc5\u987b\u6309\u7167":148,"\u5982\u9ad8\u65af":164,"\u5b50\u73af\u5883":146,"\u5b50\u7c7b\u53ef\u4ee5\u62d3\u5c55\u8be5\u65b9\u6cd5":148,"\u5b50\u7c7b\u53ef\u4ee5\u81ea\u5b9a\u4e49\u81ea\u5df1\u7684\u8be5\u53d8\u91cf":148,"\u5b50\u7c7b\u5fc5\u987b\u91cd\u5199\u5b9e\u73b0\u8be5\u65b9\u6cd5":156,"\u5b50\u7c7b\u9700\u7ee7\u627f\u91cd\u5199\u65b9\u6cd5":[148,156],"\u5b50\u8fdb\u7a0b\u4e4b\u95f4\u901a\u4fe1\u7684\u7b49\u5f85\u65f6\u95f4":146,"\u5b50\u8fdb\u7a0b\u95f4\u901a\u4fe1\u7684\u6700\u5927\u7b49\u5f85\u65f6\u95f4":146,"\u5b57\u5178":146,"\u5b57\u5178\u6620\u5c04":158,"\u5b57\u6bb5":158,"\u5b57\u6bb5\u6709\u4e00\u4e9b\u4f9d\u8d56\u5173\u7cfb":148,"\u5b57\u7b26\u4e32\u679a\u4e3e\u9a8c\u8bc1":158,"\u5b58\u5165":146,"\u5b58\u5728\u4f9d\u8d56\u4e8e\u51fd\u6570\u903c\u8fd1\u8d28\u91cf\u7684\u504f\u5dee":196,"\u5b58\u5728\u53c2\u6570\u590d\u6742":164,"\u5b83\u4ece":156,"\u5b89\u6392\u5e76\u8fd0\u884c\u8bad\u7ec3\u4efb\u52a1":153,"\u5b89\u88c5":150,"\u5b89\u88c5\u5728\u7528\u6237\u76ee\u5f55\u4e0b":139,"\u5b89\u88c5\u6210\u529f\u540e":150,"\u5b8c\u5168\u4e00\u81f4":164,"\u5b8c\u6210\u4e00\u4e2a\u65f6\u95f4\u6b65":146,"\u5b8c\u6210\u4e86":146,"\u5b8c\u6210\u540e":156,"\u5b8c\u6210\u5efa\u7acblearner\u7684\u5de5\u4f5c":156,"\u5b8c\u6210\u65b0\u7684\u8bad\u7ec3\u5de5\u4f5c":156,"\u5b8c\u6210\u672c\u5730\u5f00\u53d1\u4e4b\u540e":168,"\u5b98\u65b9\u7684\u63a8\u8350\u6559\u7a0b":168,"\u5b9a\u4e49":[146,148,196],"\u5b9a\u4e49\u4e00\u4e2a\u73af\u5883\u9700\u8981\u4ece\u73af\u5883\u7684\u8f93\u5165\u8f93\u51fa\u5165\u624b":148,"\u5b9a\u4e49\u4e86\u56db\u4e2a\u4f4d\u7f6e":164,"\u5b9a\u4e49\u4e86\u73af\u5883\u6bcf\u8fd0\u884c\u4e00\u6b65\u8fd4\u56de\u7684\u5185\u5bb9":148,"\u5b9a\u4e49\u4e86\u73af\u5883\u7684\u57fa\u672c\u4fe1\u606f":148,"\u5b9a\u4e49\u5982\u4e0b":153,"\u5b9a\u4e49\u81ea\u5df1\u7684":164,"\u5b9a\u65f6\u5c06\u5f53\u524d\u7b56\u7565\u53ca\u8bad\u7ec3\u4fe1\u606f\u53d1\u9001\u51fa\u53bb":156,"\u5b9e\u4f8b":146,"\u5b9e\u4f8b\u5316\u4e86\u5b50\u73af\u5883":146,"\u5b9e\u4f8b\u5316\u8c03\u7528\u63a5\u53e3":146,"\u5b9e\u4f8b\u5982\u4e0b":168,"\u5b9e\u578b":142,"\u5b9e\u73b0":148,"\u5b9e\u73b0\u5355\u4f8b\u6a21\u578b\u6240\u7528\u7684\u7c7b\u53d8\u91cf":148,"\u5b9e\u73b0\u5373\u53ef":148,"\u5b9e\u73b0\u7684":145,"\u5b9e\u73b0\u81ea\u8eab\u9700\u8981\u68c0\u67e5\u7684\u90e8\u5206":148,"\u5b9e\u9645\u4e0a\u5bf9\u4e8e\u5355\u673a\u8f7b\u578b\u6765\u8bf4":153,"\u5b9e\u9645\u4e0a\u5c31\u662f":164,"\u5b9e\u9645\u4e0a\u64cd\u4f5c\u4e2d":158,"\u5b9e\u9645\u4e0a\u6839\u636e\u76ee\u524d\u7684\u521d\u6b65\u8c03\u7814":153,"\u5b9e\u9645\u4e0a\u7684\u521d\u59cb\u5316\u65b9\u6cd5":148,"\u5b9e\u9645\u4f7f\u7528\u65f6\u8c03\u7528\u9759\u6001\u5143\u7d20\u7684\u76f8\u5e94\u65b9\u6cd5":148,"\u5b9e\u9a8c\u4e2d":145,"\u5b9e\u9a8c\u51c6\u5907":[143,145],"\u5b9e\u9a8c\u5f00\u59cb\u524d\u8dd1\u4e86\u4e00\u4e2a\u7eaf":143,"\u5b9e\u9a8c\u7ed3\u679c":[143,145],"\u5b9e\u9a8c\u91cd\u590d10\u6b21\u53d6\u5e73\u5747\u503c":145,"\u5bb9\u6613\u51fa\u73b0\u7ef4\u5ea6\u707e\u96be\u95ee\u9898":196,"\u5bb9\u6613\u5b66\u4e60\u5230\u5c40\u90e8\u6700\u4f18\u89e3":196,"\u5bf9":146,"\u5bf9\u4e8e":[156,164],"\u5bf9\u4e8e\u4e00\u4e2a\u73af\u5883\u7684\u5177\u4f53\u521b\u5efa":148,"\u5bf9\u4e8e\u4e00\u6bb5\u5c01\u88c5\u5f97\u8f83\u597d\u7684\u4ee3\u7801":164,"\u5bf9\u4e8e\u4f7f\u7528":164,"\u5bf9\u4e8e\u5355\u673a\u5206\u5e03\u5f0f\u800c\u8a00":153,"\u5bf9\u4e8e\u53c2\u6570":143,"\u5bf9\u4e8e\u5404\u7c7b\u7b97\u5b50":150,"\u5bf9\u4e8e\u6a21\u578b\u5df2\u77e5\u7684\u7cfb\u7edf":196,"\u5bf9\u4e8e\u6a21\u578b\u672a\u77e5\u7684\u7cfb\u7edf":196,"\u5bf9\u4e8e\u73af\u5883\u5185\u5404\u79cd\u5904\u7406\u51fd\u6570\u548c":148,"\u5bf9\u4e8e\u73af\u5883\u7ba1\u7406\u5668\u7684\u53c2\u6570":143,"\u5bf9\u4e8e\u73af\u5883\u8fd4\u56de\u7684":148,"\u5bf9\u4e8e\u7528\u6237\u81ea\u5b9a\u4e49\u7684":164,"\u5bf9\u4e8e\u8868\u683c\u578b\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5":196,"\u5bf9\u4e8e\u8be5\u4fe1\u606f\u7684\u5185\u5bb9\u6709":156,"\u5bf9\u4e8e\u8fd0\u884cdi":139,"\u5bf9\u4e8e\u90e8\u5206\u7b97\u5b50":150,"\u5bf9\u4e8einteraction\u800c\u8a00":153,"\u5bf9\u51fd\u6570\u8fdb\u884c\u5305\u88c5":164,"\u5bf9\u5956\u52b1\u51fd\u6570\u7684\u8bbe\u8ba1\u4e0e\u52a0\u5de5\u4e5f\u662f\u4e00\u4e2a\u91cd\u8981\u7684\u65b9\u5411":196,"\u5bf9\u5e94\u7684\u5f00\u53d1\u4efb\u52a1\u65f6":168,"\u5bf9\u5e94\u7684gitlab\u7f51\u9875\u4e0a\u76f4\u63a5\u8fdb\u884c\u64cd\u4f5c":168,"\u5bf9\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u6548\u679c\u6709\u5f88\u5927\u7684\u5f71\u54cd":196,"\u5bf9\u671f\u671b\u6536\u76ca":196,"\u5bf9\u672a\u6765\u7684\u4fe1\u5fc3":196,"\u5bf9\u67d0\u51e0\u4e2a\u73af\u5883\u8fdb\u884c\u64cd\u4f5c":146,"\u5bf9\u6bd4":143,"\u5bf9\u73b0\u6709\u4ee3\u7801\u7684\u4fee\u6539":168,"\u5bf9\u81ea\u5b9a\u4e49\u7684":164,"\u5bf9\u8c61":148,"\u5bf9\u8f93\u5165\u53c2\u6570\u505a\u5fc5\u8981\u7684":148,"\u5bf9\u8f93\u51fa":148,"\u5bf9\u9759\u6001\u5904\u7406\u51fd\u6570\u8fd4\u56de\u7684\u7ed3\u679c\u8fdb\u884c\u518d\u52a0\u5de5":148,"\u5bfb\u627e\u6700\u4f18\u7684\u53c2\u6570\u4f7f\u5f97\u5f3a\u5316\u5b66\u4e60\u7684\u76ee\u6807":196,"\u5bfb\u627e\u6700\u4f18\u7b56\u7565":196,"\u5c06":[145,146,164],"\u5c06\u4ed3\u5e93\u6839\u76ee\u5f55\u4e0b\u7684":139,"\u5c06\u52a8\u4f5c":196,"\u5c06\u6240\u6709\u7684":143,"\u5c06\u6536\u5230\u7684\u6570\u636e\u4fe1\u606f\u653e\u5165":156,"\u5c06\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u6839\u636e":145,"\u5c06\u65f6\u95f4\u7a97\u53e3\u5185\u7684\u6570\u636e\u53ca\u5176\u53d8\u5316\u60c5\u51b5\u8fdb\u884c\u4e86\u5b8c\u6574\u7684\u8bb0\u5f55":142,"\u5c06\u73af\u5883\u8fd0\u884c\u8d77\u6765":146,"\u5c06\u7b56\u7565\u5b58\u50a8\u6216\u53d1\u9001":156,"\u5c06\u81ea\u5df1\u7684\u56db\u4e2a\u51fd\u6570\u4f5c\u4e3a\u56de\u8c03\u51fd\u6570\u4f20\u7ed9learner":156,"\u5c06\u8bad\u7ec3\u4fe1\u606f\u5b58\u50a8\u6216\u53d1\u9001":156,"\u5c06master":153,"\u5c1a\u672a\u5b9e\u4f8b\u5316\u5b50\u73af\u5883":146,"\u5c1a\u672a\u8fdb\u884c":146,"\u5c24\u5176\u6307\u6570\u5b66\u8ba1\u7b97\u903b\u8f91\u7684\u6784\u5efa":158,"\u5c31\u4e0d\u4f1a\u51fa\u73b0\u4e3a\u5b50\u73af\u5883\u91cd\u590d\u53d1\u9001\u547d\u4ee4\u7684\u60c5\u51b5":146,"\u5c31\u4f1a\u63a5\u6536\u5230\u8be5\u4efb\u52a1":156,"\u5c31\u53ef\u4ee5\u88ab\u6d3e\u4e0a\u7528\u573a":164,"\u5c31\u662f\u5c06\u7cfb\u7edf\u63a2\u7d22\u73af\u5883\u83b7\u5f97\u7684\u6837\u672c\u4fdd\u5b58\u8d77\u6765":196,"\u5c31\u88ab":156,"\u5c3d\u91cf\u4fdd\u8bc1\u6bcf\u4e2acommit\u53ea\u5bf9\u5e94\u4e00\u79cd\u76f8\u5173\u7684\u4ee3\u7801\u6539\u52a8":168,"\u5c5e\u6027\u4e2d":146,"\u5c5e\u6027\u4f1a\u7b49\u5f85\u81f3\u5c11\u4e00\u4e2a\u5b50\u73af\u5883\u5b8c\u6210\u8fd0\u884c":146,"\u5c5e\u6027\u83b7\u5f97\u5f53\u524d\u8fd0\u884c\u5b8c\u6210":146,"\u5c5e\u6027\u8fd4\u56de\u4e00\u4e2a\u5b57\u5178":146,"\u5c5e\u6027\u8fd4\u56de\u7684":146,"\u5c5e\u6027\u8fd4\u56de\u7684\u73af\u5883":146,"\u5de6\u53f3":143,"\u5df2\u7ecf\u5b9a\u4e49\u597d\u7684":164,"\u5df2\u7ecf\u5b9e\u73b0\u4e86\u8bb8\u591a\u5e38\u7528\u7684":164,"\u5e38\u89c1\u7684slurm\u96c6\u7fa4\u7b49\u73af\u5883\u4e0a\u8fd0\u884c\u4e00\u822c\u7684\u8bad\u7ec3\u4efb\u52a1":153,"\u5e38\u91cf":158,"\u5e38\u9a7b":156,"\u5e76\u4e0d\u662f\u6bcf\u4e00\u4e2a\u72b6\u6001\u4e0b\u73af\u5883\u90fd\u4f1a\u7ed9\u4e88\u53cd\u9988":196,"\u5e76\u4e0e":143,"\u5e76\u4e0e\u73af\u5883\u4ea7\u751f\u4ea4\u4e92":148,"\u5e76\u4e14":153,"\u5e76\u4e14\u53ef\u4ee5\u53ea\u8bc4\u4f30\u5173\u6ce8\u7684\u67d0\u4e2a\u72b6\u6001":196,"\u5e76\u4e14\u53ef\u4f9b\u8bbf\u95ee":142,"\u5e76\u4e14\u5b9e\u9645\u4e0a\u5728\u8fd9\u6837\u7684\u73af\u5883\u4e0b":153,"\u5e76\u4e14\u5f71\u54cd\u5176\u5185\u90e8\u7684\u903b\u8f91\u4e0e\u6570\u636e\u7ea6\u675f":153,"\u5e76\u4e14\u63d0\u4f9b\u4e0e":146,"\u5e76\u4e14\u7ed3\u5408\u4f20\u5165\u7684\u65f6\u95f4\u5bf9\u8c61\u8fdb\u884c\u8bb0\u5f55":142,"\u5e76\u4e3a\u5176\u89e3\u51b3\u6d89\u53ca\u901a\u4fe1\u7684\u95ee\u9898":156,"\u5e76\u5145\u5206\u8003\u8651\u5176\u4e2d\u53ef\u80fd\u7684":148,"\u5e76\u5229\u7528\u73af\u5883\u6a21\u578b\u6765\u8fdb\u884c\u5b66\u4e60":196,"\u5e76\u5229\u7528flaskfilesystemlearner\u4f20\u6765\u7684\u56de\u8c03\u51fd\u6570\u54cd\u5e94\u76f8\u5e94\u7684task":156,"\u5e76\u5355\u72ec\u7528\u4e00\u4e2a":168,"\u5e76\u5728\u5176\u57fa\u7840\u4e0a\u589e\u52a0\u4e86\u4e00\u7cfb\u5217\u66f4\u4e3a\u65b9\u4fbf\u7684\u529f\u80fd":148,"\u5e76\u5728\u8fd0\u884c\u7ed3\u675f\u65f6\u8fd4\u56de":146,"\u5e76\u5b58\u50a8\u5728":145,"\u5e76\u5b9e\u73b0":156,"\u5e76\u5b9e\u73b0\u4e86":148,"\u5e76\u5c06\u5176\u53d1\u9001\u7ed9":145,"\u5e76\u5c06\u5176\u901a\u8fc7learner":156,"\u5e76\u5c06\u5176\u952e\u503c\u4f5c\u4e3a\u5b50\u73af\u5883":146,"\u5e76\u5c06\u8bfb\u53d6\u5230\u7684\u6570\u636e\u653e\u7f6e\u5728":145,"\u5e76\u63d0\u4f9b\u4e86\u7b80\u5355\u7684\u8c03\u7528\u65b9\u6cd5":164,"\u5e76\u653e\u7f6e\u5728":145,"\u5e76\u663e\u793a\u542f\u7528\u7684":148,"\u5e76\u6709\u4e13\u4eba\u5bf9\u8fd9\u4e9b\u7b97\u529b\u8fdb\u884c\u7ef4\u62a4":153,"\u5e76\u6839\u636e\u52a8\u4f5c\u6240\u8fd4\u56de\u7684\u4e0d\u540c\u7c7b\u578b\u7684\u73af\u5883\u53cd\u9988":196,"\u5e76\u6ce8\u518c\u4e00\u4e9b\u7edf\u8ba1\u65b9\u6cd5":142,"\u5e76\u7b49\u5f85learner\u7ed3\u675f\u8bad\u7ec3":156,"\u5e76\u7ed9\u4e88\u667a\u80fd\u4f53\u52a8\u4f5c\u7684\u53cd\u9988\u5956\u52b1":196,"\u5e76\u884c\u6a21\u5f0f\u4e2d\u7684\u8bad\u7ec3\u6d41\u7a0b\u89e3\u6790":156,"\u5e76\u884c\u6a21\u5f0f\u7531\u4e8e\u6d89\u53ca\u5230\u5f02\u6b65\u8fd0\u884c\u7684learner":156,"\u5e76\u884cpipelin":156,"\u5e76\u884cpipeline\u4f1a\u521b\u5efacomm":156,"\u5e76\u8c03\u7528":156,"\u5e76\u8fd4\u56de":146,"\u5e76\u8fd4\u56de\u5176":146,"\u5e76\u8fd4\u56de\u6b64":148,"\u5e76\u8fd4\u56de\u7ed3\u679c\u6216\u629b\u51fa\u5f02\u5e38":146,"\u5e76\u8fd4\u56de\u7ed9coordin":156,"\u5e76\u901a\u8fc7\u5efa\u7acb\u7684\u8fde\u63a5\u5bf9slave\u8fdb\u884c\u4efb\u52a1\u7684\u4e0b\u8fbe\u548c\u63a5\u6536":153,"\u5e76\u901a\u8fc7\u8fd4\u56de\u503c\u4ee5\u53ca\u5f02\u5e38\u629b\u51fa\u6765\u8fdb\u884c\u6d88\u606f\u56de\u4f20":153,"\u5e76\u901a\u8fc7\u8fdb\u7a0b\u9501":153,"\u5e93\u7684\u4e00\u4e9b":164,"\u5e94\u5bf9\u8d8a\u6765\u8d8a\u5bc6\u96c6\u7684\u6570\u636e\u9700\u6c42\u7684\u80fd\u529b":145,"\u5e94\u8be5\u7279\u522b\u6ce8\u610f\u7684\u70b9":168,"\u5ed6\u7684\u6559\u7a0b\u65b9\u4fbf\u4e00\u5c0f\u65f6\u5165\u95e8":168,"\u5ed6\u96ea\u5cf0\u7684":168,"\u5ef6\u4f38\u51fa\u4e0d\u540c\u7684\u7b97\u6cd5":196,"\u5efa\u7acb\u901a\u4fe1\u7ba1\u9053":146,"\u5efa\u8bae\u4e0e\u7279\u5b9a\u73af\u5883\u5143\u7d20\u76f8\u5173\u7684\u72b6\u6001\u53d8\u91cf\u4e00\u5f8b\u653e\u5728\u8fd9\u91cc\u7ef4\u62a4":148,"\u5efa\u8bae\u5148\u67e5\u9605":146,"\u5efa\u8bae\u5220\u9664\u8001\u7248\u672c\u540e\u91cd\u65b0\u5b89\u88c5\u65b0\u7248\u672c":150,"\u5efa\u8bae\u5bf9\u4e8e\u7279\u5b9a\u7684\u4e1a\u52a1\u8bbe\u5b9a\u7279\u5b9a\u7684channel\u503c":153,"\u5efa\u8bae\u6839\u636e\u4e0d\u540c\u7684\u4e1a\u52a1\u5f02\u5e38\u7c7b\u578b\u4f7f\u7528\u5bf9\u5e94\u7684\u5f02\u5e38\u7c7b":153,"\u5efa\u8bae\u73b0\u5728":168,"\u5efa\u8bae\u7c7b\u672c\u8eab\u4e5f\u5bf9\u751f\u547d\u5468\u671f\u8fdb\u884c\u59a5\u5584\u7ba1\u7406":153,"\u5efa\u8bae\u8bbf\u95ee\u4fe1\u606f\u901a\u8fc7":148,"\u5efa\u8baefork\u51fa\u4e00\u4e2a\u65b0\u4ee3\u7801\u4ed3\u5e93\u81f3\u81ea\u5df1\u7684\u7528\u6237\u540d\u4e0b":168,"\u5f00\u53d1\u5b8c\u6210\u540e\u65e0\u7528\u7684\u5206\u652f\u8bf7\u5728\u8fdc\u7a0b\u4ed3\u5e93\u4e2d\u5220\u9664":168,"\u5f00\u542fcomm":156,"\u5f02\u5e38\u6765\u8868\u793a\u4efb\u52a1\u6267\u884c\u5931\u8d25":153,"\u5f02\u6b65":156,"\u5f02\u6b65\u5f0f\u6570\u636e\u52a0\u8f7d\u5668":145,"\u5f3a\u5316\u5b66\u4e60":196,"\u5f3a\u5316\u5b66\u4e60\u4e0d\u9700\u8981\u5e26\u6807\u7b7e\u7684\u6570\u636e\u96c6":196,"\u5f3a\u5316\u5b66\u4e60\u4e2d\u5305\u542b\u4e86\u5982\u4f55\u4f7f\u7528\u7b56\u7565\u6765\u91c7\u6837\u8f68\u8ff9\u6570\u636e":196,"\u5f3a\u5316\u5b66\u4e60\u4e2d\u5c06\u9a6c\u5c14\u53ef\u592b\u51b3\u7b56\u8fc7\u7a0b\u7684\u4e00\u4e2a\u5e8f\u5217\u79f0\u4e3a":196,"\u5f3a\u5316\u5b66\u4e60\u4e3b\u8981\u9488\u5bf9\u7684\u95ee\u9898\u662f\u5728\u4e00\u4e2a\u53ef\u80fd\u4e0d\u65ad\u6f14\u5316\u7684\u73af\u5883\u4e2d":196,"\u5f3a\u5316\u5b66\u4e60\u4e5f\u88ab\u5e94\u7528\u4e8e\u81ea\u52a8\u9a7e\u9a76":196,"\u5f3a\u5316\u5b66\u4e60\u53ef\u4ee5\u7528\u4e8e\u5904\u7406\u66f4\u591a\u590d\u6742\u7684\u51b3\u7b56\u95ee\u9898":196,"\u5f3a\u5316\u5b66\u4e60\u5728\u4e92\u8054\u7f51\u63a8\u8350":196,"\u5f3a\u5316\u5b66\u4e60\u5df2\u7ecf\u5728\u6e38\u620f\u9886\u57df":196,"\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u5148\u4f30\u8ba1\u7b56\u7565\u7684\u503c\u51fd\u6570":196,"\u5f3a\u5316\u5b66\u4e60\u7684\u76ee\u6807\u4e5f\u5c31\u662f\u8ba9\u667a\u80fd\u4f53\u5b66\u4f1a\u4e00\u79cd\u7b56\u7565":196,"\u5f3a\u5316\u5b66\u4e60\u7684\u76ee\u6807\u662f\u7ed9\u5b9a\u4e00\u4e2a\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"\u5f3a\u5316\u5b66\u4e60\u76ee\u524d\u7684\u5e94\u7528\u573a\u666f\u6709\u54ea\u4e9b":196,"\u5f3a\u5316\u5b66\u4e60\u8bad\u7ec3\u5e76\u53d1\u8ba1\u7b97\u91cf\u5927":153,"\u5f3a\u5316\u5b66\u4e60\u95ee\u9898\u7684\u4f18\u5316\u76ee\u6807\u5c31\u662f\u627e\u5230\u4e00\u4e2a\u7b56\u7565":196,"\u5f3a\u70c8\u4e0d\u5efa\u8bae\u76f4\u63a5\u5bf9master\u548cslave\u7c7b\u8fdb\u884c\u4e8c\u6b21\u7ee7\u627f":153,"\u5f3a\u884c\u8986\u76d6\u63a8\u9001\u672c\u5730\u6539\u52a8\u5230\u8fdc\u7a0b\u5206\u652f":168,"\u5f53":146,"\u5f53\u4e0d\u4f20\u5165\u4efb\u4f55\u53c2\u6570\u65f6":146,"\u5f53\u4e14\u4ec5\u5f53":196,"\u5f53\u4e2d":156,"\u5f53\u4f20\u5165":146,"\u5f53\u5b89\u88c5\u6210\u529f\u540e":150,"\u5f53\u6211\u4eec\u5e0c\u671b\u5728\u67d0\u4e2a\u51fd\u6570\u6267\u884c\u7684\u65f6\u5019\u989d\u5916\u6267\u884c\u4e00\u4e9b\u81ea\u5b9a\u4e49\u7684\u64cd\u4f5c\u65f6":164,"\u5f53\u6240\u6709\u4ecd\u5728\u8fd0\u884c":146,"\u5f53\u6570\u636e\u4e0d\u53d8\u65f6":145,"\u5f53\u667a\u80fd\u4f53\u53ea\u80fd\u63a5\u6536\u90e8\u5206\u73af\u5883\u4fe1\u606f":196,"\u5f53\u667a\u80fd\u4f53\u80fd\u591f\u63a5\u6536\u5230\u73af\u5883\u5168\u90e8\u7684\u72b6\u6001\u4fe1\u606f":196,"\u5f53\u6709\u4e00\u5b9a\u6570\u91cf\u7684\u5b50\u73af\u5883\u8fd4\u56de":146,"\u5f53\u6709\u4f7f\u7528\u8005\u6709\u8bad\u7ec3\u4efb\u52a1\u65f6":153,"\u5f53\u73af\u5883\u53d1\u751f\u53d8\u5316\u65f6":196,"\u5f53\u73af\u5883\u89c4\u6a21\u589e\u5927":145,"\u5f53\u73af\u5883\u8fd4\u56de\u7684obs\u7b49\u53d8\u91cf\u5927\u5c0f\u8d85\u8fc7100kb\u65f6":146,"\u5f53\u7a0b\u5e8f\u8fd0\u884c\u5230\u6307\u5b9a\u4f4d\u7f6e\u7684\u65f6\u5019":164,"\u5f53\u7b56\u7565\u4e3a\u786e\u5b9a\u7684":196,"\u5f53\u7b56\u7565\u4e3a\u968f\u673a\u7684":196,"\u5f53\u7f13\u5b58\u4e2d\u7684\u6570\u636e\u8db3\u591f\u591a\u65f6":196,"\u5f53\u8c03\u7528":164,"\u5f53\u8d85\u8fc7\u7b49\u5f85\u65f6\u95f4\u65f6\u4f1a\u629b\u51fa\u5f02\u5e38":146,"\u5f53coordinator\u6536\u5230\u6d41\u7a0b2\u4e2d\u6700\u540e":156,"\u5f53loader\u548cnorm\u653e\u5728\u4e00\u5757\u4f7f\u7528\u7684\u65f6\u5019":158,"\u5f53master\u4e0b\u8fbe\u4efb\u52a1\u65f6":153,"\u5f53master\u7aef\u4e0b\u8fbe\u4efb\u52a1\u65f6":153,"\u5f62\u6210\u590d\u6742\u7684\u9a8c\u8bc1\u8f6c\u6362\u7ed3\u6784":158,"\u5f85\u5168\u90e8\u6216\u90e8\u5206\u73af\u5883\u8fd0\u884c\u7ed3\u675f\u65f6\u8fd4\u56de\u7ed3\u679c":146,"\u5f88\u7b80\u5355":158,"\u5f97\u5230\u5b9e\u9645\u8fd0\u884c\u65f6\u7684\u5143\u7d20\u503c":148,"\u5f97\u5230\u7684":164,"\u5faa\u73af\u4e0a\u8ff0\u7684\u6b65\u9aa4":196,"\u5fc5\u987b\u4f7f\u7528":[148,168],"\u5fc5\u987b\u5305\u542b\u8be5\u952e\u503c":148,"\u5feb\u901f\u67e5\u9605\u5f53\u524d\u73af\u5883\u7684\u5404\u79cd":148,"\u5ffd\u7565\u524d5\u6b21\u65f6\u95f4\u8868\u73b0\u4e0d\u592a\u7a33\u5b9a\u7684\u8fed\u4ee3":145,"\u6027\u80fd\u4e0a\u6574\u4f53\u4f18\u4e8e":143,"\u6027\u80fd\u7684\u5ea6\u91cf":148,"\u6027\u8bc4\u4f30":196,"\u603b\u4f53\u7528\u65f6\u5982\u4e0b\u8868":143,"\u603b\u7528\u65f6\u53cd\u800c\u4f1a\u51cf\u5c0f":145,"\u603b\u7ed3\u6765\u8bf4":196,"\u6052\u771f":158,"\u60c5\u51b5\u4e0b\u7684":145,"\u610f\u5473\u7740\u6570\u636e\u63a8\u65ad\u65f6\u95f4\u9012\u51cf":145,"\u6210\u529f\u6267\u884c\u7684\u4fe1\u606f\u540e":156,"\u6211\u4eec\u4e00\u822c\u7528":196,"\u6211\u4eec\u4f1a\u89e3\u91ca\u4ee5\u4e0b\u7684\u57fa\u7840\u6982\u5ff5":196,"\u6211\u4eec\u4f1a\u8fdb\u4e00\u6b65\u89e3\u91ca\u4ee5\u4e0b\u7684\u65b9\u6cd5\u6982\u5ff5":196,"\u6211\u4eec\u51c6\u5907\u4e86\u4e09\u4e2a\u89c4\u6a21\u4e0d\u540c\u7684\u73af\u5883":143,"\u6211\u4eec\u51c6\u5907\u4e86\u56db\u4e2a\u89c4\u6a21\u4e0d\u540c\u7684\u73af\u5883":145,"\u6211\u4eec\u5206\u522b\u4fdd\u7559\u4e86\u4e24\u8005\u7684\u9ed8\u8ba4\u503c":143,"\u6211\u4eec\u53d1\u73b0":145,"\u6211\u4eec\u53ea\u8ba8\u8bba\u6709\u9650\u72b6\u6001\u7684\u9a6c\u53ef\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"\u6211\u4eec\u53ef\u4ee5\u5c06\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u4e0e\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u8868\u793a\u4e3a":196,"\u6211\u4eec\u53ef\u4ee5\u5f88\u65b9\u4fbf\u7684\u67e5\u9605\u5230":148,"\u6211\u4eec\u53ef\u4ee5\u8fdb\u4e00\u6b65\u5f97\u5230\u6700\u4f18\u7684\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u4e0e\u6700\u4f18\u7684\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u7684\u5173\u7cfb":196,"\u6211\u4eec\u53ef\u4ee5\u901a\u8fc7\u4ee5\u4e0b\u65b9\u5f0f\u8fdb\u884c\u4efb\u52a1\u7684\u4e0b\u8fbe":153,"\u6211\u4eec\u5728\u540e\u8fb9\u7684\u6d41\u7a0b\u4e2d\u518d\u89e3\u91ca":156,"\u6211\u4eec\u5b9e\u73b0\u7684":145,"\u6211\u4eec\u5bf9":143,"\u6211\u4eec\u5bf9\u5176\u4e5f\u5b9e\u73b0\u4e86\u548c":164,"\u6211\u4eec\u5c06":145,"\u6211\u4eec\u5f3a\u5236\u8981\u6c42\u6240\u6709\u7b7e\u5165":168,"\u6211\u4eec\u6240\u8bad\u7ec3\u7684\u667a\u80fd\u4f53\u5c31\u662f\u5728\u8fd9\u6837\u7684\u73af\u5883\u4e2d\u53bb\u8fdb\u884c\u63a2\u7d22\u548c\u5b66\u4e60":148,"\u6211\u4eec\u6bcf\u6b21\u884c\u52a8\u5c31\u53ea\u9700\u8981\u91c7\u53d6\u6536\u76ca\u8f83\u5927\u7684\u884c\u52a8\u6216\u8005\u91c7\u53d6\u80fd\u591f\u5230\u8fbe\u6536\u76ca\u8f83\u5927\u72b6\u6001\u7684\u884c\u52a8":196,"\u6211\u4eec\u6d4b\u91cf\u4e86\u4e09\u79cd":145,"\u6211\u4eec\u76f4\u63a5\u4f7f\u7528":196,"\u6211\u4eec\u79f0\u667a\u80fd\u4f53\u7684\u5b66\u4e60\u8fc7\u7a0b\u4e3afulli":196,"\u6211\u4eec\u7ed3\u5408":145,"\u6211\u4eec\u8bbe\u5b9a":143,"\u6211\u4eec\u8bbe\u5b9a\u4e00\u4e2a":143,"\u6211\u4eec\u8bbe\u5b9a\u4e00\u6b21\u5b9e\u9a8c\u4e2d\u4f1a\u6a21\u62df":143,"\u6211\u4eec\u8fd8\u6dfb\u52a0\u4e86":143,"\u6211\u4eec\u8fd8\u89c2\u5bdf\u4e86\u5728":145,"\u6211\u4eec\u8fd8\u8bbe\u5b9a\u4e86\u4e09\u4e2a":145,"\u6211\u4eec\u8fed\u4ee3\u8ba1\u7b97\u7684\u662f\u503c\u51fd\u6570":196,"\u6211\u4eec\u901a\u5e38\u4f7f\u7528\u54ea\u4e9b\u65b9\u6cd5\u5e73\u8861explor":196,"\u6211\u4eec\u901a\u5e38\u4f7f\u7528batch\u4e3a\u5355\u4f4d\u5c06fix":196,"\u6211\u4eec\u901a\u5e38\u5982\u4f55\u5b9e\u73b0offlin":196,"\u6211\u4eec\u901a\u8fc7\u8fed\u4ee3\u66f4\u65b0\u503c\u51fd\u6570\u7684\u8868\u683c\u5373\u53ef\u5b8c\u6210\u5bf9\u503c\u51fd\u6570\u7684\u4f30\u8ba1":196,"\u6211\u4eec\u9700\u8981\u5229\u7528\u51fd\u6570\u903c\u8fd1\u7684\u65b9\u6cd5\u5bf9\u503c\u51fd\u6570\u8fdb\u884c\u8868\u793a":196,"\u6216":[146,158],"\u6216\u5143\u6570\u636e":156,"\u6216\u5b50\u8fdb\u7a0b\u5361\u6b7b\u65f6\u7a0b\u5e8f\u4e0d\u4f1a\u6b63\u5e38\u9000\u51fa":146,"\u6216\u5e76\u884c\u5730":146,"\u6216\u662f\u6253\u7b97\u4fee\u6539\u73b0\u6709\u4ee3\u7801":168,"\u6216\u662f\u6570\u636e\u6d41\u538b\u529b\u589e\u5927\u65f6":145,"\u6216\u67d0\u4e00\u6761":168,"\u6216\u8005":[158,164],"\u6216\u8005\u4e5f\u53ef\u4ee5\u5728\u539frepo\u4e0b\u521b\u5efa\u4e00\u4e2a\u81ea\u5df1\u7684\u5f00\u53d1\u5206\u652f":168,"\u6216\u8005\u662f\u8ba1\u7b97\u51fd\u6570\u76f8\u5173\u7684\u4e00\u4e9b\u72b6\u6001":164,"\u6216\u8005\u7531":146,"\u6216\u8005\u901a\u8fc7":153,"\u6216\u8fd8\u6ca1\u6709\u51c6\u5907\u597d\u53d1\u5e03\u5230\u5c0f\u7ec4\u5185":168,"\u6216\u901a\u8fc7":153,"\u6216math":158,"\u6240\u4ee5\u53ea\u6709\u5f53\u4e0a\u4e00\u4e2a":145,"\u6240\u4ee5\u53ef\u8ba4\u4e3a\u662f\u4e0e\u73af\u5883\u603b\u5171\u4ea4\u4e92":143,"\u6240\u4ee5\u5bf9\u4e8e\u540c\u4e00\u73af\u5883":145,"\u6240\u4ee5\u5e73\u8861exploitation\u548cexploration\u7684\u76ee\u7684\u5c31\u662f\u83b7\u5f97\u4e00\u79cd\u957f\u671f\u6536\u76ca\u6700\u9ad8\u7684\u7b56\u7565":196,"\u6240\u4ee5\u6211\u4eec\u53c8\u505a\u4e86\u4e00\u7ec4\u5b9e\u9a8c":143,"\u6240\u4ee5\u6211\u4eec\u73b0\u5728\u4f1a\u5355\u72ec\u63d0\u4f9b\u5bf9\u5e94\u7248\u672c\u4e0b":150,"\u6240\u4ee5dataloader\u662f\u5e76\u884cpipeline\u7279\u6709\u7684":156,"\u6240\u4f7f\u7528\u7684":164,"\u6240\u51fa\u54c1\u7684":148,"\u6240\u5360\u6574\u4f53\u65f6\u95f4\u7684\u6bd4\u4f8b":145,"\u6240\u6307\u5b9a\u7684\u5b50\u73af\u5883\u6309\u7167":146,"\u6240\u6307\u5b9a\u7684\u5b50\u73af\u5883\u8fdb\u7a0b\u6309\u7167":146,"\u6240\u6709\u4ee3\u7801\u5b9e\u73b0\u4e2d\u547d\u540d\u5efa\u8bae\u4e00\u822c\u60c5\u51b5\u4f7f\u7528\u5355\u6570":148,"\u6240\u6709\u4ee3\u7801\u5b9e\u73b0\u79c9\u627f":148,"\u6240\u6709\u5728\u8fd0\u884c\u72b6\u6001\u7684\u73af\u5883":146,"\u6240\u6709\u5b50\u73af\u5883":146,"\u6240\u6709\u5bf9":148,"\u6240\u6709\u65b0\u4ee3\u7801\u4ed3\u5e93":168,"\u6240\u6709\u672a\u8fd0\u884c\u7ed3\u675f\u7684\u73af\u5883":146,"\u6240\u6709\u73af\u5883":146,"\u6240\u8c13\u7b56\u7565":196,"\u6240\u8c13valu":196,"\u6240\u9700\u7684\u65f6\u95f4":143,"\u6240\u9700\u8981\u7684\u53c2\u6570":164,"\u624b\u52a8\u8fdb\u884cmerg":168,"\u624d\u53ef\u4ee5\u5c06\u4e0b\u4e00\u4e2a":145,"\u624d\u80fd\u7ee7\u7eed\u4f7f\u7528":146,"\u6253\u4e0a":168,"\u6253\u5370\u65e5\u5fd7":164,"\u6253\u5370log\u7b49":156,"\u6267\u884c":145,"\u6267\u884c\u540e\u8fd4\u56de\u7ed3\u679c":156,"\u6267\u884cpip\u5b89\u88c5\u547d\u4ee4":139,"\u6269\u5c55\u6027\u548c\u6613\u7528\u6027":142,"\u6279\u91cf\u5904\u7406":168,"\u627e\u5230\u6700\u5927\u503c\u6240\u5728\u7684\u7684":164,"\u629b\u51fa\u7684\u7f51\u7edc\u8bf7\u6c42\u5f02\u5e38\u5728interaction\u6846\u67b6\u4e2d":153,"\u62ff\u5230\u6570\u636e\u540e\u8c03\u7528":156,"\u6301\u6709\u7684\u67d0\u51e0\u4e2a\u73af\u5883\u8bbe\u7f6e\u7279\u5b9a\u7684":146,"\u6307\u5411\u8be5\u7c7b\u7684\u552f\u4e00\u5b9e\u4f8b":148,"\u6307\u5b9a\u5176\u8fd0\u884c\u53c2\u6570":146,"\u6307\u5c06\u6570\u636e\u4ece\u6587\u4ef6\u4e2d\u8bfb\u53d6\u5230\u5185\u5b58\u7684\u65f6\u95f4":145,"\u6307\u6570\u636e\u9884\u5904\u7406\u65f6\u95f4":145,"\u6309\u7167\u4e0a\u6587\u7684\u8981\u6c42\u4f7f\u7528":148,"\u6309\u7167critic\u90e8\u5206\u5f97\u5230\u7684\u4ef7\u503c":196,"\u6362\u884c":168,"\u6362\u884c\u7b26":168,"\u63a5\u53e3":148,"\u63a5\u53e3\u65b9\u6cd5":156,"\u63a5\u8fd1":145,"\u63a5\u8fd10":196,"\u63a5\u8fd1\u4e8e1\u65f6\u8868\u660e\u66f4\u8003\u8651\u8fdc\u671f\u7684\u5229\u76ca":196,"\u63a7\u5236":164,"\u63a8\u65ad\u8fc7\u7a0b":145,"\u63a8\u8350\u5728":148,"\u63a8\u8350\u5f15\u5165\u81ea\u52a8\u6d4b\u8bd5\u548c\u6301\u7eed\u96c6\u6210":168,"\u63a8\u8350\u8bbe\u7f6e\u4e3atrue":146,"\u63a8\u9001\u81f3\u539f\u59cb\u4ed3\u5e93":168,"\u63a8\u9001\u8fdb\u81ea\u5df1\u7684":168,"\u63cf\u8ff0\u4f60\u51c6\u5907\u52a0\u5165\u7684\u529f\u80fd\u548c\u5177\u4f53\u7684":168,"\u63d0\u4ea4\u81f3":168,"\u63d0\u4f9b\u4e86":164,"\u63d0\u4f9b\u4e86\u53c2\u6570freq\u6765\u63a7\u5236hook\u88ab\u6267\u884c\u7684\u9891\u7387":[164,165],"\u63d0\u4f9b\u4e86\u66f4\u4e3a\u7b80\u5355\u7684\u8c03\u7528\u65b9\u6cd5":164,"\u63d0\u4f9b\u4e86\u73af\u5883\u72b6\u6001\u7684\u679a\u4e3e\u7c7b\u578b\u6765\u5b9e\u65f6\u638c\u63e1\u6240\u6709\u5b50\u73af\u5883\u7684\u8fd0\u884c\u72b6\u6001":146,"\u63d0\u4f9b\u7684\u9ed8\u8ba4\u5b9a\u4e49":148,"\u63d0\u4f9b\u7b80\u5355\u7684reset\u65b9\u6cd5":164,"\u641c\u7d22\u65b9\u9762\u6709\u4e30\u5bcc\u7684\u5e94\u7528\u573a\u666f":196,"\u642c\u8fd0\u81f3":145,"\u652f\u6301\u4e00\u5c42\u4e00\u5c42\u7684\u590d\u7528":164,"\u652f\u6301\u4ee5\u7ee7\u627f\u7b49\u5f62\u5f0f\u7684\u6269\u5c55":142,"\u652f\u6301\u5c06\u8bad\u7ec3\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5206\u5272\u4e3a\u591a\u4e2a\u5b50\u4efb\u52a1\u4ea4\u7531":145,"\u6536\u96c6\u4e00\u5b9a\u91cf\u6570\u636e\u6240\u9700\u7684\u65f6\u95f4":143,"\u653e\u5165\u8fd9\u4e00\u6570\u636e\u8bf7\u6c42":156,"\u6545":156,"\u6545\u4e32\u884cpipeline\u53ef\u4ee5\u5b9e\u4f8b\u5316bas":156,"\u6545\u4e5f\u653e\u5728\u6b64\u5904\u5217\u51fa":143,"\u6545\u4f5c\u4e3a\u4e00\u4e2a\u72ec\u7acb\u6a21\u5757\u5b58\u5728":158,"\u6545\u53ef\u4ee5\u652f\u6301\u91cd\u7528":158,"\u6545\u5728\u8fd9\u4e00\u90e8\u5206\u4ee5\u6211\u4eec\u5b9e\u73b0\u7684":156,"\u6545\u6b64\u5904\u8bbe\u8ba1\u4e3a\u975e\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1\u6a21\u5f0f":153,"\u6545\u6b64\u65f6\u7684\u4efb\u52a1\u5e94\u5f53\u4e3a":156,"\u6545learner":156,"\u6559\u7a0b":168,"\u6570\u636e":[145,156],"\u6570\u636e\u52a0\u8f7d\u6d41\u7a0b":145,"\u6570\u636e\u5728\u6709\u6548\u65f6\u95f4\u7a97\u53e3\u5185\u7684\u81ea\u52a8\u8bb0\u5f55\u4e0e\u5206\u6790":142,"\u6570\u636e\u5904\u7406":145,"\u6570\u636e\u63a8\u65ad":145,"\u6570\u636e\u6536\u96c6":150,"\u6570\u636e\u6d41\u538b\u529b\u589e\u5927":145,"\u6570\u91cf\u8fbe\u5230":146,"\u6574\u4e2a\u6587\u4ef6\u5939\u5185\u7684\u6362\u884c":168,"\u6574\u5408\u81ea\u5df1\u7684\u672c\u5730":168,"\u6574\u5408\u8fdb\u7c7b\u5185\u90e8":153,"\u6574\u578b":142,"\u6587\u4ef6":[150,168],"\u6587\u4ef6\u53ef\u4f9b\u5b89\u88c5":150,"\u6587\u4ef6\u5939":168,"\u6587\u4ef6\u5939\u79fb\u52a8\u51fa\u53bb":139,"\u65b0\u589e\u4e86":148,"\u65b9\u4fbf\u5730\u5bf9":164,"\u65b9\u5dee\u8f83\u5927":196,"\u65b9\u6cd5":[146,148,153,156,164],"\u65b9\u6cd5\u4e00\u6837":146,"\u65b9\u6cd5\u4e2d":148,"\u65b9\u6cd5\u4e2d\u5b8c\u6210\u8be5\u529f\u80fd":148,"\u65b9\u6cd5\u4e2d\u5b9e\u73b0":148,"\u65b9\u6cd5\u4e4b\u524d":148,"\u65b9\u6cd5\u4e4b\u540e":148,"\u65b9\u6cd5\u4e4b\u540e\u4fbf\u53ef\u901a\u8fc7\u8c03\u7528":146,"\u65b9\u6cd5\u4ee5\u4fbf\u67e5\u770b\u5404\u4e2a\u4f4d\u7f6e\u7684":164,"\u65b9\u6cd5\u4ee5\u542f\u52a8comm":156,"\u65b9\u6cd5\u4ee5\u83b7\u53d6\u65f6\u95f4\u5bf9\u8c61\u5185\u7684\u65f6\u95f4":142,"\u65b9\u6cd5\u4f1a\u4e32\u884c\u5730":146,"\u65b9\u6cd5\u4f1a\u5f15\u53d1\u5f02\u5e38":146,"\u65b9\u6cd5\u4f20\u5165\u53c2\u6570\u7684":146,"\u65b9\u6cd5\u4f9d\u636e\u8f93\u5165\u7684":148,"\u65b9\u6cd5\u5219\u662f\u5bf9\u73af\u5883\u8fdb\u884c\u91cd\u7f6e":148,"\u65b9\u6cd5\u5373\u53ef\u7528\u4e8eloggedmodel":142,"\u65b9\u6cd5\u5373\u53ef\u770b\u5230\u6240\u6709\u5f53\u524dmodel\u6240\u6dfb\u52a0\u7684wrapper\u5d4c\u5957\u60c5\u51b5":164,"\u65b9\u6cd5\u53ea\u9700\u8981\u8bb0\u5f55\u4e0b\u8fd9\u4e2a\u503c":148,"\u65b9\u6cd5\u53ef\u4f5c\u4e3a\u4e00\u4e2a\u7ebf\u7a0b\u542f\u52a8":156,"\u65b9\u6cd5\u6267\u884c\u65f6\u8bbe\u7f6e\u968f\u673a\u79cd\u5b50\u5373\u53ef":148,"\u65b9\u6cd5\u662f\u4ece\u5916\u754c\u4f20\u5165\u8bad\u7ec3\u6570\u636e":156,"\u65b9\u6cd5\u6765\u624b\u52a8":146,"\u65b9\u6cd5\u6765\u6267\u884c\u4efb\u52a1":153,"\u65b9\u6cd5\u68c0\u67e5\u662f\u5426\u5408\u6cd5":148,"\u65b9\u6cd5\u7684\u53c2\u6570":146,"\u65b9\u6cd5\u7684\u5b50\u73af\u5883\u7684":146,"\u65b9\u6cd5\u7684\u7b49\u5f85\u65f6\u95f4":146,"\u65b9\u6cd5\u7684\u8c03\u7528\u4e00\u822c\u5728":148,"\u65b9\u6cd5\u7684\u8f93\u5165\u662f\u4e00\u4e2a":164,"\u65b9\u6cd5\u7684\u8fd0\u884c\u65f6":146,"\u65b9\u6cd5\u88ab\u7528\u4e8e\u89e3\u51b3\u667a\u80fd\u4f53\u4e0e\u73af\u5883\u7684\u4ea4\u4e92\u95ee\u9898":196,"\u65b9\u9762\u7684\u64cd\u4f5c":164,"\u65e0":[148,156],"\u65e0\u8bba\u662f\u54ea\u4e00\u79cd\u65b9\u6cd5":196,"\u65e2\u53ef\u4ee5\u53bb\u9002\u5e94\u4e0d\u540c\u7684\u52a8\u4f5c\u7a7a\u95f4\u4e0e\u72b6\u6001\u7a7a\u95f4\u7684\u95ee\u9898":196,"\u65e5\u5fd7\u6a21\u578b\u7cfb\u7edf\u662fautolog\u7684\u6838\u5fc3":142,"\u65f6":[145,146,168,196],"\u65f6\u4e3a\u8be5\u5b50\u73af\u5883\u8bbe\u7f6e\u7684\u53c2\u6570":146,"\u65f6\u4e5f\u5fc5\u987b\u8c03\u7528":148,"\u65f6\u4f1a\u5f15\u53d1\u5f02\u5e38":146,"\u65f6\u542f\u52a8\u73af\u5883\u8bbe\u5b9a\u79cd\u5b50":148,"\u65f6\u5e8f\u5dee\u5206\u5b66\u4e60":196,"\u65f6\u7684\u53c2\u6570\u4e3a\u4e0a\u6b21\u624b\u52a8":146,"\u65f6\u95f4":145,"\u65f6\u95f4\u7cfb\u7edf\u662fautolog\u7cfb\u7edf\u7684\u5173\u952e\u8981\u7d20":142,"\u65f6\u9690\u72b6\u6001\u7684\u884c\u4e3a":164,"\u660e\u786e\u89c4\u5b9a\u5176\u683c\u5f0f":148,"\u661f\u9645\u4e89\u9738":196,"\u661f\u9645\u89c4\u6a21":145,"\u6620\u5c04\u7ed3\u679c\u662f\u4e0d\u786e\u5b9a\u7684":150,"\u662f":[143,145,168],"\u662f\u4e00\u4e2a":148,"\u662f\u4e00\u4e2a\u73af\u5883\u7ba1\u7406\u5668":146,"\u662f\u4e00\u7c7b\u4f18\u5316\u65b9\u6cd5":196,"\u662f\u4e24\u8005\u7684\u7ed3\u5408":196,"\u662f\u4e32\u884c\u6a21\u5f0f\u4e0e\u5e76\u884c\u6a21\u5f0f\u4e2d\u8fdb\u884c\u8bad\u7ec3\u7684\u6838\u5fc3":156,"\u662f\u53ef\u9009\u952e\u503c":148,"\u662f\u5426\u5728\u8f6c\u4e3afloat\u540e\u5728\u533a\u95f4":158,"\u662f\u5426\u6240\u6709\u6301\u6709\u7684\u73af\u5883\u5df2\u7ecf\u8fd0\u884c\u7ed3\u675f":146,"\u662f\u5426\u8fd0\u884c\u81f3":146,"\u662f\u5728\u539f\u59cb\u65b9\u6cd5\u7684\u57fa\u7840\u4e0a":164,"\u662f\u57fa\u4e8e\u4e24\u4e2aloader":158,"\u662f\u5bf9\u539f\u59cb\u51fd\u6570\u7684\u5c01\u88c5":164,"\u662f\u5bf9\u73af\u5883\u7684\u90e8\u5206\u6027\u63cf\u8ff0":196,"\u662f\u5bf9\u73af\u5883\u7684global\u6027\u63cf\u8ff0":196,"\u662f\u5bf9\u73af\u5883\u7c7b\u7684\u4e00\u4e2a\u5305\u88c5":164,"\u662f\u5f02\u6b65\u52a0\u8f7d\u6570\u636e\u7684":145,"\u662f\u5f3a\u5316\u5b66\u4e60\u4e2d\u91cd\u8981\u7684\u6a21\u5757\u4e4b\u4e00":148,"\u662f\u5f3a\u5316\u5b66\u4e60\u5728\u6570\u5b66\u4e0a\u7684\u7406\u60f3\u5316\u5f62\u5f0f":196,"\u662f\u6307\u662f\u7b56\u7565":196,"\u662f\u6307\u667a\u80fd\u4f53\u91c7\u7528\u7b56\u7565":196,"\u662f\u6307\u72b6\u6001\u5230\u52a8\u4f5c\u7684\u6620\u5c04":196,"\u662f\u667a\u80fd\u4f53\u6240\u5904\u7684\u73af\u5883\u7ed9\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u4e00\u4e2a\u5b66\u4e60\u4fe1\u53f7":196,"\u662f\u6709\u9650\u72b6\u6001\u96c6\u5408":196,"\u662f\u72b6\u6001\u7ef4\u5ea6":143,"\u662f\u72b6\u6001\u8f6c\u79fb\u6982\u7387":196,"\u662f\u73af\u5883":143,"\u662f\u89e3\u51b3\u5b9e\u9645\u95ee\u9898\u65f6\u6700\u5e38\u8003\u8651\u7684\u6846\u67b6":196,"\u662f\u975e\u5e38\u65b9\u4fbf\u4e14\u6709\u6548\u7684\u5de5\u5177":164,"\u662f\u9a6c\u5c14\u79d1\u592b\u7684":196,"\u662fmaster\u7aef\u548cslave\u7aef":153,"\u667a\u80fd\u4f53\u4ece\u73af\u5883\u4e2d\u63a5\u6536\u89c2\u5bdf\u5230\u7684\u4fe1\u606f":196,"\u667a\u80fd\u4f53\u7684\u76ee\u6807\u662f\u6700\u5927\u5316\u79ef\u7d2f\u81ea\u5df1\u63a5\u6536\u5230\u7684\u5956\u52b1":196,"\u66f4\u52a0\u6666\u6da9\u96be\u61c2":156,"\u66f4\u591a\u7684actor":196,"\u66f4\u591a\u7684polici":196,"\u66f4\u65b0\u65f6\u57fa\u4e8e\u5f53\u524d\u5df2\u5b58\u5728\u7684\u4f30\u8ba1":196,"\u66f4\u65b0\u7684\u76ee\u6807\u662f":196,"\u6700\u4e3a\u5173\u952e\u7684\u90e8\u5206\u5728\u4e8e":148,"\u6700\u4f73\u5b9e\u8df5\u4e3a\u9884\u5148\u5f00\u542f\u5168\u90e8\u7684\u670d\u52a1\u8282\u70b9":153,"\u6700\u540e\u518d\u5728\u539f\u4ed3\u5e93\u4e0a\u63d0":168,"\u6700\u540e\u6211\u4eec\u8fd8\u89e3\u7b54\u4e86\u4e00\u4e9b\u5f3a\u5316\u5b66\u4e60\u9886\u57df\u4e2d\u5e38\u89c1\u7684\u6982\u5ff5\u6027\u95ee\u9898":196,"\u6700\u57fa\u7840\u7684wrapper":164,"\u6700\u7ec8\u7684\u4f18\u5316\u76ee\u6807\u90fd\u662freturn\u7684\u6700\u5927\u5316":196,"\u6709\u4e24\u79cd\u65b9\u5f0f":153,"\u6709\u8f83\u660e\u663e\u7684\u6548\u7387\u4f18\u52bf":145,"\u672a\u8fd0\u884c\u81f3":146,"\u672c\u5730\u4ee3\u7801\u4ed3\u5e93\u5f00\u53d1":168,"\u672c\u7c7b\u56fe\u5e76\u4e0d\u5b8c\u6574":156,"\u672c\u8fdb\u7a0b\u4ec5\u8d1f\u8d23\u5c06\u6570\u636e\u8bfb\u53d6\u4efb\u52a1\u5207\u5206\u6210":145,"\u673a\u5668\u4eba\u63a7\u5236\u7b49\u63a7\u5236\u7cfb\u7edf\u4e2d":196,"\u6765\u4ecb\u7ecd\u5e76\u884c\u6a21\u5f0f\u4e2d\u4ece\u5e76\u884cpipeline\u5165\u53e3\u90e8\u7f72coordin":156,"\u6765\u5b8c\u6210":168,"\u6765\u5b9e\u73b0":148,"\u6765\u5b9e\u73b0\u65b9\u4fbf\u6613\u7528\u7684\u7edf\u8ba1\u529f\u80fd":142,"\u6765\u5bf9":146,"\u6765\u5f97\u5230\u65b0\u7684\u7ecf\u8fc7\u5305\u88c5\u7684\u73af\u5883":164,"\u6765\u63cf\u8ff0\u5177\u4f53\u8981\u505a\u7684\u5de5\u4f5c\u6216\u8ddf\u540c\u4e8b\u8ba8\u8bba\u76f8\u5173\u89e3\u51b3\u65b9\u6848":168,"\u6765\u63d0\u4ea4\u6539\u52a8":168,"\u6765\u6e90\u4e8e\u63a5\u53e3\u7684\u7236\u7c7b":148,"\u6765\u786e\u4fdd":168,"\u6765\u7ef4\u62a4\u591a\u4e2a\u73af\u5883\u5b9e\u4f8b":146,"\u6765\u8868\u793a":196,"\u6765\u8bf4":146,"\u6765\u8bf4\u5219\u662f\u8fd0\u884c\u6bcf\u4e2a\u73af\u5883\u7684\u5b50\u8fdb\u7a0b":146,"\u6784\u5efa\u4e00\u4e2a\u5927\u5c0f\u5199\u4e0d\u654f\u611f\u7684\u679a\u4e3eloader":158,"\u6784\u5efa\u4e00\u4e2a\u679a\u4e3eloader":158,"\u6784\u5efa\u4e00\u4e2a\u7c7b\u578b\u8f6c\u6362loader":158,"\u6784\u5efa\u4e00\u4e2a\u7c7b\u578b\u9a8c\u8bc1loader":158,"\u6784\u5efadict\u683c\u5f0f\u6570\u636e":158,"\u6784\u9020\u4e00\u4e9b\u73af\u5883\u8fd0\u884c\u65f6\u7684\u72b6\u6001\u53d8\u91cf\u7b49":146,"\u6784\u9020\u6bcf\u4e2a":146,"\u67e5\u770b":164,"\u67e5\u770bforward\u65b9\u6cd5\u5728model\u4e2d\u7684\u8c03\u7528\u60c5\u51b5":[164,165],"\u67e5\u770bwrapper\u5d4c\u5957\u60c5\u51b5":164,"\u6837\u4f8b":146,"\u6839\u636e\u4f20\u5165\u7684\u521d\u59cb\u914d\u7f6e\u4e3a\u6bcf\u4e2a\u5177\u4f53\u7684\u73af\u5883\u751f\u6210\u76f8\u5e94\u7684\u914d\u7f6e\u6587\u4ef6":148,"\u6839\u636e\u4f20\u5165\u7684hook\u4f4d\u7f6e\u540d":156,"\u6839\u636e\u53c2\u6570\u7ed9\u5b9a\u7684freq\u6bcf\u9694\u4e00\u5b9a\u6570\u91cf\u4e2aiter\u4e4b\u540e\u4fdd\u5b58\u6a21\u578b":164,"\u6839\u636e\u53c2\u6570\u7ed9\u5b9a\u7684freq\u6bcf\u9694\u4e00\u5b9a\u6570\u91cf\u4e2aiter\u4e4b\u540e\u6253\u5370\u65e5\u5fd7":164,"\u6839\u636e\u63a5\u6536\u5230\u7684\u4fe1\u606f\u9009\u62e9\u52a8\u4f5c":196,"\u6839\u636e\u6982\u7387\u91c7\u6837\u52a8\u4f5c":164,"\u6839\u636e\u8fd9\u4e9b\u7ed3\u679c\u4fee\u6539\u5b50\u73af\u5883\u7684\u8fd0\u884c\u72b6\u6001":146,"\u6839\u636e\u9884\u5148\u8bbe\u5b9a\u7684\u6700\u5927\u8fed\u4ee3\u6570\u53caevaluate\u6536\u655b\u60c5\u51b5":156,"\u683c\u5f0f\u7684":146,"\u68c0\u67e5\u4e00\u4e2a\u73af\u5883\u5143\u7d20\u7c7b\u662f\u5426\u5b9e\u73b0\u4e86\u5fc5\u9700\u5c5e\u6027":148,"\u68c0\u67e5\u5408\u6cd5\u6027\u65b9\u6cd5":148,"\u68c0\u67e5\u5e76\u63d0\u53d6":158,"\u68c0\u6d4b\u673a\u5236":146,"\u6982\u8ff0":[142,145,146,148,156,164],"\u6a21\u5757\u4e3a\u6bcf\u4e2a\u73af\u5883\u521b\u5efa\u5355\u72ec\u7684\u8fdb\u7a0b":146,"\u6a21\u5757\u5df2\u7ecf\u5e2e\u6211\u4eec\u5b9a\u4e49\u4e86\u7edd\u5927\u591a\u6570\u5e38\u7528\u7684\u5b66\u672f\u73af\u5883":148,"\u6a21\u5757\u8fd8\u4e0d\u591f\u4e86\u89e3":146,"\u6a21\u578b\u5229\u7528\u6570\u636e":145,"\u6a21\u578b\u6536\u655b\u901f\u5ea6\u592a\u6162":196,"\u6a21\u5f0f\u5207\u6362\u4ee5\u53ca\u4e0d\u540c":164,"\u6a21\u62df\u771f\u5b9e\u573a\u666f":143,"\u6b21":143,"\u6b21\u5b9e\u9a8c\u53d6\u5e73\u5747":143,"\u6b21\u6570":146,"\u6b63\u5728\u7b49\u5f85\u65b0\u547d\u4ee4\u7684\u5b50\u73af\u5883":146,"\u6b63\u5728\u8fd0\u884c\u4e2d\u7684\u5b50\u73af\u5883":146,"\u6b63\u5728\u8fdb\u884c":146,"\u6b63\u662f\u901a\u8fc7\u5728learn":196,"\u6b63\u786e\u5173\u95ed\u5404\u9879\u8d44\u6e90":156,"\u6b63\u786e\u8fd0\u884c":168,"\u6b64\u4e3e\u53ef\u4ee5\u52a0\u5feb":146,"\u6b64\u5904":153,"\u6b64\u5916":[142,143,148,153,156],"\u6b64\u5916\u8fd8\u4f20\u6765\u5efa\u7acblearner\u5fc5\u987b\u7684\u4fe1\u606f":156,"\u6b64\u65f6":[146,196],"\u6b64\u65f6\u6700\u4f18\u7b56\u7565\u662f\u8d2a\u5a6a\u7b56\u7565":196,"\u6b64\u65f6\u7684\u53c2\u6570\u6240\u5bf9\u5e94\u7684\u7b56\u7565\u4e3a\u6700\u4f18\u7b56\u7565":196,"\u6b64\u65f6\u8ba8\u8bba\u5355\u6b65td\u5373td":196,"\u6b64\u65f6dataloader\u53c8\u4f1a\u8c03\u7528":156,"\u6b65\u8fdb\u65f6\u95f4":142,"\u6bcf\u4e2a":145,"\u6bcf\u4e2a\u8fed\u4ee3\u4e2d\u81ea\u884c\u53d1\u9001\u83b7\u53d6\u6570\u636e\u7684\u8bf7\u6c42":156,"\u6bcf\u6b21":[143,164],"\u6bcf\u969420\u4e2aiter\u4f1a\u5b58\u4e00\u6b21ckpt":164,"\u6bd4\u5982\u5c06\u76f8\u5173\u6570\u636e\u79fb\u9664":148,"\u6bd4\u5982\u7b97\u6cd5\u66f4\u65b0\u4f7f\u7528":168,"\u6bd4\u5982\u7ef4\u62a4\u4e00\u4e9b\u72b6\u6001\u8bb0\u5f55\u53d8\u91cf":148,"\u6bd4\u5982\u81ea\u5df1\u9020\u8f6e\u5b50":168,"\u6bd4\u5982\u83b7\u53d6\u73af\u5883observation\u7684\u7ef4\u5ea6\u7b49\u4fe1\u606f":148,"\u6bd4\u5982behavior":196,"\u6bd4\u8f83\u63a8\u8350\u7684\u4e00\u79cd\u65b9\u5f0f":153,"\u6ca1\u9519":158,"\u6cbf\u7740\u68af\u5ea6\u65b9\u6cd5":196,"\u6ce8":145,"\u6ce8\u518c":164,"\u6ce8\u518c\u4e86\u4e00\u4e2a\u7528\u4e8e\u8fdb\u884c\u5e73\u5747\u503c\u8ba1\u7b97\u7684\u51fd\u6570":142,"\u6ce8\u518c\u65b0\u7684hook":156,"\u6ce8\u518c\u7684\u65f6\u5019\u9700\u8981\u63d0\u4f9b\u540d\u79f0":164,"\u6ce8\u610f":[148,158],"\u6ce8\u610f\u4e0d\u8981\u76f4\u63a5\u4f7f\u7528httperror\u8fdb\u884c\u5f02\u5e38\u7684\u6355\u6349":153,"\u6ce8\u610f\u521d\u59cb\u5316\u5b8c\u6210\u540e\u4f1a\u8c03\u7528":148,"\u6ce8\u610f\u7f16\u5199\u5408\u9002\u7684":168,"\u6d4b\u8bd5\u5176\u5728\u4e0d\u540c\u89c4\u6a21\u7684\u73af\u5883\u4e0e\u4e0d\u540c\u7c7b\u578b\u7684\u73af\u5883\u7ba1\u7406\u5668\u4e0b":143,"\u6d4b\u8bd5\u6a21\u5757\u4e2d\u5747\u53ef\u4f7f\u7528":150,"\u6d4b\u901f\u7ed3\u679c\u5982\u4e0b\u8868\u6240\u793a":143,"\u6dfb\u52a0\u4e86":146,"\u6dfb\u52a0\u8fd9\u4e2a\u529f\u80fd\u7684\u539f\u56e0\u548c\u6253\u7b97\u4f7f\u7528\u7684\u5b9e\u73b0\u65b9\u5f0f":168,"\u6e10\u8fdb\u6027\u6536\u655b":196,"\u7075\u6d3b\u7684\u6570\u636e\u7ec4\u5408\u6846\u67b6\u7ec4\u4ef6":158,"\u7136\u540e\u540c\u6837\u901a\u8fc7":168,"\u7136\u540e\u5c06\u9ed8\u8ba4\u73af\u5883\u914d\u7f6e\u590d\u5236\u76f8\u5e94\u4efd\u6570\u8fd4\u56de":148,"\u7136\u540e\u6211\u4eec\u5f00\u59cb\u4ecb\u7ecd\u5e76\u884c\u6a21\u5f0f\u4e0b\u7684flaskfilesystemlearner\u8fd9\u4e00comm":156,"\u7136\u540e\u662f\u5728\u6574\u4f53\u6d41\u7a0b\u4e2d":145,"\u7136\u540e\u6839\u636e\u503c\u51fd\u6570\u5bf9\u7b56\u7565\u8fdb\u884c\u6539\u8fdb":196,"\u7136\u540e\u8bd5\u56fe\u4ece":156,"\u7136\u540e\u8fdb\u5165\u6d41\u7a0b5":145,"\u7136\u540e\u91cd\u590d\u6267\u884c\u83b7\u53d6\u6570\u636e":156,"\u7136\u540emymaster\u591a\u91cd\u7ee7\u627fmaster\u548c\u65b0\u7684\u529f\u80fd\u7c7b":153,"\u7136\u800c\u4e0e\u73af\u5883\u4ea4\u4e92\u540e\u4ea7\u751f\u7684\u6570\u636e\u4e0d\u80fd\u76f4\u63a5\u7528\u4e8e\u8bad\u7ec3":196,"\u7136\u800c\u5b9e\u9645\u5f00\u53d1\u4e2d\u63a2\u7d22\u51fa\u4e86\u5176\u66f4\u591a\u7684\u7528\u6cd5\u4ee5\u53ca\u66f4\u5927\u7684\u529f\u80fd\u6f5c\u529b":158,"\u72b6\u6001":[146,196],"\u72b6\u6001\u4ef7\u503c\u51fd\u6570":196,"\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u548c\u884c\u4e3a\u4ef7\u503c\u51fd\u6570\u7684\u5173\u7cfb":196,"\u72b6\u6001\u4ef7\u503c\u51fd\u6570\u662f\u8bc4\u4ef7\u7b56\u7565\u51fd\u6570\u4f18\u52a3\u7684\u6807\u51c6\u4e4b\u4e00":196,"\u72b6\u6001\u7684":146,"\u738b\u8005\u8363\u8000\u7b49":196,"\u73af\u5883\u4e00\u4e2a":148,"\u73af\u5883\u4e2d\u4e5f\u4fdd\u6301\u4e86\u8f83\u9ad8\u7684\u6027\u80fd":143,"\u73af\u5883\u4e2d\u4f18\u52bf\u66f4\u52a0\u660e\u663e":143,"\u73af\u5883\u4f1a\u56e0\u4e3a\u667a\u80fd\u4f53\u91c7\u53d6\u7684\u52a8\u4f5c\u53d1\u751f\u6539\u53d8":196,"\u73af\u5883\u5143\u7d20\u4fe1\u606f\u6a21\u677f":148,"\u73af\u5883\u5143\u7d20\u57fa\u7c7b":148,"\u73af\u5883\u5143\u7d20\u7684\u952e\u503c\u5982\u679c\u4e3a\u7a7a\u65f6":148,"\u73af\u5883\u5143\u7d20\u8fd0\u884c\u65f6\u57fa\u7c7b":148,"\u73af\u5883\u5143\u7d20\u90e8\u5206\u7b80\u6613\u7684\u7c7b\u903b\u8f91\u56fe\u5982\u4e0b":148,"\u73af\u5883\u6267\u884c\u8f93\u5165\u7684\u52a8\u4f5c":146,"\u73af\u5883\u6a21\u5757":148,"\u73af\u5883\u6bcf\u4e2a\u65f6\u95f4\u6b65\u90fd\u53ef\u5305\u542b\u8be5\u952e\u503c":148,"\u73af\u5883\u76f8\u5e94\u53c2\u6570\u5982\u4e0b\u8868":145,"\u73af\u5883\u7ba1\u7406\u5668\u7528\u4f5c":143,"\u73b0\u5728":156,"\u73b0\u5728\u5df2\u7ecf\u53ef\u4ee5\u5728":164,"\u7528":164,"\u7528\u4e8e\u4e00\u4e9b\u7b80\u5355\u73af\u5883\u7684\u8fd0\u884c\u6216":146,"\u7528\u4e8e\u5728\u8bad\u7ec3\u7684\u7279\u5b9a\u65f6\u95f4\u70b9\u6267\u884c\u4e00\u4e9b\u51fd\u6570":156,"\u7528\u4e8e\u57fa\u4e8e\u65f6\u95f4\u7cfb\u7edf":142,"\u7528\u4e8e\u5b58\u653e\u4e00\u4e9b\u548c\u901a\u4fe1\u76f8\u5173\u7684\u6d88\u606f\u5b57\u5178":156,"\u7528\u4e8e\u5b9e\u73b0":164,"\u7528\u4e8e\u5c06\u4e24\u79cd\u65f6\u95f4\u7cfb\u7edf\u8fdb\u884c\u5c01\u88c5":142,"\u7528\u4e8e\u5e76\u884c\u8bad\u7ec3\u4e2d\u548c":156,"\u7528\u4e8e\u652f\u6301\u4e2d\u7b49\u590d\u6742\u6570\u5b66\u8fd0\u7b97":158,"\u7528\u4e8e\u652f\u6301\u7b80\u5355\u975e\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1":153,"\u7528\u4e8e\u652f\u6301\u9ad8\u590d\u6742\u6570\u5b66\u8ba1\u7b97\u6216\u4e0d\u53ef\u63a7\u8ba1\u7b97\u903b\u8f91":158,"\u7528\u4e8e\u6a21\u62df":145,"\u7528\u4e8e\u751f\u6210\u91c7\u6837\u6570\u636e\u5e8f\u5217\u7684\u7b56\u7565\u548c\u7528\u4e8e\u5b9e\u9645\u51b3\u7b56\u7684\u5f85\u8bc4\u4f30\u548c\u6539\u8fdb\u7b56\u7565\u662f\u4e0d\u540c\u7684":196,"\u7528\u4e8e\u751f\u6210\u91c7\u6837\u6570\u636e\u5e8f\u5217\u7684\u7b56\u7565\u548c\u7528\u4e8e\u5b9e\u9645\u51b3\u7b56\u7684\u5f85\u8bc4\u4f30\u548c\u6539\u8fdb\u7b56\u7565\u662f\u76f8\u540c\u7684":196,"\u7528\u4e8e\u79bb\u6563\u52a8\u4f5c":164,"\u7528\u4e8e\u8fde\u7eed\u52a8\u4f5c":164,"\u7528\u53c2\u6570\u62df\u5408\u7b56\u7565\u51fd\u6570":196,"\u7528\u540e\u7ee7\u5404\u4e2a\u72b6\u6001\u7684\u4ef7\u503c\u4f30\u8ba1\u503c\u6765\u66f4\u65b0\u5f53\u524d\u67d0\u4e2a\u72b6\u6001\u7684\u4ef7\u503c\u4f30\u8ba1\u503c":196,"\u7528\u5904":164,"\u7528\u6237\u53ef\u5728":146,"\u7528\u6765\u5e2e\u52a9\u667a\u80fd\u4f53\u7684\u5b66\u4e60":196,"\u7528\u6765\u8ba1\u7b97\u7d2f\u79ef\u7684\u5956\u52b1":196,"\u7528\u6cd5":146,"\u7528baseenvinfo\u548cenvelementinfo":146,"\u7531\u4e8e":[143,145,150],"\u7531\u4e8e\u4e0d\u786e\u5b9a\u6bcf\u4e2a\u5b50\u73af\u5883":146,"\u7531\u4e8e\u4f7f\u7528\u4e86":143,"\u7531\u4e8e\u5176\u4e0e\u73af\u5883\u76f8\u5173":143,"\u7531\u4e8e\u524d\u9762\u63d0\u5230\u7684":164,"\u7531\u4e8e\u67d0\u4e9b\u8fd0\u884c\u73af\u5883\u4e2d\u7f3a\u5c11\u76f8\u5e94\u6743\u9650":139,"\u7531\u4e8e\u68af\u5ea6\u4e0b\u964d\u8981\u6c42\u7528\u4e8e\u6279\u6b21\u8bad\u7ec3\u7684\u6570\u636e\u7b26\u5408i":196,"\u7531\u4e8e\u8bbe\u5b9a":143,"\u7531\u4e8e\u8f68\u8ff9\u4e2d\u4e5f\u5305\u542b\u4e86\u73af\u5883\u7684dynamics\u6a21\u578b\u7684\u4fe1\u606f":196,"\u7531\u4e8e\u9010\u6e10\u589e\u5927\u7684\u6570\u636e\u6d41\u538b\u529b\u662f\u901a\u8fc7\u9010\u6e10\u964d\u4f4e\u7684":145,"\u7531\u9879\u76ee\u8d1f\u8d23\u4eba\u6216\u6307\u5b9a\u76f8\u5173\u540c\u4e8b\u8fdb\u884c":168,"\u7531learner\u8bad\u7ec3\u4e00\u4e2a\u8fed\u4ee3":156,"\u7565\u6162\u4e8e":143,"\u7684":[139,143,145,146,148,150,164,168],"\u76848080\u7aef\u53e3":153,"\u7684\u4e00\u4e2a\u53c2\u6570":145,"\u7684\u4e09\u500d":145,"\u7684\u4e0d\u540c\u5de5\u4f5c\u8d1f\u8f7d":145,"\u7684\u4f18\u52bf\u66f4\u52a0\u660e\u663e":145,"\u7684\u4f30\u8ba1\u4e5f\u662f\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u4e00\u4e2a\u4f18\u5316\u65b9\u5411":196,"\u7684\u4f7f\u7528":153,"\u7684\u5185\u5bb9\u8fdb\u884c":164,"\u7684\u521d\u59cb\u5316\u9700\u8981\u4f20\u5165\u6bcf\u4e2a":146,"\u7684\u533a\u522b":[146,164],"\u7684\u540d\u79f0":164,"\u7684\u566a\u58f0":164,"\u7684\u5730\u65b9\u6709\u4e09\u4e2a":164,"\u7684\u5730\u65b9\u6bd4\u8f83\u5c11":164,"\u7684\u57fa\u7c7b":164,"\u7684\u5927\u5c0f":145,"\u7684\u5b50\u73af\u5883":146,"\u7684\u5b50\u73af\u5883\u65f6":146,"\u7684\u5b50\u73af\u5883\u90fd\u6ca1\u6709\u5b8c\u6210":146,"\u7684\u5b50\u7c7b":164,"\u7684\u5b9a\u4e49":148,"\u7684\u5b9e\u4f8b":164,"\u7684\u5b9e\u4f8b\u5316\u51fd\u6570\u8fdb\u884c\u5305\u88c5":146,"\u7684\u5b9e\u4f8b\u5316\u63a5\u53e3":146,"\u7684\u5b9e\u4f8b\u5316\u8c03\u7528\u63a5\u53e3\u548c":146,"\u7684\u5b9e\u73b0\u903b\u8f91\u4e0d\u540c":143,"\u7684\u5b9e\u9645\u9700\u6c42":145,"\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u5305\u62ec\u4e24\u4e2a\u6b65\u9aa4":196,"\u7684\u601d\u60f3":148,"\u7684\u64cd\u4f5c":164,"\u7684\u6536\u76careturn\u5728\u72b6\u6001":196,"\u7684\u6570\u636e\u5168\u90e8\u88ab\u8bfb\u51fa":145,"\u7684\u6570\u636e\u653e\u5165":145,"\u7684\u6574\u6570":158,"\u7684\u65b9\u6cd5\u6dfb\u52a0\u5230":164,"\u7684\u65f6\u5019":164,"\u7684\u65f6\u5019\u4f1a\u81ea\u52a8\u6839\u636e":164,"\u7684\u65f6\u95f4":143,"\u7684\u6700\u5927\u91cd\u8bd5\u6b21\u6570":146,"\u7684\u672c\u8d28\u533a\u522b\u5728\u4e8e":196,"\u7684\u6d4b\u901f\u7ed3\u679c":145,"\u7684\u73af\u5883\u4e2d\u6027\u80fd\u4e0b\u964d\u5f97\u975e\u5e38\u660e\u663e":143,"\u7684\u76ee\u6807":168,"\u7684\u76f8\u5173\u4f7f\u7528\u5b58\u5728\u5f3a\u4f9d\u8d56":148,"\u7684\u76f8\u5173\u6a21\u5757\u4f1a\u8fdb\u884c\u76f8\u5e94\u5904\u7406":148,"\u7684\u79cd\u5b50\u63a7\u5236":148,"\u7684\u79cd\u7c7b\u81ea\u52a8\u4fee\u6539\u5bf9\u5e94\u7684":148,"\u7684\u7ed3\u679c":146,"\u7684\u8868\u73b0\u53ca\u89e6\u53d1\u573a\u666f":168,"\u7684\u8bad\u7ec3\u65f6\u95f4\u76f8\u543b\u5408":145,"\u7684\u8bad\u7ec3\u90e8\u5206\u53ef\u4ee5\u7b80\u5316\u5982\u4e0b":164,"\u7684\u8bbe\u8ba1\u521d\u8877":145,"\u7684\u8fc7\u7a0b":196,"\u7684\u8fd0\u884c\u6548\u7387":146,"\u7684\u901f\u5ea6\u662f":143,"\u7684\u952e\u503c\u5bf9":146,"\u7684\u957f\u671f\u671f\u671b\u6536\u76ca":196,"\u7684\u95f4\u9694\u65f6\u95f4":146,"\u7684\u96c6\u5408\u79f0\u4e4b\u4e3a\u52a8\u4f5c\u7a7a\u95f4":196,"\u76d1\u7763\u5b66\u4e60\u662f\u4ece\u6709\u6807\u7b7e\u7684\u6570\u636e\u96c6\u4e2d\u8fdb\u884c\u6a21\u5f0f\u548c\u7279\u5f81\u7684\u5b66\u4e60":196,"\u76ee\u524d\u4f9d\u8d56\u4e8e\u7279\u5b9a\u7684\u73af\u5883\u7248\u672c":150,"\u76ee\u524d\u5df2\u7ecf\u652f\u6301\u7684":164,"\u76ee\u524d\u652f\u6301\u7684\u73af\u5883\u7248\u672c\u662f":150,"\u76ee\u524d\u652f\u6301\u7684\u7c7b\u578b\u6709\u5355\u8fdb\u7a0b\u4e32\u884c\u548c\u591a\u8fdb\u7a0b\u5e76\u884c\u4e24\u79cd\u6a21\u5f0f":146,"\u76ee\u5f55\u4e0b\u6709\u6211\u4eec\u5df2\u7ecf\u63d0\u4f9b\u597d\u7684":150,"\u76f4\u5230\u7d2f\u79ef\u56de\u62a5\u7684\u671f\u671b\u6700\u5927":196,"\u76f4\u5230\u8bad\u7ec3\u7ed3\u675f":156,"\u76f4\u63a5\u4ece\u6700\u4f18\u4ef7\u503c\u51fd\u6570\u7684\u5b9a\u4e49\u51fa\u53d1":196,"\u76f4\u63a5\u5728\u672c\u8fdb\u7a0b\u4e2d\u8bfb\u53d6\u6570\u636e":145,"\u76f4\u63a5\u8fdb\u5165\u6d41\u7a0b5":145,"\u76f8\u4f3c\u7684\u5c01\u88c5":164,"\u76f8\u4f3c\u7684\u63a5\u53e3":146,"\u76f8\u5173\u4efb\u52a1":148,"\u76f8\u5bf9\u4e8e\u7b80\u5355\u76f4\u63a5\u7684\u4e32\u884c\u6a21\u5f0f":156,"\u76f8\u5f53\u4e8e":148,"\u76f8\u6bd4\u8f83dp\u5728\u9a6c\u5c14\u53ef\u592b\u6027\u4e0d\u6210\u7acb\u65f6\u635f\u5931\u8f83\u5c0f":196,"\u771f\u6b63\u7684\u4f18\u52bf\u73af\u5883\u4e3a\u591a\u673a\u89c4\u6a21\u5316\u5206\u5e03\u5f0f\u73af\u5883":153,"\u77e9\u9635\u6216\u9ad8\u9636\u5f20\u91cf\u6765\u8868\u793a\u72b6\u6001\u548c\u89c2\u5bdf\u7684\u7ed3\u679c":196,"\u786e\u5b9a\u52a0\u8fd9\u4e2a\u529f\u80fd\u662f\u5fc5\u987b\u4e14\u53ef\u884c\u7684":168,"\u786e\u5b9e\u662f\u63d0\u9ad8\u4e86":145,"\u7981\u6b62":168,"\u79bb\u5f00":196,"\u79cd\u7c7b":148,"\u79d2":[143,145],"\u7aef\u7528\u4e8e\u8bad\u7ec3\u4e4b\u95f4\u6240\u7ecf\u5386\u7684\u8fc7\u7a0b":145,"\u7aef\u8fde\u63a5":153,"\u7b14\u8bb0\u672c\u4e0a\u8fd0\u884cdemo":153,"\u7b2c\u4e00\u6b21":148,"\u7b49":150,"\u7b49\u4ef7\u4e8eint":158,"\u7b49\u51fd\u6570":164,"\u7b49\u53ef\u4ee5\u89c6\u4e3a\u73af\u5883\u5143\u7d20":148,"\u7b49\u5f85\u4e4b\u524d\u7684\u4efb\u52a1\u5b8c\u6210\u540e\u518d\u6267\u884c":153,"\u7b49\u5f85\u5176\u8bfb\u53d6\u6570\u636e":145,"\u7b49\u5f85\u76f4\u5230\u81f3\u5c11\u4e00\u4e2a\u73af\u5883\u8fd4\u56de\u4e86\u8fd0\u884c\u7ed3\u679c":146,"\u7b49\u5f85coordinator\u518d\u6b21\u5206\u914d\u65b0\u7684\u4efb\u52a1":156,"\u7b49\u5f85coordinator\u5206\u914d\u65b0\u7684\u4efb\u52a1":156,"\u7b49\u7684\u4e00\u7cfb\u5217\u65b9\u6cd5":153,"\u7b56\u7565\u4e0e\u8bad\u7ec3\u4fe1\u606f\u7684\u5b9a\u65f6\u5b58\u50a8\u6216\u53d1\u9001\u7684hook":156,"\u7b56\u7565\u4f18\u5316":196,"\u7b56\u7565\u662f\u6700\u4f18\u7684":196,"\u7b56\u7565\u66f4\u65b0":156,"\u7b56\u7565\u68af\u5ea6\u7684\u65b9\u6cd5\u5bb9\u6613\u6536\u655b\u5230\u5c40\u90e8\u6700\u5c0f\u503c":196,"\u7b56\u7565\u68af\u5ea6\u7684\u65b9\u6cd5\u9700\u8981\u5b66\u4e60\u53c2\u6570\u5316\u8868\u793a\u7684\u7b56\u7565":196,"\u7b56\u7565\u8bc4\u4f30\u4e0e\u7b56\u7565\u4f18\u5316":196,"\u7b80\u5199\u4e3a":143,"\u7b80\u5316\u8c03\u7528\u7684":164,"\u7b80\u5355\u5728conflicts\u53ef\u4ee5\u76f4\u63a5\u5728":168,"\u7b80\u5355\u6570\u5b66\u8fd0\u7b97":158,"\u7b80\u5355\u7684\u63cf\u8ff0\u4ea4\u4e92":196,"\u7b80\u5355\u7684\u6765\u8bf4":196,"\u7b97\u5b50\u652f\u6301\u524d\u5411":150,"\u7ba1\u7406\u4ee5\u53ca\u7ed3\u679c\u7684\u83b7\u53d6":153,"\u7c7b":153,"\u7c7b\u53d8\u91cf":[148,156],"\u7c7b\u578b":148,"\u7c7b\u578b\u5224\u65ad\u4e0e\u8f6c\u6362":158,"\u7c7b\u578b\u548c":146,"\u7c7b\u5c5e\u6027\u65b9\u6cd5":146,"\u7c7b\u63a5\u53e3\u65b9\u6cd5":[146,148,156],"\u7c7b\u66f4\u4e3a\u5feb\u901f\u65b9\u4fbf\u7684\u66f4\u6539":164,"\u7c7b\u6bd4\u5bf9slurm\u96c6\u7fa4\u7684\u7ef4\u62a4":153,"\u7c7b\u7ee7\u627f\u5173\u7cfb\u5982\u4e0b\u56fe\u6240\u793a":148,"\u7cfb\u7edf":150,"\u7cfb\u7edf\u4f7f\u7528":168,"\u7d2f\u79ef\u56de\u62a5\u7684\u671f\u671b\u6700\u5927":196,"\u7d2f\u79ef\u5956\u52b1":196,"\u7ebf\u7a0b":145,"\u7ebf\u7a0b\u5747\u5728\u5de5\u4f5c":145,"\u7ebf\u7a0b\u6765\u907f\u514d\u7a0b\u5e8f\u76f2\u7b49":143,"\u7ec4\u4ef6\u6253\u5305\u597d\u7684":150,"\u7ec4\u4ef6\u662f\u4e00\u4e2a\u52a0\u901f\u7b97\u5b50\u7ec4\u4ef6":150,"\u7ec4\u6210\u56db\u4e2a\u5f85\u6d4b\u8bd5\u7684\u7ec4\u4ef6":143,"\u7ecf\u5e38\u4f7f\u7528":196,"\u7ecf\u9a8c\u56de\u653e\u6280\u672f":196,"\u7ecf\u9a8c\u56de\u653e\u6c60\u66f4\u65b0\u7b49":156,"\u7ed3\u5408\u4e0a\u6587\u4e2dslave\u7684\u4f8b\u5b50":153,"\u7ed3\u5408\u4e86\u4ee5\u4e0a\u4e24\u79cd\u65b9\u6cd5\u7684\u4f18\u70b9":196,"\u7ed3\u675f\u65f6":148,"\u7ed3\u675f\u65f6\u5c06\u8fd4\u56de\u503c\u4fdd\u5b58\u8d77\u6765":146,"\u7ed3\u6784\u7684":146,"\u7ed3\u679c\u540e":146,"\u7ed3\u679c\u8868\u660e":[143,145],"\u7ed9learner":156,"\u7edd\u5bf9\u4e0d\u8981\u628a\u5927\u5bb9\u91cf\u4e8c\u8fdb\u5236\u6587\u4ef6\u5d4c\u5165git":168,"\u7edf\u4e00\u653e\u5728":164,"\u7ee7\u627f":164,"\u7ee7\u627f\u4e86":148,"\u7ee7\u627f\u4e86baseenvmanag":146,"\u7ef4\u62a4\u9759\u6001\u7684\u5c5e\u6027\u548c\u65b9\u6cd5":148,"\u7f3a\u70b9":196,"\u7f51\u7edc\u7aef\u53e3\u7b49":153,"\u7f51\u7edc\u89c4\u6a21\u9012\u51cf":145,"\u8003\u8651\u5230":153,"\u8003\u8651\u5230learner\u53ef\u80fd\u9700\u8981\u5728\u6574\u4e2a\u8bad\u7ec3\u524d\u540e":156,"\u800c":[143,145,153,158,164],"\u800c\u52a8\u6001\u89c4\u5212\u5c5e\u4e8emodel":196,"\u800c\u5728":156,"\u800c\u5728\u4e4b\u540e\u7684\u8bad\u7ec3\u4e2d\u53d6\u51fabuffer\u4e2d\u7684experience\u4f7f\u7528":196,"\u800c\u5728\u7b56\u7565\u641c\u7d22\u65b9\u6cd5\u4e2d":196,"\u800c\u5bf9\u4e8e\u4e1a\u52a1\u5f02\u5e38":153,"\u800c\u5bf9\u4e8eslave\u7c7b\u7684\u8c03\u7528":153,"\u800c\u5f88\u591a\u60c5\u51b5\u4e0b":196,"\u800c\u662f\u4f1a\u5728":146,"\u800c\u662f\u5efa\u7acb\u5728\u73af\u5883feedback\u7684\u57fa\u7840\u4e0a":196,"\u800c\u662f\u76f4\u63a5\u4f7f\u7528fix":196,"\u800c\u6dfb\u52a0\u4e86\u4f4d\u7f6eposition\u8fd9\u4e00\u5c5e\u6027":156,"\u800c\u7528\u6237\u53ef\u4ee5\u5728\u94a9\u5b50\u4e2d\u5b9e\u73b0\u81ea\u5df1\u6240\u9700\u8981\u7684\u529f\u80fd":164,"\u800cactor":196,"\u800ccomm":156,"\u800cexploitation\u5219\u662fagent\u9700\u8981\u53bb\u9009\u62e9\u5f53\u524d\u72b6\u6001\u4e0b\u5c3d\u53ef\u80fd\u7684\u6536\u76ca\u9ad8\u7684\u52a8\u4f5c":196,"\u800cmodel":196,"\u800cmujoco\u7b49\u4e00\u4e9b\u673a\u5668\u4eba\u8fde\u7eed\u63a7\u5236\u4efb\u52a1\u4e2d\u4e3a\u8fde\u7eed\u52a8\u4f5c\u7a7a\u95f4":196,"\u800ctd":196,"\u8017\u65f6":168,"\u81ea\u52a8\u8c03\u7528\u94a9\u5b50\u5185\u5b9a\u4e49\u597d\u7684\u51fd\u6570":164,"\u81ea\u5b9a\u4e49":164,"\u81ea\u7136\u65f6\u95f4":142,"\u81ea\u7531":158,"\u81ea\u884c\u4ecedataloader\u83b7\u53d6\u6570\u636e":156,"\u81ea\u8eab\u5bf9\u5916\u754c\u8f93\u5165\u8d28\u7591":148,"\u81ea\u8eab\u5bf9\u5916\u754c\u8f93\u51fa\u8d1f\u8d23":148,"\u81f3":143,"\u81f3\u4e8e\u4ec0\u4e48\u662f\u56de\u8c03\u51fd\u6570\u53ca\u56de\u8c03\u51fd\u6570\u662f\u7528\u6765\u505a\u4ec0\u4e48\u7684":156,"\u81f3\u4e8e\u5b9e\u9645\u4efb\u52a1\u7684\u5206\u914d\u4e0e\u6267\u884c":156,"\u81f3\u672c\u5730\u4e4b\u540e":168,"\u81f3\u6b64":164,"\u82e5":145,"\u82e5\u4e3a0\u62161\u8868\u660e\u4e0d\u4f7f\u7528\u591a\u8fdb\u7a0b":145,"\u82e5\u4e3a\u5927\u4e8e1\u7684\u6570\u5219\u8868\u660e\u4f7f\u7528\u591a\u8fdb\u7a0b":145,"\u82e5\u4e3a\u6570\u636e":145,"\u82e5\u5176\u4e3a\u7a7a":156,"\u82e5\u6210\u529f\u5b89\u88c5\u540e":150,"\u82e5\u6240\u6709\u73af\u5883\u5747\u5728\u8fd0\u884c\u4e0a\u4e00\u4e2a\u547d\u4ee4":146,"\u82e5\u6307\u5b9a\u9700\u8981":145,"\u82e5\u662f":146,"\u82e5\u679cslave\u7aef\u5df2\u7ecf\u6709\u4e00\u4e2a\u4efb\u52a1\u6b63\u5728\u8fd0\u884c":153,"\u82e5\u8981\u5173\u95ed\u8be5\u7279\u6027":146,"\u82e5\u8ba4\u4e3a\u5f53\u503c\u51fd\u6570\u6700\u4f18\u65f6":196,"\u82e5\u968f\u673a\u53d8\u91cf\u5e8f\u5217\u4e2d\u7684\u6bcf\u4e2a\u72b6\u6001\u90fd\u662f\u9a6c\u5c14\u79d1\u592b\u7684\u5219\u79f0\u6b64\u968f\u673a\u8fc7\u7a0b\u4e3a\u9a6c\u5c14\u79d1\u592b\u968f\u673a\u8fc7\u7a0b":196,"\u83b7\u53d6\u6570\u636e":145,"\u83b7\u53d6\u6570\u636e\u7684\u51fd\u6570":156,"\u83b7\u53d6\u6570\u636e\u8bfb\u53d6\u4efb\u52a1":145,"\u8499\u7279\u5361\u6d1b\u548ctd\u7b97\u6cd5\u96b6\u5c5e\u4e8emodel":196,"\u8499\u7279\u5361\u6d1b\u65b9\u6cd5":196,"\u867d\u7136\u5bf9\u6574\u4f53\u7b56\u7565\u7684\u66f4\u65b0\u66f4\u7a33\u5b9a\u4f46\u662f\u964d\u4f4e\u4e86\u5b66\u4e60\u7684\u6548\u7387":196,"\u867d\u7136\u63d0\u4f9b\u4e86\u8bad\u7ec3\u63a5\u53e3":156,"\u884c\u4e3a\u4ef7\u503c\u51fd\u6570":196,"\u8868\u793a\u4e3a":196,"\u8868\u793a\u53c2\u6570":196,"\u8868\u793a\u73af\u5883\u8dd1\u5b8c\u4e00\u4e2a":148,"\u8868\u793a\u73af\u5883\u8fd0\u884c\u8be5\u6b65\u662f\u662f\u5426\u53d1\u751f\u4e86\u9519\u8bef":148,"\u8870\u51cf\u56e0\u5b50\u4f53\u73b0\u7684\u662f\u672a\u6765\u7684\u5956\u52b1\u5728\u5f53\u524d\u65f6\u523b\u7684\u4ef7\u503c\u6bd4\u4f8b":196,"\u8870\u51cf\u56e0\u5b50\u7684\u5f15\u5165\u4e0d\u4f46\u5728\u6570\u5b66\u8868\u8fbe\u4e0a\u66f4\u65b9\u4fbf":196,"\u88ab\u5e7f\u6cdb\u5e94\u7528\u4e8e\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u4e2d":196,"\u89c2\u5bdf\u7a7a\u95f4\u7684\u7ef4\u5ea6\u7b49\u7b49":148,"\u89c4\u6a21":145,"\u89c6\u7ebf\u56de\u5230comm":156,"\u89c6\u7ebf\u56de\u5230coordin":156,"\u89c6\u7ebf\u56de\u5230learner":156,"\u89e3\u51b3mdp\u95ee\u9898\u7684\u5e38\u7528\u65b9\u6cd5":196,"\u8ba1\u7b97":158,"\u8ba1\u7b97\u5f97\u51fa\u4e00\u4e2a\u65b0\u7684loader":158,"\u8ba1\u7b97x":158,"\u8bad\u7ec3":150,"\u8bad\u7ec3\u4e00\u4e2a\u80fd\u4e3b\u52a8\u9009\u62e9\u81ea\u5df1\u7684\u52a8\u4f5c":196,"\u8bad\u7ec3\u4e00\u4e2a\u8fed\u4ee3":156,"\u8bad\u7ec3\u4efb\u52a1\u4f1a\u5206\u4e3a\u5982\u4e0b\u51e0\u79cd\u60c5\u51b5":153,"\u8bad\u7ec3\u4efb\u52a1\u5b8c\u6210\u4e4b\u540e":164,"\u8bad\u7ec3\u4efb\u52a1\u5f00\u59cb\u4e4b\u524d":164,"\u8bad\u7ec3\u591a\u4e2a\u8fed\u4ee3":156,"\u8bad\u7ec3\u5b8c\u6210\u540e":156,"\u8bad\u7ec3\u5b8c\u6bd5\u7684\u65f6\u5019\u4f1a\u5b58\u4e00\u6b21ckpt":164,"\u8bb2\u5f97\u8db3\u591f\u6df1\u5165":168,"\u8bbe\u4e3a8":145,"\u8bbe\u5b9a\u5177\u4f53\u7684\u8fd0\u884c\u7ec6\u8282":146,"\u8bbe\u7f6e":146,"\u8bbe\u7f6e\u4e3a":168,"\u8bbe\u7f6e\u73af\u5883\u968f\u673a\u79cd\u5b50":146,"\u8bbe\u8ba1\u4e86":145,"\u8bc4\u4f30\u5355\u4e2a\u7b56\u7565\u65f6\u5e76\u4e0d\u5145\u5206":196,"\u8bd5\u56fe\u83b7\u53d6\u6570\u636e":156,"\u8be5\u4efb\u52a1\u53ef\u4ee5\u4fdd\u8bc1":143,"\u8be5\u5c5e\u6027\u4f1a\u5224\u65ad\u6240\u6709\u5b50\u73af\u5883\u7684\u5b8c\u6210\u60c5\u51b5":146,"\u8be5\u5c5e\u6027\u53d6\u503c\u5fc5\u987b\u4e3a\u7c7b\u53d8\u91cfpositions\u4e2d\u7684\u4e00\u4e2a":156,"\u8be5\u5f02\u5e38\u53ea\u80fd\u6355\u6349\u975e\u4e1a\u52a1\u5f02\u5e38":153,"\u8be5\u60c5\u51b5\u5e76\u4e0d\u4e3b\u8981\u8ba8\u8bba":145,"\u8be5\u6270\u52a8\u670d\u4ece\u5e73\u5747\u5206\u5e03":143,"\u8be5\u65b9\u6cd5\u4f1a\u5b89\u5168\u5730\u5173\u95ed\u6240\u6709\u7684\u5b50\u73af\u5883":146,"\u8be5\u65b9\u6cd5\u4f1a\u6309\u7167\u4f20\u5165\u7684":146,"\u8be5\u65b9\u6cd5\u4f1a\u68c0\u67e5\u8fd0\u884c\u7ed3\u679c":146,"\u8be5\u65b9\u6cd5\u4f1a\u7b49\u5f85\u8fd9\u4e9b\u5b50\u73af\u5883\u7684\u4e0a\u4e00\u6b21":146,"\u8be5\u65b9\u6cd5\u4f20\u5165\u7684\u53c2\u6570\u662f\u4e00\u4e2a":146,"\u8be5\u65b9\u6cd5\u53ef\u9009\u5b9e\u73b0":148,"\u8be5\u6846\u67b6\u96c6\u6210\u4e86\u503c\u51fd\u6570\u4f30\u8ba1\u7b97\u6cd5\u548c\u7b56\u7565\u641c\u7d22\u7b97\u6cd5":196,"\u8be5\u7c7b\u53ca\u5176\u5b50\u7c7b\u662f":148,"\u8be5\u7c7b\u53ca\u5176\u5b50\u7c7b\u8d1f\u8d23\u67d0\u4e00\u5177\u4f53\u73af\u5883\u5143\u7d20\u7684\u57fa\u672c\u4fe1\u606f\u548c\u5904\u7406\u51fd\u6570\u5b9a\u4e49":148,"\u8be5\u7c7b\u5c06\u5bf9\u5e94\u7684\u9759\u6001\u73af\u5883\u5143\u7d20\u5b9e\u4f8b\u4f5c\u4e3a\u81ea\u5df1\u7684\u4e00\u4e2a\u6210\u5458\u53d8\u91cf":148,"\u8be5\u7c7b\u662f":164,"\u8be5\u7c7b\u662f\u6240\u6709":164,"\u8be5\u7c7b\u7684\u552f\u4e00\u6807\u8bc6\u540d":148,"\u8be5\u884c\u4e3a\u4e0d\u5e94\u8be5\u5728":148,"\u8be5\u90e8\u5206\u4e5f\u53ef\u81ea\u7531\u9009\u62e9":148,"\u8be5\u952e\u503c\u975e\u5fc5\u987b":148,"\u8be6\u7ec6\u7684\u53c2\u6570\u4fe1\u606f\u53ef\u53c2\u8003":139,"\u8bf7\u4ecd\u7136\u5728\u539f\u4ee3\u7801\u4ed3\u5e93\u63d0\u4e00\u4e2a":168,"\u8bf7\u4f7f\u7528\u5bf9\u5e94\u7684\u5f02\u5e38\u7c7b\u5df2\u7ecf\u6355\u6349":153,"\u8bf7\u5148\u7ebf\u4e0b\u548c\u4ee3\u7801\u5e93\u7684\u8d1f\u8d23\u4eba\u804a\u4e00\u4e0b\u4f60\u7684\u610f\u56fe":168,"\u8bf7\u6c42":145,"\u8bf7\u6ce8\u610f\u52a0\u4e0a":158,"\u8bf7\u6ce8\u610f\u5728\u5b9e\u9645\u4f7f\u7528\u7684\u65f6\u5019":158,"\u8bf7\u7279\u522b\u7559\u610f":168,"\u8bf7\u7ee7\u627fmaster\u7c7b":153,"\u8bf7\u7ee7\u627fslave\u7c7b\u5e76\u5b9e\u73b0":153,"\u8bf7\u7ee7\u7eed\u9605\u8bfb":156,"\u8bf7\u81ea\u884c\u786e\u8ba4\u4e0d\u4f1a\u6709\u8d44\u6e90\u6d6a\u8d39\u6216\u51b2\u7a81\u7684\u60c5\u51b5\u53d1\u751f":148,"\u8bfb\u51fa\u7684\u6570\u636e\u6309\u7167\u539f\u6765\u7684":145,"\u8bfb\u53d6\u5e76\u9884\u5904\u7406\u6570\u636e":145,"\u8bfb\u53d6\u6a21\u578b\u7684\u68c0\u67e5\u70b9":164,"\u8c03\u7528":[146,156,164],"\u8c03\u7528\u5728":146,"\u8c03\u7528\u60c5\u51b5":164,"\u8c03\u7528\u65b9\u6cd5\u4e5f\u66f4\u4e3a\u7b80\u5355":164,"\u8c03\u7528\u6700\u5916\u5c42\u7684model":164,"\u8c03\u7528\u6d41\u7a0b":164,"\u8c03\u7528\u7236\u7c7b\u7684\u8be5\u65b9\u6cd5":148,"\u8c03\u7528\u8be5\u4f4d\u7f6e\u6240\u6709hook":156,"\u8c03\u7528\u8be5\u65b9\u6cd5\u540e":146,"\u8c03\u7528hook\u4fdd\u5b58checkpoint":156,"\u8c03\u7528hook\u8981\u6267\u884c\u7684\u51fd\u6570":156,"\u8d1d\u5c14\u66fc\u65b9\u7a0b\u662f\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u7684\u57fa\u7840":196,"\u8d1d\u5c14\u66fc\u65b9\u7a0b\u8868\u793a\u5f53\u524d\u72b6\u6001\u7684\u4ef7\u503c\u4e0e\u4e0b\u4e00\u4e2a\u72b6\u6001\u7684\u4ef7\u503c":196,"\u8d1f\u8d23\u548ccoordinator\u901a\u4fe1":156,"\u8d1f\u8d23\u8fd0\u884c\u65f6\u76f8\u5173\u7684\u72b6\u6001\u7ba1\u7406":148,"\u8d1f\u8f7d\u624d\u83b7\u5f97\u4e86\u5982\u6b64\u4f18\u79c0\u7684\u6027\u80fd\u63d0\u5347":145,"\u8d1f\u8f7d\u738720":145,"\u8d1f\u8f7d\u76f8\u5bf9\u7a33\u5b9a":145,"\u8d1f\u8f7d\u7a33\u5b9a\u4fdd\u6301\u5728":143,"\u8d1f\u8f7d\u7ea6\u4e3a":145,"\u8ddf\u8fdb\u81ea\u5df1\u7684\u8fdb\u5c55":168,"\u8ddf\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u4e0d\u540c\u7684\u662f":196,"\u8de8\u7ec4\u4ed3\u5e93\u63a8\u8350\u7528fork":168,"\u8f68\u8ff9\u6570\u636e\u4e2d\u5305\u542b\u4e86\u73af\u5883\u7684transition\u65b9\u7a0b":196,"\u8f68\u8ff9\u6570\u636e\u6587\u4ef6\u5927\u5c0f\u4e5f\u5404\u4e0d\u76f8\u540c":145,"\u8f6c\u4e3aloader":158,"\u8f6c\u6362\u4e0e\u9a8c\u8bc1":158,"\u8f6c\u6362\u503c\u8fd8\u539f":158,"\u8f83\u4e3a\u590d\u6742\u7684\u9700\u8981\u5728\u672c\u5730fetch\u76ee\u6807\u5206\u652f\u7684\u6539\u52a8\u4e4b\u540e":168,"\u8f93\u5165":164,"\u8fc7\u7a0b":143,"\u8fd0\u7528\u5b66\u5230\u7684\u6a21\u578b\u6765\u8fdb\u884cplanning\u83b7\u53d6\u65b0\u7684\u6570\u636e":196,"\u8fd0\u884c\u591a\u4e2a\u73af\u5883\u7684\u5b9e\u4f8b":146,"\u8fd0\u884c\u5b8c\u6bd5\u518d\u8fd0\u884c\u6b64\u6b21":146,"\u8fd0\u884c\u5e73\u53f0\u662f16gv100":150,"\u8fd0\u884c\u65e5\u5fd7\u6587\u4ef6\u7b49":168,"\u8fd0\u884c\u7684":146,"\u8fd0\u884c\u7ed3\u675f\u540e\u5bf9\u5e94\u7684":146,"\u8fd0\u884c\u81f3":146,"\u8fd1\u89c6":196,"\u8fd4\u56de":146,"\u8fd4\u56de\u503c":148,"\u8fd4\u56de\u5168\u90e8\u8fd0\u884c\u7ed3\u679c":146,"\u8fd4\u56de\u5b8c\u6210\u4e86\u4e0a\u4e00\u4e2a":146,"\u8fd4\u56de\u6240\u6709\u672a\u8fd0\u884c\u7ed3\u675f\u7684\u73af\u5883":146,"\u8fd4\u56de\u63d0\u4f9b\u5143\u7d20\u8bf4\u660e\u7684\u5b57\u7b26\u4e32":148,"\u8fd4\u56de\u8be5\u5143\u7d20\u7c7b\u7684\u57fa\u672c\u4fe1\u606f\u548c\u5904\u7406\u51fd\u6570":148,"\u8fd8\u6709\u5fc5\u8981\u4ecb\u7ecd\u4e00\u4e0blearnerslav":156,"\u8fd8\u6709\u66f4\u591a\u7684\u4e00\u4e9b\u529f\u80fd\u548c\u7528\u6cd5":153,"\u8fd8\u9488\u5bf9\u7ec6\u8282\u505a\u4e86\u4e00\u4e9b\u6539\u52a8":148,"\u8fd9\u4e00\u4f7f\u7528flask\u53ca\u6587\u4ef6\u7cfb\u7edf\u8fdb\u884c\u901a\u4fe1\u7684comm":156,"\u8fd9\u4e00\u500d\u7387\u8303\u56f4\u5185\u968f\u673a\u6d6e\u52a8":143,"\u8fd9\u4e00\u6bd4\u4f8b":145,"\u8fd9\u4e00\u70b9\u4e5f\u4e0e\u5176\u76f8\u8f83\u4e8e":145,"\u8fd9\u4e00\u771f\u6b63\u8d1f\u8d23\u548ccoordinator\u8fdb\u884c\u901a\u4fe1\u7684\u7c7b":156,"\u8fd9\u4e00\u8282\u4e3b\u8981\u5217\u4e00\u4e9b\u5728\u4f7f\u7528":168,"\u8fd9\u4e24\u4e2a\u65f6\u95f4\u5747\u4e3a\u591a\u6b21\u91cd\u590d\u5b9e\u9a8c\u6d4b\u5f97":145,"\u8fd9\u4e24\u8005\u7684\u5dee\u5f02\u5728\u4e8e":158,"\u8fd9\u4e2a":148,"\u8fd9\u4e2a\u5b57\u5178\u4e2d":164,"\u8fd9\u4e2a\u7c7b\u7684\u4e1a\u52a1\u903b\u8f91\u4e3a":153,"\u8fd9\u4e2a\u8fc7\u7a0b\u53ef\u80fd\u5bf9short":196,"\u8fd9\u4e2a\u8fc7\u7a0b\u5faa\u73af\u53d1\u751f":196,"\u8fd9\u4e5f\u662f\u76ee\u524dmodel":196,"\u8fd9\u4e9b\u4fe1\u606f\u90fd\u4f20\u5230\u4e86learner":156,"\u8fd9\u4e9b\u64cd\u4f5c\u5c06\u4ee5hook\u7684\u65b9\u5f0f\u5b8c\u6210":156,"\u8fd9\u4e9b\u6587\u4ef6\u53ef\u80fd\u4f1a\u5e26\u6765\u591a\u79cd\u591a\u6837\u7684\u95ee\u9898":168,"\u8fd9\u4e9b\u6d4b\u8bd5\u4f1a\u8fd0\u884c\u539f\u59cb\u7248\u672c\u57fa\u4e8epytorch":150,"\u8fd9\u4efd\u6587\u6863\u65e8\u5728\u7ed9\u4e86\u89e3":168,"\u8fd9\u5c31\u662fexploit":196,"\u8fd9\u5c31\u7528\u5230\u4e86\u6211\u4eec\u521a\u521a\u63d0\u5230\u7684":156,"\u8fd9\u6837\u4e3b\u8981\u662f\u4e3a\u4e86\u9632\u6b62\u516c\u5171\u4ee3\u7801\u5e93\u5206\u652f\u6df7\u4e71":168,"\u8fd9\u6837\u5b9e\u73b0\u662f\u4e3a\u4e86\u8ba9\u5b50\u7c7b\u8c03\u7528\u65b9\u6cd5":148,"\u8fd9\u6837\u5f53\u4ee3\u7801\u8fd0\u884c\u5230\u6307\u5b9a\u4f4d\u7f6e\u7684\u65f6\u5019":164,"\u8fd9\u6837\u7684\u5199\u6cd5":158,"\u8fd9\u6837\u7684\u8bdd":168,"\u8fd9\u7c7b\u73af\u5883":143,"\u8fd9\u90e8\u5206\u7684":164,"\u8fd9\u91cc\u4e3b\u8981\u5206\u4e24\u79cd\u60c5\u51b5":168,"\u8fd9\u91cc\u662fvalueerror":158,"\u8fd9\u91cc\u6709\u4e0b\u9762\u51e0\u4e2a\u5efa\u8bae":168,"\u8fd9\u91cc\u8bf4\u7684\u4e8c\u6b21\u7ee7\u627f\u662f\u6307":153,"\u8fdb\u5165\u6d41\u7a0b2":145,"\u8fdb\u5165\u6d41\u7a0b3":145,"\u8fdb\u5165\u6d41\u7a0b4":145,"\u8fdb\u7a0b":145,"\u8fdb\u7a0b\u5217\u8868":145,"\u8fdb\u7a0b\u5217\u8868\u4e2d\u7684\u6bcf\u4e00\u4e2a\u5143\u7d20":145,"\u8fdb\u7a0b\u5217\u8868\u4e5f\u4e0d\u4f1a\u88ab\u521d\u59cb\u5316":145,"\u8fdb\u7a0b\u90fd\u4ece":145,"\u8fdb\u884c":146,"\u8fdb\u884c\u4e86\u5bf9\u6bd4":143,"\u8fdb\u884c\u4e86\u5f02\u5e38\u7c7b\u7684\u5f52\u7c7b":153,"\u8fdb\u884c\u4e86\u6d4b\u901f\u5b9e\u9a8c":143,"\u8fdb\u884c\u4e86\u901f\u5ea6\u4e0a\u7684\u5bf9\u6bd4":145,"\u8fdb\u884c\u521b\u5efa":148,"\u8fdb\u884c\u52a0\u901f":146,"\u8fdb\u884c\u5404\u4e2a\u5b57\u6bb5\u7684\u8bb0\u5f55\u548c\u5206\u6790":142,"\u8fdb\u884c\u5b58\u50a8\u53ca\u8fde\u63a5":145,"\u8fdb\u884c\u5f53\u524d\u8fed\u4ee3\u7684\u8bad\u7ec3":156,"\u8fdb\u884c\u5feb\u901f\u521b\u5efa\u548c\u8d44\u6e90\u56de\u6536":153,"\u8fdb\u884c\u5feb\u901f\u8c03\u7528":153,"\u8fdb\u884c\u64cd\u4f5c":164,"\u8fdb\u884c\u6ce8\u518c":164,"\u8fdb\u884c\u6dfb\u52a0":164,"\u8fdb\u884c\u7b56\u7565\u7684\u4ef7\u503c\u8bc4\u4f30":196,"\u8fdb\u884c\u7b56\u7565\u8fed\u4ee3\u7684\u8ba1\u7b97":196,"\u8fdb\u884c\u7ba1\u7406":148,"\u8fdb\u884c\u8ba8\u8bba\u6216code":168,"\u8fdb\u884c\u8bad\u7ec3":156,"\u8fdb\u884c\u963b\u585e\u63a7\u5236":153,"\u8fde\u63a5\u8d85\u65f6\u7b49":153,"\u8fed\u4ee3\u66f4\u65b0\u7b56\u7565\u53c2\u6570\u503c":196,"\u9009\u62e9\u9891\u9053":153,"\u9009\u9879":139,"\u9009\u9879\u4f1a\u5bfc\u81f4\u65e0\u6cd5\u4f7f\u7528cli":139,"\u901a\u4fe1":156,"\u901a\u5e38":148,"\u901a\u8fc7":[146,158,164],"\u901a\u8fc7\u4e0a\u8ff0\u8c03\u7528\u540e":153,"\u901a\u8fc7\u4e0b\u9762\u7684\u4ee3\u7801\u5373\u53ef\u5f97\u5230\u6240\u9700":164,"\u901a\u8fc7\u4eff\u771f\u8f68\u8ff9\u4f30\u8ba1\u503c\u51fd\u6570\u8fdb\u800c\u4f18\u5316\u7b56\u7565":196,"\u901a\u8fc7\u4f7f\u7528replai":196,"\u901a\u8fc7\u5728\u5b50\u8fdb\u7a0b\u4e2d\u8fd0\u884c":146,"\u901a\u8fc7\u5b50\u8fdb\u7a0b\u5411\u91cf\u5316\u7684\u65b9\u5f0f":146,"\u901a\u8fc7\u5faa\u73af\u4e32\u884c":146,"\u901a\u8fc7\u7ba1\u9053\u5411":145,"\u901a\u8fc7\u7ed9\u5b9a\u7684":148,"\u901a\u8fc7\u8be5\u5b9e\u4f8b":164,"\u901a\u8fc7\u8c03\u7528":146,"\u901a\u8fc7\u903b\u8f91\u7ec4\u5408\u7b49\u65b9\u5f0f":158,"\u901a\u8fc7\u91c7\u6837\u5148\u5b66\u4e60\u4e00\u4e2a\u5bf9\u73af\u5883\u7684\u5efa\u6a21":196,"\u901a\u8fc7\u91c7\u6837\u6765\u76f4\u63a5\u5bf9\u4e8e\u6700\u4f18\u4ef7\u503c\u51fd\u6570\u8fdb\u884c\u65e0\u504f\u4f30\u8ba1":196,"\u901a\u8fc7\u91cd\u5199":153,"\u903b\u8f91\u7ec4\u5408":158,"\u90a3\u4e48":[168,196],"\u90a3\u4e48\u57fa\u4e8e\u503c\u51fd\u6570\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u65e0\u6cd5\u5b66\u4e60\u5230\u8fd9\u6837\u7684\u7b56\u7565":196,"\u90a3\u4e48\u6a21\u578b\u6bd4\u8f83\u5bb9\u6613\u9677\u5165\u5c40\u90e8\u6700\u4f18":196,"\u90a3\u6837\u53bb\u4f7f\u7528":164,"\u90e8\u5206\u4e3a\u8be5":164,"\u90e8\u5206\u8fd0\u884c\u73af\u5883\u4f1a\u5c06cli\u5b89\u88c5\u5728\u7528\u6237\u76ee\u5f55\u4e0b":139,"\u90e8\u5206\u8fd0\u884c\u73af\u5883\u4f7f\u7528pip\u5b89\u88c5\u65f6\u6307\u5b9a":139,"\u90fd\u6bd4":145,"\u90fd\u8c03\u7528":156,"\u914d\u7f6e\u4e0e\u4f7f\u7528\u5982\u4e0b":164,"\u914d\u7f6e\u6587\u4ef6\u5939":168,"\u91c7\u53d6\u52a8\u4f5c":196,"\u91ca\u653e\u5168\u90e8\u8d44\u6e90":146,"\u91ca\u653e\u8d44\u6e90":146,"\u91cc\u9762\u7528\u5230\u7684":164,"\u91cd\u542f\u65f6\u5bf9\u5e94\u8fdb\u884c\u8c03\u7528":148,"\u91cd\u542f\u72b6\u6001":148,"\u91cd\u590d":143,"\u91cf\u5316\u4ea4\u6613\u7b49\u9886\u57df":196,"\u9488\u5bf9":143,"\u9488\u5bf9\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u4e2d\u8f83\u901a\u7528\u7684\u7b97\u6cd5\u6a21\u5757":150,"\u94a9\u5b50":164,"\u94a9\u5b50\u4e2d\u5b9a\u4e49\u597d\u7684\u51fd\u6570\u4f1a\u88ab\u81ea\u52a8\u8c03\u7528":164,"\u94a9\u5b50\u4f1a\u88ab\u89e6\u53d1":164,"\u9500\u6bc1\u5b50\u73af\u5883\u5f00\u8f9f\u7684\u8fdb\u7a0b":146,"\u9500\u6bc1\u73af\u5883\u5b50\u8fdb\u7a0b":146,"\u952e\u503c\u4e3a\u8be5\u5b50\u73af\u5883\u7684":146,"\u952e\u503c\u5bf9":148,"\u957f\u5ea6\u4e3a1\u7684\u961f\u5217":156,"\u9605\u8bfb":168,"\u963b\u585e":156,"\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1":153,"\u963b\u585e\u5728":145,"\u963b\u585e\u591a\u7ebf\u7a0b\u4efb\u52a1":153,"\u9644\u8fd1\u5c0f\u5e45\u6ce2\u52a8":145,"\u964d\u4f4e\u4e86\u65b9\u5dee\u5e76\u52a0\u5feb\u4e86\u5b66\u4e60":196,"\u964d\u4f4e\u8fdc\u671f\u5229\u76ca\u7684\u4e0d\u786e\u5b9a\u6027":196,"\u9664\u4e86\u5728":143,"\u9664\u6b64\u4e4b\u5916":196,"\u9664\u975e\u5fc5\u8981":168,"\u9664\u975e\u7d2f\u8ba1\u8fd0\u884c\u7684":146,"\u9664\u975e\u91cd\u65b0":146,"\u968f\u65f6\u95f4\u6ce2\u52a8\u975e\u5e38\u5927":145,"\u968f\u673a\u62bd\u6837\u5f97\u5230\u7684\u6570\u636e\u5c31\u80fd\u63a5\u8fd1i":196,"\u968f\u673a\u7b56\u7565\u5c06\u4f1a\u4f18\u4e8e\u786e\u5b9a\u6027\u7684\u7b56\u7565":196,"\u96c6\u5408\u5904\u7406\u65e5\u5fd7":164,"\u9700\u4f7f\u7528":146,"\u9700\u8981":146,"\u9700\u8981\u4f20\u5165\u5177\u4f53":148,"\u9700\u8981\u4fdd\u8bc1batch":145,"\u9700\u8981\u5728":148,"\u9700\u8981\u5728\u73af\u5883info\u51fd\u6570\u4e2d":146,"\u9700\u8981\u5b8c\u6210\u4ee5\u4e0b\u51e0\u6b65":164,"\u9700\u8981\u63d0\u4f9b":164,"\u9700\u8981\u6536\u96c6\u81f3\u5c11":143,"\u9700\u8981\u7684\u65f6\u95f4":146,"\u9700\u8981\u7b49\u5f85":143,"\u9700\u8981\u7b49\u5f85\u5168\u90e8":143,"\u9700\u8981\u7ee7\u7eed\u8fed\u4ee3":156,"\u9700\u8981\u901a\u8fc7":168,"\u9700\u8981\u9a8c\u8bc1cli\u7684\u5b89\u88c5\u76ee\u5f55\u662f\u5426\u5728\u4f7f\u7528\u8005\u7684\u73af\u5883\u53d8\u91cf\u4e2d":139,"\u975e\u963b\u585e\u591a\u7ebf\u7a0b\u4efb\u52a1":153,"\u975ehttp\u72b6\u6001\u7801":153,"\u9875\u9762\u63cf\u8ff0":168,"\u9879\u76ee\u7ef4\u62a4\u8005\u4e4b\u5916\u7684\u4eba\u76f4\u63a5\u66f4\u65b0":168,"\u9996\u5148\u5efa\u7acblearner":156,"\u9996\u5148\u662f\u6574\u4f53\u6d41\u7a0b\u6240\u7528\u5168\u90e8\u65f6\u95f4":145,"\u9996\u5148\u662f\u901a\u8fc7\u5e38\u89c4\u65b9\u5f0f\u542f\u52a8\u548c\u505c\u6b62master":153,"\u9996\u5148\u662f\u901a\u8fc7\u5e38\u89c4\u65b9\u5f0f\u542f\u52a8\u548c\u5173\u95edslave\u7aef":153,"\u9996\u6b21\u521d\u59cb\u5316\u73af\u5883\u9700\u8c03\u7528":146,"\u9a6c\u5c14\u53ef\u592b\u6027":196,"\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b\u7531\u5143\u7ec4":196,"\u9a6c\u5c14\u79d1\u592b\u51b3\u7b56\u8fc7\u7a0b\u7684\u72b6\u6001\u8f6c\u79fb\u6982\u7387\u4e3a":196,"\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u4e2d\u4e0d\u5b58\u5728\u52a8\u4f5c\u548c\u5956\u52b1":196,"\u9a6c\u5c14\u79d1\u592b\u8fc7\u7a0b\u662f\u4e00\u4e2a\u4e8c\u5143\u7ec4":196,"\u9a8c\u8bc1":150,"\u9a8c\u8bc1\u662f\u5426\u4e3a":158,"\u9a8c\u8bc1\u662f\u5426\u4e3a\u5728":158,"\u9a8c\u8bc1\u662f\u5426\u5728\u533a\u95f4":158,"\u9ad8\u7ea7\u7279\u6027":146,"\u9ad8\u81f350":145,"\u9ed8\u8ba4\u4e3a":146,"\u9ed8\u8ba4\u4f1a":146,"\u9ed8\u8ba4\u4f1a\u8fdb\u884c\u81ea\u52a8":146,"\u9ed8\u8ba4\u60c5\u51b5\u4e0b":168,"\u9ed8\u8ba4\u60c5\u51b5\u4f1a\u83b7\u53d6\u914d\u7f6e\u6587\u4ef6\u4e2d\u7684\u73af\u5883\u4e2a\u6570":148,"\u9ed8\u8ba4\u90fd\u4f7f\u7528":148,"\ufb01xed":192,"abstract":[2,8,17,23,49,50,58,69,93,94,96,101,105,107,108,123,132,155,157,160,163,193,199],"act\u548crew\u7684shape\u548cvalue\u7684dtyp":146,"adri\u00e0":171,"api\u7684\u5b9e\u73b0":150,"atari\u6e38\u620f\u4e2d\u4f7f\u7528rgb\u56fe\u7247\u6765\u8868\u793a\u6e38\u620f\u73af\u5883\u7684\u4fe1\u606f":196,"autolog\u6574\u4f53\u5206\u4e3a\u4e24\u90e8\u5206":142,"autolog\u6a21\u5757\u7684\u4e3b\u8981\u7528\u9014\u4e3a\u89e3\u51b3\u5728\u6a21\u578b\u8bad\u7ec3\u7b49\u6570\u636e\u52a8\u6001\u573a\u666f\u4e0b":142,"avglist\u7c7b\u4f1a\u81ea\u52a8\u8bb0\u5f55\u5bf9value\u503c\u7684\u66f4\u6539":142,"ayncdataloader\u7684\u53c2\u6570":156,"ba\u015far":174,"based\u548cmodel":196,"based\u5927\u7c7b\u65b9\u6cd5\u4e2d\u540c\u6837\u6709\u4e24\u79cd\u8def\u5f84":196,"based\u5bf9\u5e94\u7684\u662f\u5b66\u4e60\u5728\u4e00\u4e2a\u8f93\u5165\u72b6\u6001\u5e94\u8be5\u91c7\u53d6\u4ec0\u4e48\u884c\u52a8":196,"based\u5c31\u662f\u5728\u5b66\u4e60\u8bc4\u4ef7\u4e00\u4e2a\u8f93\u5165\u72b6\u6001\u7684\u4ef7\u503c":196,"based\u624d\u63d0\u9ad8\u4e86\u6574\u4e2a\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u8fed\u4ee3\u7684\u6548\u7387":196,"based\u65b9\u6cd5\u5148\u5b66\u4e60\u503c\u51fd\u6570":196,"based\u65b9\u6cd5\u5e38\u8d70\u7684\u8def\u7ebf":196,"based\u65b9\u6cd5\u7684\u91cd\u70b9\u5728\u4e8e\u73af\u5883\u6a21\u578b":196,"based\u65b9\u6cd5\u76f4\u63a5\u66f4\u65b0\u7b56\u7565":196,"based\u7684\u5f3a\u5316\u5b66\u4e60\u65b9\u6cd5\u662f\u5c06\u7b56\u7565\u8fdb\u884c\u53c2\u6570\u5316":196,"based\u7684\u65b9\u6cd5\u7684\u8be6\u7ec6\u7406\u89e3\u53c2\u8003\u6211\u4eec\u6587\u6863\u4e2d\u7684\u5177\u4f53\u7b97\u6cd5":196,"based\u7684\u7b56\u7565\u4f18\u5316":196,"based\u7b97\u6cd5\u6307\u8be5\u7b97\u6cd5\u4f1a\u5b66\u4e60\u73af\u5883\u7684\u8f6c\u79fb\u8fc7\u7a0b\u5e76\u5bf9\u73af\u5883\u8fdb\u884c\u5efa\u6a21":196,"basetime\u5747\u63d0\u4f9btim":142,"boolean":71,"break":[117,118,135,138,169,199,200],"buffer\u6211\u4eec\u53ef\u4ee5\u5c06experience\u5b58\u5165buff":196,"byte":77,"case":[4,43,56,75,94,95,115,117,119,124,126,133,155,157,159,162,165,169,181,183,185,188,197,199,200],"catch":[82,90,136,173],"class":[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,58,67,68,69,73,74,75,79,81,82,83,88,91,92,93,94,95,96,100,101,102,104,105,107,108,120,123,124,126,127,132,133,142,149,153,154,155,156,157,162,163,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,197,199,200,202],"cloning\u5c31\u662f\u7ecf\u5178\u7684offlin":196,"collector\u4e4b\u95f4\u7684\u901a\u4fe1\u95ee\u9898":156,"controller\u4f5c\u4e3a\u4e1a\u52a1\u903b\u8f91\u76f8\u5173\u7684\u7c7b\u5e94\u548cmymaster\u662f\u7ec4\u5408\u5173\u7cfb":153,"coordinator\u4e5f\u4f1a\u5728\u6536\u5230\u8be5\u4fe1\u606f\u540e\u7ee7\u7eed\u53d1\u9001\u4efb\u52a1":156,"coordinator\u5728\u6536\u5230learner\u7684\u6570\u636e\u8bf7\u6c42\u540e":156,"coordinator\u77e5\u9053comm":156,"cpu\u8d1f\u8f7d":145,"critic\u5c31\u662f\u4e00\u8fb9\u53bb\u5b66\u4e60crit":196,"critic\u63d0\u51fa\u7684\u6700\u5927\u71b5\u5f3a\u5316\u5b66\u4e60\u7b97\u6cd5\u6781\u5927\u7684\u63d0\u9ad8\u4e86off":196,"critic\u662f\u4e00\u79cd\u65e2\u5b66\u4e60\u4ef7\u503c\u51fd\u6570\u4e5f\u5b66\u4e60\u7b56\u7565\u51fd\u6570\u7684\u65b9\u6cd5":196,"critic\u7b97\u6cd5\u5982a2c":196,"dataloader\u4fbf\u4f1a\u8c03\u7528comm":156,"dataloader\u53ef\u4ee5\u5c06\u5176\u53d6\u51fa":156,"dataset\u4f5c\u4e3a\u7b97\u6cd5\u7684\u8f93\u5165":196,"dataset\u8f93\u5165":196,"default":[0,8,11,19,27,28,29,33,34,35,37,38,40,41,42,43,45,46,47,48,54,59,62,63,66,67,69,72,73,75,82,89,90,91,94,108,119,120,123,124,127,129,131,133,134,135,138,144,147,149,151,154,161,162,163,166,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,189,190,192,193,199,200,201],"demo\u5982\u4e0b":150,"do":[8,17,19,20,72,75,88,91,92,94,95,108,115,121,123,135,140,142,149,152,153,156,157,161,162,163,165,166,169,173,176,188,191,197,199],"dp\u5177\u6709\u4ee5\u4e0b\u7684\u7279\u70b9":196,"engine\u4e2d":164,"engine\u4e2d\u4e3a\u5206\u5e03\u5f0f\u73af\u5883\u4e0b\u7684\u591a\u673a\u591a\u5361\u8bad\u7ec3\u63d0\u4f9b\u652f\u6301":153,"engine\u4e2d\u9ed8\u8ba4\u5173\u95edhpc_rl\u7684\u4f7f\u7528":150,"engine\u4f1a\u5728import\u65f6\u81ea\u52a8\u8fdb\u884c\u5bfb\u627e\u76f8\u5e94\u7684\u66ff\u4ee3\u5e93\u6216\u4ee3\u7801\u5b9e\u73b0":139,"engine\u65f6\u547d\u4ee4\u884c\u4e2d\u663e\u793a\u7684import":139,"engine\u7684\u76f8\u5173wrapper\u4f1a\u81ea\u52a8\u6839\u636e\u6570\u636e\u5c3a\u5bf8\u8fdb\u884c\u8c03\u6574":150,"enum":[14,15,20,114,158,159],"envwrapper\u88c5\u9970\u8fc7\u7684":146,"exploration\u5373\u662frl\u4e2d\u7684agent\u9700\u8981\u4e0d\u65ad\u7684\u53bb\u63a2\u7d22\u73af\u5883\u7684\u4e0d\u540c\u72b6\u6001":196,"exploration\u56f0\u5883":196,"export":199,"final":[8,17,19,29,72,78,79,90,94,118,131,134,135,155,157,172,179,188,192,199],"float":[4,11,17,19,23,26,27,29,37,38,40,41,42,43,45,46,47,48,56,58,59,62,63,66,68,73,74,75,81,91,92,93,107,108,115,123,134,135,136,142,148,149,156,158,159,172,175,176,177,178,179,181,184,185,186,187,189,190,192],"free\u7684\u65b9\u6cd5\u4e2d":196,"free\u7b97\u6cd5\u5219\u4e0d\u9700\u8981\u5bf9\u73af\u5883\u8fdb\u884c\u5efa\u6a21":196,"function":[3,8,20,27,29,33,34,37,39,40,41,42,45,46,47,48,49,50,52,53,54,56,58,59,63,67,69,74,75,76,79,80,82,83,86,90,91,93,96,100,105,107,110,116,117,120,123,127,128,129,131,132,133,135,142,146,147,149,154,157,162,163,165,166,171,172,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,195,198,200],"gpu\u4e0a\u5e76\u884c\u6267\u884c":150,"hook\u6240\u5904\u7684\u4f4d\u7f6e":[164,165],"hook\u662f\u6700\u57fa\u672c\u7684\u57fa\u7c7b":156,"hook\u7684\u4f18\u5148\u7ea7":[164,165],"hook\u7684\u540d\u79f0":[164,165],"hook\u7684\u7c7b\u578b":[164,165],"hpc_rl\u4f18\u5316\u540e\u7684\u5b9e\u73b0":150,"hpc_rl\u53ea\u652f\u6301\u5176\u4e2d\u67d0\u4e9b\u5e38\u89c1\u7684\u53c2\u6570\u7ec4\u5408":150,"hpc_rl\u5728\u5185\u90e8\u9ed8\u8ba4\u4f1a\u9884\u5148\u5206\u914d\u7b97\u5b50\u6240\u9700\u8981\u7684\u5185\u5b58":150,"import":[31,40,41,43,45,46,47,61,64,66,82,85,108,118,120,123,126,127,129,132,133,135,136,138,142,146,147,148,149,150,151,155,157,160,161,162,164,165,169,172,176,177,179,181,184,186,187,188,189,190,194,195,197,199,200],"int":[0,3,4,8,12,14,15,17,19,20,23,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,56,58,63,67,68,73,74,75,79,81,82,89,90,91,93,94,95,102,105,107,108,114,115,123,124,128,130,131,134,135,136,138,142,156,158,159,162,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,192,199,200],"interaction\u4e3a\u4e00\u4e2a\u72ec\u7acb\u4e8e\u4efb\u4f55\u5177\u4f53\u4e1a\u52a1\u7684\u4ea4\u4e92\u5f0f\u670d\u52a1\u6846\u67b6":153,"interaction\u5206\u4e3a\u4e24\u4e2a\u7aef":153,"interaction\u662f\u5b8c\u5168\u4e0d\u5fc5\u8981\u7684":153,"inv_trans_fn\u4ec5\u652f\u6301r2d2\u4e2d\u7684\u76f8\u5173\u53d8\u6362\u5f62\u5f0f":150,"join\u7b49\u751f\u547d\u5468\u671f\u7ba1\u7406\u65b9\u6cd5":153,"learner\u4e0ecollector\u4ea4\u66ff\u5de5\u4f5c":156,"learner\u4e0ecollector\u540c\u4e00\u65f6\u523b\u90fd\u5728\u5de5\u4f5c":156,"learner\u4e2d\u4f1a\u5c06learner\u5173\u95ed":156,"learner\u4e2d\u5148\u662f\u5b9e\u4f8b\u5316\u4e00\u4e2a":156,"learner\u4e2d\u5b8c\u6210\u7684":156,"learner\u4e2d\u5b9e\u73b0\u7684":156,"learner\u4e2d\u7684":156,"learner\u4ece\u88ab\u5e76\u884cpipeline\u90e8\u7f72":156,"learner\u4fbf\u662f\u8d1f\u8d23\u89e3\u51b3\u5e76\u884c\u6a21\u5f0f\u4e2d\u7684\u8fd9\u4e9b\u95ee\u9898\u7684":156,"learner\u521b\u5efa\u51e0\u4e2a":156,"learner\u53calearn":156,"learner\u53ef\u4ee5\u72ec\u7acb\u5b8c\u6210\u4e32\u884cpipeline\u4e2d\u7684\u8bad\u7ec3\u5de5\u4f5c":156,"learner\u5728\u5efa\u7acb\u540e":156,"learner\u57fa\u7c7b":156,"learner\u5b8c\u6210\u8bad\u7ec3":156,"learner\u5b9e\u73b0":156,"learner\u5c06":156,"learner\u5c06\u8bad\u7ec3\u4fe1\u606f\u5b58\u653e\u5728":156,"learner\u5e76\u4e0d\u5b9e\u9645\u8fdb\u884c\u8bad\u7ec3":156,"learner\u5e76\u4e3a\u5176\u4e00\u6b21\u6216\u591a\u6b21\u5206\u914d\u4efb\u52a1":156,"learner\u5e76\u76f4\u63a5\u5bf9\u5176\u64cd\u4f5c":156,"learner\u5f00\u59cb":156,"learner\u662f\u56e0\u4e3adataloader\u65e0\u6cd5\u83b7\u5f97\u6570\u636e\u800c\u88ab\u963b\u585e\u4f4f\u7684":156,"learner\u662frl\u7b97\u6cd5\u8fdb\u884c\u8bad\u7ec3\u7684\u6838\u5fc3":156,"learner\u6709\u7740\u4e0d\u540c\u7684\u8c03\u7528\u63a5\u53e3\u548c\u8fd0\u884c\u6a21\u5f0f":156,"learner\u670d\u52a1":156,"learner\u6ca1\u6709\u5b8c\u6210\u8bad\u7ec3":156,"learner\u7684":156,"learner\u7684\u4e00\u4e2a\u91cd\u8981\u5de5\u4f5c\u5c31\u662f\u5c06\u8fd9\u4e9bhook\u53ca\u6267\u884chook\u65f6\u6240\u9700\u8981\u7684\u51fd\u6570\u6ce8\u518c\u81f3learner\u4e2d":156,"learner\u7684\u521b\u5efa":156,"learner\u7684\u5de5\u4f5c\u6d41\u7a0b":156,"learner\u7684\u5de5\u4f5c\u6d41\u7a0b\u4e3a":156,"learner\u8fdb\u884c\u8bad\u7ec3":156,"learner\u901a\u8fc7":156,"learner\u9700\u8981\u81ea\u5df1\u53d1\u51fa\u6570\u636e\u8bf7\u6c42":156,"learnerhook\u662f\u5728\u5176\u57fa\u7840\u4e0a\u9488\u5bf9learner\u7684\u5c01\u88c5":156,"learnerslave\u7ee7\u627f\u81easlav":156,"learnerslave\u8fd9\u51e0\u4e2a\u7c7b\u4e4b\u95f4\u7684\u5173\u7cfb\u53ef\u89c1\u7c7b\u56fe\u6240\u793a":156,"loader\u4e13\u6ce8\u4e8e\u903b\u8f91\u7684\u6784\u5efa":158,"loader\u4e3a\u4e00\u4e2a\u8f7b\u91cf\u5316":158,"loader\u7684\u57fa\u672c\u8bbe\u8ba1\u601d\u8def\u662f\u5c06\u4e00\u4e9b\u5e38\u89c1\u7684\u5c0f\u89c4\u6a21\u8f6c\u5316\u4e0e\u9a8c\u8bc1\u6a21\u5757":158,"loader\u7ec4\u4ef6":158,"loader\u8fdb\u884c\u903b\u8f91\u7ec4\u5408\u7684\u539f\u7406":158,"long":[75,95,114,144,147,152,154,190,197,199],"loss\u4e0b\u7684\u7b97\u5b50\u8fdb\u884c\u4f18\u5316":150,"loss\u7684\u57fa\u672c\u5f62\u5f0f":196,"lstm\u4e2d\u7684normalization\u4ec5\u652f\u6301ln":150,"ma\u0144dziuk":183,"master\u548cslave\u7aef\u7684channel\u52a1\u5fc5\u8bbe\u7f6e\u4e3a\u540c\u4e00\u4e2a\u6574\u6570":153,"master\u7aef\u6709\u4e24\u79cd\u542f\u52a8\u65b9\u5f0f":153,"master\u7aef\u7684\u4e3b\u8981\u4efb\u52a1\u662f\u5bf9slave\u7aef\u8fdb\u884c\u8fde\u63a5":153,"mc\u4e0d\u9700\u8981\u73af\u5883\u6a21\u578b":196,"mc\u6216td":196,"mc\u66f4\u65b0\u7684\u76ee\u6807\u662f":196,"mc\u7528\u6837\u672c\u56de\u62a5\u4ee3\u66ff\u5b9e\u9645\u7684\u671f\u671b\u56de\u62a5":196,"model\u57fa\u7840\u4e0a\u505aplan":196,"model\u7684\u5b66\u4e60\u53ef\u4ee5\u6839\u636e\u6a21\u578b\u6784\u9020\u7684\u4e0d\u540c":196,"model\u7684\u5b9a\u4e49\u53ef\u4ee5\u7528\u6570\u5b66\u8868\u793a\u4e3a\u72b6\u6001\u8f6c\u79fb\u5206\u5e03\u548c\u5956\u52b1\u51fd\u6570\u7ec4\u6210\u7684\u5143\u7ec4":196,"mujoco\u63a7\u5236\u4efb\u52a1\u4e2d\u4f7f\u7528\u5411\u91cf\u6765\u8868\u793a\u667a\u80fd\u4f53\u7684\u72b6\u6001":196,"new":[2,4,17,19,23,25,26,27,58,82,89,94,96,101,105,107,112,117,118,120,121,125,129,132,138,147,149,151,153,154,155,157,159,162,165,166,167,169,172,185,188,190,197,199,200],"none\u4e09\u9009\u4e00":158,"norm\u4e13\u6ce8\u4e8e\u6570\u5b66\u8ba1\u7b97":158,"norm\u673a\u5236":158,"normfunc\u673a\u5236":158,"null":[56,133,181],"over\ufb01t":192,"pip\u5b89\u88c5\u65f6\u53ef\u80fd\u51fa\u73b0":139,"pip\u6dfb\u52a0":139,"policy\u5219\u662f\u53ef\u4ee5\u4f7f\u7528\u4e4b\u524d\u8fc7\u7a0b\u4e2d\u7684\u7b56\u7565\u8fdb\u884c\u8bad\u7ec3":196,"policy\u548coff":196,"policy\u5f88\u96be\u5e73\u8861\u63a2\u7d22\u4e0e\u5229\u7528\u7684\u95ee\u9898":196,"policy\u662f\u4f7f\u7528\u5f53\u524d\u7684\u7b56\u7565\u8fdb\u884c\u8bad\u7ec3":196,"policy\u7684\u4f18\u52bf\u5728\u4e8e\u91cd\u590d\u5229\u7528\u6570\u636e\u8fdb\u884c\u8bad\u7ec3":196,"policy\u7684\u7a33\u5b9a\u6027\u548c\u6027\u80fd":196,"policy\u7684\u7b97\u6cd5":196,"public":[182,199],"puigdom\u00e8nech":171,"python\u771f\u652f\u6301\u8fd9\u4e2a":158,"r\u00e9mi":175,"redis\u7684\u76f8\u5173warn":139,"replay\u4f5c\u7528\u5728\u54ea\u91cc":196,"replay\u63d0\u51fa\u7684\u601d\u60f3\u5c31\u662f\u4e3a\u4e86\u8ba9agent\u4ece\u8fc7\u53bb\u7ecf\u5386\u7684transitions\u4e2d\u8fdb\u884c\u5b66\u4e60":196,"repo\u4e2d":168,"return":[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,53,55,56,57,58,59,61,62,63,64,66,67,68,69,71,73,74,75,76,77,78,79,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,101,102,104,105,107,108,114,115,118,120,123,124,125,126,127,128,129,130,133,135,138,142,146,147,149,153,154,155,156,157,158,159,162,163,166,171,172,175,176,178,179,181,185,186,187,188,189,190,191,192,195,198,199,200],"return\u7684\u5b9a\u4e49\u4e3a\u5728\u4e00\u4e2a\u9a6c\u5c14\u53ef\u592b\u8fc7\u7a0b\u4e2d\u4e0a\u4ecet\u65f6\u523b\u5f00\u59cb\u5f80\u540e\u6240\u6709\u7684\u5956\u52b1\u7684\u6709\u8870\u51cf\u7684\u6536\u76ca\u603b\u548c":196,"reward\u6709\u635f\u5931":196,"rl\u53c8\u79f0batch":196,"short":[69,78,95,172,199,201],"slave\u4e00\u76f4\u90fd\u5904\u4e8e\u5f85\u547d\u72b6\u6001":156,"slave\u4f1a\u901a\u8fc7\u9884\u5148\u5546\u5b9a\u7684ip\u5730\u5740\u4e0e\u7aef\u53e3\u53f7\u4e0ecoordinator\u5efa\u7acb\u8fde\u63a5":156,"slave\u4f5c\u4e3a\u7c7b\u7684\u4e00\u4e2a\u79c1\u6709\u5c5e\u6027":153,"slave\u53ef\u4ee5\u8c03\u7528\u8fd9\u4e9b\u51fd\u6570":156,"slave\u5411coordinator\u8fd4\u56de\u6210\u529f\u7684\u4fe1\u606f":156,"slave\u5904":156,"slave\u6536\u5230\u540e\u8c03\u7528comm":156,"slave\u672c\u8eab\u7684\u7ed3\u6784\u548c\u751f\u547d\u5468\u671f\u53d7\u5230\u5e72\u6270":153,"slave\u673a\u5236\u5e2e\u52a9flaskfilesystemlearner\u5b8c\u6210\u4e0ecoordinator\u7684\u901a\u4fe1\u5de5\u4f5c":156,"slave\u7684":156,"slave\u7aef\u7684\u4efb\u52a1\u662f\u4ecemaster\u7aef\u63a5\u6536\u4efb\u52a1\u4fe1\u606f":153,"slave\u7aef\u8bbe\u6709\u6700\u5927\u4efb\u52a1\u6570\u91cf":153,"slave\u8c03\u7528comm":156,"slave\u8fd4\u56de\u7ed9coordin":156,"static":[0,2,4,25,135,149],"super":[123,126,127,156,188],"switch":[130,154,165,189,199,200],"t\u02c6z_j":175,"td3\u7b49\u53c2\u8003\u6211\u4eec\u6587\u6863\u4e2d\u5bf9\u7b97\u6cd5\u7684\u89e3\u91ca":196,"td\u4e0emc\u7684\u5bf9\u6bd4":196,"template\u6765\u6307\u5b9a\u5bf9\u5e94ob":146,"tests\u4e0b\u7684\u5355\u5143\u6d4b\u8bd5\u6765\u9a8c\u8bc1\u7cbe\u5ea6\u548c\u6548\u7387":150,"th\u00e9ophil":174,"throw":[147,181],"time\u5206\u4e3a\u4ee5\u4e0b\u4e24\u7c7b":142,"training\u5373\u662ftraining\u65f6\u4e0d\u4f7f\u7528collector\u4e0e\u73af\u5883\u8fdb\u884c\u4ea4\u4e92":196,"training\u548cofflin":196,"training\u7b97\u6cd5":196,"transition\u53ef\u80fd\u662f\u786e\u5b9a\u7684\u4e5f\u53ef\u80fd\u662f\u968f\u673a\u7684":196,"true":[0,4,11,19,23,25,26,27,29,34,37,38,40,41,42,43,45,46,47,48,56,59,67,68,74,75,79,82,90,91,93,101,120,121,125,126,127,129,131,133,134,135,136,138,146,147,148,149,150,151,153,154,156,162,164,165,166,171,172,175,176,177,178,179,181,184,185,186,187,189,190,191,192,199,200],"try":[8,17,19,82,85,112,117,157,169,195,199],"var":[41,45,67,89,123],"void":[146,147],"while":[45,71,75,107,117,118,120,121,123,125,128,131,134,135,144,146,147,157,162,175,177,178,179,180,181,184,185,188,191,192,197,199,200],"windows\u4e0b\u53ef\u4ee5\u4f7f\u7528":168,"x\u662f\u5426\u5728\u533a\u95f4":158,A:[0,2,3,8,11,19,20,23,25,26,27,38,43,57,67,73,75,76,82,92,93,94,96,101,105,107,108,117,118,126,134,135,151,152,153,155,157,158,159,161,165,171,174,175,176,177,178,180,183,185,186,187,188,190,192,198,200,201],AND:[181,185],And:[0,43,107,127,128,129,131,157,161,162,163,166,167,181,188,195,199,200,202],As:[92,95,108,121,123,131,133,135,144,157,160,161,163,165,173,187,190,197,199,200],At:[79,147,149,155,181],But:[115,117,123,125,155,157,180,188],By:[29,78,115,117,123,131,149,154,169,172,179,183,187,190,199],FOR:[178,189,192],For:[27,40,41,43,46,58,75,77,78,95,96,108,114,115,117,120,121,123,125,126,127,130,131,132,133,134,135,136,140,147,149,151,154,155,157,160,162,165,167,169,172,175,177,178,179,181,186,187,188,190,191,194,197,199,200],IF:[178,189,192],IN:[75,185],IS:[40,41,43,45,46,108,129,176,177,181,184,186],If:[0,19,25,26,27,40,43,45,46,47,49,50,56,75,78,79,82,90,93,94,101,107,112,115,123,124,125,131,132,138,147,149,151,154,155,157,160,162,163,165,166,169,174,178,179,181,187,188,189,192,193,194,195,197,199,200,201],In:[25,27,43,45,47,53,54,58,69,75,94,95,96,105,107,112,114,115,117,118,119,120,121,124,125,126,127,129,131,132,133,134,135,136,138,144,147,149,151,154,155,157,159,161,162,163,165,167,168,169,172,173,175,176,177,178,179,181,184,187,188,189,190,192,193,197,199,200,201],Is:[152,166],It:[4,27,38,43,47,48,92,115,117,118,120,127,129,134,135,147,149,151,154,155,157,159,160,163,165,169,172,175,179,187,190,191,194,197,199,200],Its:[125,136,154,157,173],No:[4,14,15,163,173,194],Not:[108,114,166],ON:185,Of:197,On:[149,177,188,197],One:[8,25,53,135,179,189,199],Or:[3,123,127,135,154,169],Such:[134,142],That:[154,190],The:[3,4,11,17,19,23,25,26,27,28,29,31,33,34,37,38,39,40,41,42,43,45,46,47,48,49,52,53,54,56,58,67,76,77,78,79,81,82,84,89,90,91,92,93,94,96,100,101,105,107,108,112,113,114,115,117,118,119,121,123,124,126,127,128,132,133,134,135,136,138,140,144,147,149,151,154,155,157,159,161,162,163,165,166,167,169,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,189,190,191,192,193,194,195,197,200,201],Then:[79,91,105,108,118,123,124,125,126,128,129,132,133,157,163,172,175,181,188,189,197,199,200],There:[63,64,94,121,125,127,134,135,154,157,160,165,167,169,172,183,184,197,199,201],These:[133,142,151,157,169,173,177,186,199],To:[124,127,131,133,136,144,147,149,155,161,172,173,177,178,194,195,197,199,200],Will:[96,105,156,166,175,187],With:[21,108,124,151,169,172,190,197,199],_1:191,_2:[172,191],_:[78,117,123,138,142,146,147,156,166,171,172,174,175,176,177,178,179,181,183,184,185,186,187,189,191,192,193,199,200],__:78,_____________________________________:75,__________________________________________:75,_____________________________________________________________________________:75,__avg_func:[123,142],__call__:[58,83,107,123,156,157,164,165],__contains__:19,__del__:[100,102],__delitem__:19,__enter__:[8,88,93,153,154],__exit__:[8,88,93,153,154],__getattr__:108,__getitem__:[19,26,91,94],__init__:[0,2,4,11,12,14,15,17,19,20,21,23,25,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,50,52,53,54,56,58,73,75,79,81,82,88,91,93,94,95,96,100,101,102,104,105,107,108,120,123,124,126,127,135,142,145,146,147,148,149,155,156,157,162,163,166,171,174,175,176,177,178,179,181,185,186,187,188,192,199,202],__iter__:79,__main__:[127,135,136,138,142,150,151,153,154,187],__max_func:123,__min_func:123,__mul__:26,__name__:[127,135,136,138,142,150,151,153,154,187],__next__:79,__property_nam:142,__regist:[123,142],__repr__:[148,149,174],__setitem__:91,__version__:195,_a_:52,_act_shap:189,_actor_update_freq:192,_adder:128,_after_connect:19,_after_disconnect:19,_after_forward:75,_after_hook_typ:20,_after_new_task:19,_alpha:[58,189],_alpha_optim:189,_batch_mn_pdf:52,_before_connect:[19,21,23],_before_disconnect:[19,21,23],_before_forward:75,_before_hook_typ:20,_before_new_task:[19,153,154],_before_task:[21,23],_begin_tim:[123,142],_burnin_step:133,_calcul:[158,159],_calculate2:[158,159],_cfg:[40,41,45,46,47,123,127,128,133,156,162,166,178,189,192],_check:[148,149],_checkpointer_manag:[156,166],_collect_model:[133,162],_collector_envstep:123,_core:[148,149],_count:4,_create_collector:96,_create_learn:[156,157],_create_model:162,_cuda:189,_cut_ob:38,_data_demand_queu:[156,157],_data_preprocess_learn:[40,41,45,46,133,176,177,184,186],_data_result_queu:[156,157],_dataload:[107,156],_debug:81,_delai:192,_detail:[148,149],_devic:[156,166],_durat:142,_dynamic_se:131,_end_flag:156,_end_tim:[123,142],_env:[94,131],_env_dynamic_se:131,_env_num:131,_env_se:131,_epsilon:4,_error_connect:19,_error_disconnect:19,_error_hook_typ:20,_error_new_task:19,_eval_model:133,_factor:[40,41,46,176,177,186],_file_to_dict:0,_finished_task:156,_forward_collect:[39,40,41,42,43,45,46,47,48,129,162,176,177,184,186],_forward_colleect:129,_forward_ev:[39,40,41,42,43,45,46,47,162,184],_forward_eval_reset_ev:[40,41,46,176,177,186],_forward_learn:[39,40,41,42,43,45,46,47,48,123,126,128,129,133,162,176,177,178,184,186,192,199],_forward_learn_cnt:192,_freq:123,_gamma:[126,128,129,178,189,191,192],_get_action_dist:53,_get_attribut:162,_get_batch_s:[45,125,184],_get_collect_oppon:155,_get_flatten_s:28,_get_job_info:155,_get_null_transit:181,_get_ob:4,_get_oppon:155,_get_state_dist:53,_get_timestep:96,_get_train_sampl:[39,40,41,43,45,46,48,128,133,162,172,176,177,181,184,186],_gpu:[43,179],_hook:[156,166],_init:[148,149],_init_:188,_init_cfg:155,_init_collect:[39,40,41,42,43,45,46,47,48,128,133,162,176,177,184,186],_init_ev:[39,40,41,42,43,45,46,47,133,176,177,184,186],_init_leagu:155,_init_learn:[39,40,41,42,43,45,46,47,48,128,133,176,177,178,184,186,192],_init_multi_gpu_set:127,_init_play:25,_instanc:[148,149],_iresponseinform:[13,16],_is_auto_alpha:189,_is_trained_enough:27,_islaveconnect:[16,18],_iter:76,_itertargettyp:76,_itertyp:76,_j:191,_last_agent_step:27,_last_it:[156,166],_launch_job:155,_learn_info_queu:[156,157],_learn_model:[126,127,133,178,189,192],_learner_uid:[156,166],_len:[43,47,179],_list:123,_load_path:[156,166],_load_state_dict_collect:162,_load_state_dict_ev:162,_load_state_dict_learn:[40,41,43,45,46,162,176,177,184,186],_log_alpha:[189,191],_log_buff:[156,166],_logger:[156,166],_loss_weight:[40,176],_lost_connect:23,_mean:4,_metadata_queu:96,_model:[133,162,178,190,192],_monitor_vars_learn:[41,45,123,162,177,184],_mutate_play:[27,155],_name:[148,149,156,166],_next_data:156,_nstep:[126,128,129,133],_nstep_return:128,_obs_shap:189,_optim:[123,127],_optimizer_ac:45,_optimizer_actor:[178,192],_optimizer_aux_crit:45,_optimizer_crit:[178,192],_optimizer_polici:189,_optimizer_q:189,_parent_id:27,_per_collect:[41,45,177,184],_pfsp_branch:155,_polici:[94,107,156,164,165],_policy_embedding_s:189,_policy_net:189,_policy_net_forward:189,_posit:156,_preprocess_data:35,_print_result:[153,154],_prioriti:156,_priority_info:[156,166],_process_task:[21,23,96,153,154,156,157],_process_transit:[39,40,41,42,43,45,46,47,125,129,133,162,176,177,184,186],_prop_nam:142,_q:191,_rank:[156,166],_rate:[43,47,179],_rate_actor:[42,178,192],_rate_crit:[42,178,192],_rate_polici:189,_rate_q:189,_rate_valu:189,_reparameter:189,_reset_collect:[40,41,46,162,176,177,186],_reset_ev:[40,46,162],_reset_learn:[40,41,46,162,176,177,186],_result_valu:[153,154],_running_mean_std_rnd:188,_running_mean_std_rnd_ob:188,_s_:52,_sec:108,_seed:131,_set_attribut:162,_setup_global_encod:[38,176,186],_setup_hook:[107,156,166],_setup_wrapp:[107,156,166],_shape:4,_sigma_:52,_snapshot:[27,155],_soft_q_embedding_s:189,_soft_q_net:189,_soft_q_net_forward:189,_sp_branch:155,_start_tim:142,_state:124,_state_dict:108,_state_dict_collect:162,_state_dict_ev:162,_state_dict_learn:[40,41,43,45,46,162,176,177,184,186],_sum:142,_t:[171,172,185,191],_target_entropi:[189,191],_target_model:[126,133,162,178,192],_task_process:[153,154],_tb_logger:[156,166],_time:142,_time_wrapp:[107,166],_timer:[156,166],_tmp_conn:[153,154],_total_agent_step:27,_train:[52,53,54,188],_train_iter:123,_twin_crit:[178,192],_twin_q:189,_unroll_len:181,_update_play:155,_use_cuda:[156,166],_use_distribut:[156,166],_used_data:108,_valu:[123,142],_var:4,_weight:[43,47,179],_world_siz:156,_wrapper_tim:[156,166],_x0:58,_x:58,_z:172,a0fd:134,a1:[53,139,140],a2:[53,139,140],a2c:[6,44,60,128,133,141,181,182,194,197,199,202],a2c_data:55,a2c_error:[60,171],a2c_loss:[55,171],a2cpolici:[6,44,171],a3:[139,140],a4:[139,140],a_0:[117,172,196,197],a_1:117,a_:[171,172,176,178,181,185,187,191,192,196,197],a_i:181,a_k:172,a_layer_num:29,a_n:[196,197],a_siz:53,a_t:[133,172,179,181,191,196,197],aa:[158,159],aaai:177,ab:[46,54,65,75,123,126,129,153,154,171,172,175,178,179,181,183,184,185,186,187,188,190,192,193],abbeel:177,abc:156,abhishek:174,abl:[163,169,184],ablat:173,abnorm:[148,149,199],abort:135,about:[4,27,63,75,117,127,131,133,134,135,147,160,161,162,166,169,174,179,188,190,195,197,199,200,201],abov:[8,17,56,114,115,144,149,154,155,157,161,162,169,177,181,190,193,197,199,200,201],absolut:[91,142,179,187],abstractmethod:156,abstractproperti:156,abus:154,academ:[149,194],academia:120,acceler:[127,147,151],accept:[177,186],acces:169,access:[26,29,79,81,149,167,188,200],accord:[3,4,27,28,29,33,34,37,39,40,41,42,45,46,47,48,56,58,74,75,77,88,94,95,96,101,102,107,108,115,120,128,129,136,147,149,151,154,155,156,162,163,165,166,169,171,175,178,179,181,183,185,187,188,189,192,195,197,199,200],accordingli:[126,128,169,172,197],account:197,accumul:[41,63,130,147,190,192,197],accur:[4,52,53,54,95,154,199],accuraci:151,acer:[182,194],acer_policy_error:172,acer_trust_region_upd:172,acer_value_error:172,acerpolici:172,achiev:[17,19,124,127,149,165,173,175,183,184,187,188,193],acquir:[41,47,48,88,130,135,155,157,166,193,197,199,200],acquire_spac:82,across:[4,75,120],act:[58,63,75,134,147,148,149,155,172,181,197],act_func:75,act_shap:[4,148,149],act_spac:[130,135,148,149],actiion:120,action:[2,3,4,6,16,19,22,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,57,58,61,62,63,64,66,69,96,108,117,120,123,124,126,128,129,130,133,146,147,148,149,160,163,165,167,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,198,199,201],action_arg:[33,178,192],action_args_shap:[33,178,192],action_dim:[63,190],action_distribut:[43,123],action_mask:[35,138,177,190],action_nois:[164,165,192],action_num:126,action_shap:[33,34,35,37,38,126,127,135,136,171,175,176,177,178,179,181,185,186,187,189,192,199],action_spac:[126,130],action_type_shap:[33,178,192],actionnoisewrapp:[124,164,165],actions_dict:3,activ:[6,19,25,27,28,29,33,34,37,70,92,142,155,171,175,178,179,181,185,187,191,192,195],active_env:[3,146,147],activeplay:[25,155],acton:4,actor:[33,34,35,41,42,45,55,66,123,125,160,171,172,174,177,181,182,185,189,191,198,199],actor_:[42,178,192],actor_data:[178,192],actor_gradi:172,actor_head_hidden_s:[33,34,171,178,181,185,192],actor_head_layer_num:[33,34,171,178,181,185,192],actor_head_typ:[33,178,192],actor_hidden_size_list:[35,177],actor_loss:[172,178,192],actor_output:[33,34,171,178,181,185,192],actor_update_freq:192,actual:[82,112,114,115,121,128,149,153,154,157,165,197],actvat:75,ad:[26,67,75,81,147,149,154,155,159,160,165,166,167,169,178,192,195],adam:[6,70,178,180,188,189,192],adapt:[120,124,133,162,165,185,187,188,197,202],adaptivein:75,add:[25,26,38,42,67,69,75,82,91,101,102,107,108,117,120,123,124,127,129,131,132,133,140,142,149,151,156,157,159,165,166,168,169,176,178,186,188,190,192,197,199,200],add_learner_hook:[107,156],add_num:67,add_play:26,add_scalar:[123,138,200],add_used_data:108,add_wrapp:[164,165],addedr:107,adder:[6,60,133,172,181,199,202],addit:[75,120,154,157,163,173,184,185,186,200],addition:[27,96,123,144,155,174,191],address:[17,19,23,155,157,177,192],adjust:[151,165,191,199],adopt:[127,163,166,179,187,188,191,199],adv:[39,55,56,59,62,123,171,181,185],adv_:[45,184],adv_abs_max:[45,123],advanc:[4,108,114,147,154,161,163,180,184,188],advanced_buff:[108,163,202],advancedreplaybuff:[125,152,199,200],advantag:[45,55,56,59,66,110,116,154,171,177,179,181,184,187,190,197,199],advantage_n:172,advantage_retrac:172,adversari:180,advis:194,affect:[142,151,154,163],afoura:177,after:[0,4,17,19,20,23,26,27,28,29,33,34,37,38,39,40,41,42,43,45,46,47,48,56,67,68,75,81,92,96,112,120,123,125,127,129,133,134,138,147,149,151,153,154,155,156,157,159,162,163,165,168,169,171,172,173,175,176,177,178,179,181,184,185,186,187,188,192,194,195,197,199,200,201],after_connect:17,after_disconnect:17,after_forward:124,after_it:[107,156,164,165,166,199],after_run:[107,156,164,165,166,199,200],after_task_start:20,afterward:[96,114,123,157,166,188],ag:[42,114,161,178,189,192],again:[128,133,147,155,157,163],against:[25,27,155,172,187,189],agarw:187,agent57:188,agent:[27,35,38,40,41,46,57,117,120,125,133,135,136,138,149,155,174,176,177,180,186,188,190,194,197,200],agent_alone_st:[38,176],agent_colla_alone_q:40,agent_id:35,agent_num:[35,38,40,41,46,148,149,176,177,186],agent_q:[38,176,186],agent_q_act:[38,176,186],agent_st:[35,38,176,177,186],aggreg:[127,161,187,194,199],agre:[157,160],ai:[138,194,199],aim:[0,34,93,133,135,161,162,169,171,185,190,191,199],aka:[40,41,42,43,45,46,47,48,162,175,176,177,178,179,184,186,187,189,192],al:[135,173,174,176,177,180,186,188],alarm:93,alec:185,aleksand:185,alex:[171,179],alexand:178,alg1:[178,189,192],alg:[133,188],algorithm:[39,40,41,42,43,45,46,47,48,53,63,101,108,117,121,124,125,128,129,131,133,136,151,152,155,160,162,163,168,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,197,199,200,202],alia:17,align:[178,189,191,192],aliv:[17,19,92,153,154],all:[2,3,4,26,27,55,57,62,63,66,68,75,77,79,81,82,89,90,91,95,107,108,121,123,124,125,127,128,131,134,136,138,144,147,149,151,152,153,154,155,157,160,161,162,163,165,167,169,172,173,174,177,179,180,181,188,197,199,200,201],allai:38,allevi:155,alli:[38,176],alloc:151,allow:[78,82,124,133,174,177,184,187,197,199],allreduc:[86,127],ally_featur:38,ally_feature_rang:[38,176],almost:[120,199],alon:[38,154,176],alone_obs_shap:[38,176],along:[126,133,179,197],alpha:[40,73,129,176,189,190,191],alpha_loss:[189,191],alphabet:26,alphabetiv:26,alphago:[182,183,194],alphagozero:[182,194],alphastar:[25,75,155,181,194],alphastar_fake_data:25,alreadi:[15,27,62,132,138,154,195,199],also:[3,4,25,27,28,53,63,64,75,82,92,107,114,115,117,120,123,124,125,126,128,129,131,133,135,138,142,149,154,155,157,159,160,162,163,165,167,169,173,180,184,185,187,188,190,193,194,195,197,199,200],alter:126,altern:[118,140,171,177,184,187,199],although:[157,173,191],alwai:[82,92,123,149,155,157,160,166],ambigu:159,among:[26,62,107,108,123,127,157,162,175,177,180,199],amount:[4,151,154,187,188,192,197,201],amsgrad:73,an:[2,3,4,19,25,26,27,43,47,49,50,56,58,67,69,75,79,82,90,92,96,105,107,108,117,118,119,121,122,123,125,126,128,129,130,131,133,134,135,136,138,147,149,151,152,155,157,159,161,162,163,165,169,171,172,173,174,175,176,177,178,179,180,181,183,184,186,187,188,189,190,191,192,193,194,197,199,200,201,202],anaconda:195,analog:154,analysi:[152,191],analyst:191,analyz:187,anca:190,andoptim:41,andrew:185,ani:[2,3,4,8,12,17,19,20,21,23,39,40,41,42,43,45,46,47,48,49,50,56,68,74,78,79,81,82,84,89,90,92,94,95,96,108,117,123,124,127,128,129,133,153,154,156,159,162,163,165,166,167,169,172,181,183,188,193,195,199],annal:173,anneal:[129,179,187,199],anneal_step:129,annot:82,anoth:[15,17,115,179,197,199],answer:[196,197],answerbi:197,ant:141,antonogl:[179,193],any_dim:[40,46,78],anymor:108,anyon:199,anyth:[8,17,153,154,199],ap:129,apart:173,api:[107,127,133,151,155,167,194],api_doc:[28,29,31,37],api_vers:87,app:[6,9,16,161],appear:[3,114,123,140],append:[4,94,126,172,181,189,190],appli:[4,19,23,75,120,127,162,172,175,178,188,189,197,199,200],applic:[133,183,191,194],application_entri:[117,202],approach:[117,155,176,177,183,188,190,192,193,197],appropri:[154,159,169,190],approx:[177,178],approx_kl:[45,123],approx_kl_avg:123,approxeq:193,approxim:[144,172,175,179,192,193,197,199],ar:[3,4,14,15,17,19,20,23,26,27,33,39,40,41,42,43,45,46,47,48,53,55,57,62,66,72,75,78,79,82,91,94,96,105,107,108,114,115,117,118,120,121,123,124,125,127,129,131,132,134,135,136,138,140,144,147,149,151,152,155,156,157,159,160,161,162,163,165,167,169,172,173,174,175,178,179,181,183,184,185,186,187,188,189,190,192,193,195,197,199,200,201],arang:190,arbitrarili:200,architectur:[37,48,66,134,160,161,174,176,179,181,186,187,194],archiv:[155,169],area:[191,195],arg:[27,40,41,42,43,45,46,47,48,67,75,83,88,90,92,93,94,96,107,120,124,146,147,156,161,166,172,175,176,177,178,179,181,184,186,187,189,190,191,192],argiment:69,argmax:[38,39,40,41,45,46,47,69,75,124,176,186,187,188,199],argmax_act:133,argmax_sampl:[164,165,199],argmaxsamplewrapp:[124,164,165],argument:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,58,59,61,62,63,64,66,67,68,69,71,72,73,74,75,76,77,78,79,81,82,84,85,87,88,89,90,91,92,93,94,95,96,100,101,102,104,105,107,108,124,126,129,131,160,166,171,172,175,176,177,178,179,181,185,186,187,190,192,199],argumentskei:[3,25,33,35,40,41,43,45,46,108,177,178,192],argumet:4,arm:[136,173,193],around:[178,195],arrai:[3,4,91,126,135,136,175,187,192,193],arrang:[154,160],arrow:126,arthur:193,articl:93,articul:167,artifici:[173,177],arxiv:[42,46,53,54,55,59,62,66,75,171,172,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,192,193],ascent:[178,189,192],ask:132,aspect:[173,179],assembl:159,assert:[29,33,34,37,72,126,127,131,153,154,156,166,171,175,178,179,181,185,187,189,190,192,199],assess:197,assign:[43,47,56,88,91,104,129,136,152,155,157,162,176,177,179,188,197],assign_collector:104,assign_learn:104,assigne:[166,167],assum:[4,26,63,117,123,181],assumpt:117,astyp:4,asymmetr:175,asymptot:197,async:[80,86,90,107,143,144,146,147,166],async_op:90,async_process:145,async_train_queu:[79,145],asyncdataload:[80,145,156,157],asynchron:[79,157,171,199],asyncsubprocessenvmanag:[5,146,147,199],atari:[4,120,126,127,131,132,133,137,145,148,149,152,179,187,188,191,193,194,195,197,202],atari_env:[131,132,135],atarienv:135,atlanti:187,atoc:[133,182,194,202],atocpolici:174,atom:[37,48,175,187],attempt:[92,157,183],attent:[6,38,70,115,121,123,125,142,153,154,159,169,174,176,195,199],attention_s:[38,176],attibut:4,attr:[67,123],attribut:[27,49,50,52,53,54,69,75,107,123,130,134,147,149,154,157,162,163,166,176,188,199,200],audruna:186,augment:[189,190,191],auth:[14,15],authent:17,author:[165,175,182,185,187,193],auto:[0,14,15,124,189,191,199],auto_alpha:189,auto_checkpoint:[6,70,107,156],auto_reset:[146,147],autolog:[123,202],automat:[2,3,17,19,90,93,112,124,131,135,136,140,142,147,151,153,154,165,166,167,169,199,200],autonom:177,aux_:[45,184],aux_freq:123,aux_loss:[45,123],aux_value_loss:[45,123],aux_value_loss_avg:123,auxiliari:[4,45,123,184,193],auxiliary_loss:[45,123],auxiliary_loss_avg:123,avail:[130,138,140,183],aver:[42,178,189,192],averag:[45,63,64,95,108,119,123,134,135,142,144,171,172,178,187,188,191,192,199],avg:[123,142],avg_envstep_per_episod:134,avg_envstep_per_sec:134,avg_episode_per_sec:134,avg_pi:172,avg_sample_per_episod:134,avg_step_per_episod:134,avg_time_per_episod:134,avg_time_per_step:134,avg_train_sample_per_sec:134,avglist:142,aviv:177,avoid:[115,120,144,154,159,167,169,184,185,189,197],awai:[26,181],awak:20,away_id:26,axi:[188,189,191,201],azar:187,b440:134,b4a39461a268_451909_logg:134,b:[8,29,33,34,37,38,40,46,55,57,59,61,62,63,66,71,74,75,77,78,82,114,115,126,129,150,151,153,154,155,158,159,168,169,171,173,175,176,178,179,181,183,185,186,187,189,190,192],b_:[175,191],back:[72,130,140,157,174,189,199],backpropag:[127,183],backward:[39,40,41,42,45,46,47,48,107,127,151,172,178,188,189,192],backwardli:[172,174],badia:171,balanc:[41,45,119,162,163,177,183,184,188,190,197,199],bandit:[136,173,183],bandit_nois:136,bapst:172,bar:[172,181,183,187,191],barto:63,bartosz:183,base:[0,6,13,16,19,20,23,27,29,50,51,58,63,74,83,94,96,101,105,107,114,120,123,124,128,136,138,143,144,145,147,149,151,152,153,154,155,156,159,162,164,165,166,168,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,198,199,200,202],base_buff:[108,163,202],base_comm_collector:[6,98],base_comm_learn:[105,156,157],base_env:[5,6,148,149],base_env_manag:[5,6,94,152,199],base_leagu:[6,24,155,202],base_learn:[0,6,105,106,123,156,157,202],base_learner_default_config:[156,166],base_parallel_collector:[96,202],base_parallel_command:[6,103,202],base_polici:202,base_reward_estim:[6,51],base_reward_model:[49,202],base_serial_collector:[6,98,202],base_serial_command:[6,103,202],base_serial_evalu:[6,98,202],baseclass:[94,96,105],basecommcollector:98,basecommlearn:[106,152,156],baseenv:[5,152],baseenvinfo:[2,3,130,147,148,149],baseenvmanag:[5,94,138,152,199,200],baseenvtimestep:[3,148,149],baseleagu:155,baselearn:[0,101,106,123,138,156,157,166,200],baselin:[4,66,120,143,144,177,178,181,187,189,192],baselinevac:138,basemodelwrapp:[124,164,165],basenois:60,baseparallelcollector:96,baserewardmodel:[50,51,188],baseserialcollector:[0,101],baseserialevalu:[98,199,200],basetim:[108,123,142],bash:161,basi:[149,165,197],basic:[2,8,12,17,27,74,75,134,135,144,149,151,159,160,162,165,169,173,194,198,199],batch:[4,33,34,37,38,40,41,43,45,46,55,56,57,59,61,62,63,66,71,75,78,79,105,118,121,123,124,127,133,145,165,169,171,172,175,177,178,179,181,184,185,187,188,189,192,197,199],batch_:[43,47,179],batch_rang:190,batch_siz:[38,40,41,46,63,75,78,79,102,105,108,118,119,121,125,129,133,135,136,145,156,162,163,176,186,188,190,199,200],batchsiz:[63,64],batra:174,battl:[25,26,199],battlerecorddict:155,battlesharedpayoff:[27,155],bb:[153,154,158,159],bc:[117,190],bc_loss:[123,172],bc_weight:[45,184],beam:193,bear:144,beat:27,beaten:27,becaus:[48,69,115,121,132,133,134,149,151,154,157,163,175,176,179,187,188,193,197,199],becom:[133,155,173,181,191],been:[27,92,120,132,147,149,153,154,159,165,173,179,188,195,197,199],befor:[17,19,20,23,29,38,40,43,45,46,75,90,92,93,107,118,144,147,149,154,156,157,165,166,167,169,174,176,177,186,187,188,193,197,199,200],before_forward:124,before_it:[107,156,164,165,166,199],before_run:[107,156,164,165,166,199,200],before_task_start:20,begainn:75,begin:[54,75,107,117,122,133,135,151,166,167,172,175,178,186,187,188,189,191,192,193,194,199,200],beginn:[165,194],behavior:[45,117,133,136,149,165,172,180,181,199],behavioral_clon:[45,184],behavioral_cloning_loss:[45,123],behaviour:[17,19,23,61,66,197],behaviour_act:[61,66],behaviour_output:[61,66,181],behind:[4,166,181,188],bei:177,being:[147,149,154,157],believ:175,bellemar:175,bellman:[29,175,178,179,181,190,196,197],belong:[171,197],below:[112,120,135,138,147,179,180,187,188,190,193,199,200,201],benchmark:[136,152,171,175,176,177,178,179,181,182,184,185,186,187,189,192],benefit:[177,197],bengio:187,besid:[132,149,167,193,195,199],best:[134,154,155,184,190,194],beta:[73,108,129,163,178],beta_:184,beta_funct:202,beta_function_typ:29,better:[120,130,152,160,173,177,179,183,188,191,193,197,199],between:[19,26,27,40,41,45,46,66,69,75,93,96,118,128,133,138,147,152,155,157,163,165,171,172,173,175,176,177,180,181,184,186,188,189,191,192,193,197,199,201],beyond:[63,173],bia:[45,59,95,129,133,134,171,172,179,184,192,197,199],bias:[40,41,43,45,46,47,129,162,176,177,179,184,186],bidirect:174,big16:145,big64:145,big:[143,144,163,181,189,199],bigger:[40,41,43,45,46,47,48,162,163,172,175,176,177,179,181,184,186,187,188],bigtriangledown_:191,bilal:187,bilin:75,bilinearupsampl:[6,70],bin:[4,161,195],binari:[75,77,169,174,197],binary_encod:[6,70],bipedalwalk:202,bit:131,bitflip:[121,202],bitflip_dqn_main:121,blind:27,blob:63,block:[37,75,77,92,152,153,157,187],blog:[93,188],blue:[158,159],bn:75,board:173,bodi:197,boldsymbol:187,boltzmann:[190,191],bond:187,bonu:[4,181,188],bool:[0,3,4,11,12,17,19,20,23,25,26,27,28,29,33,34,37,38,40,41,42,43,45,46,47,48,56,61,62,63,67,68,69,72,73,74,75,81,82,84,89,90,91,93,94,95,100,101,102,108,124,127,131,148,149,162,171,172,175,176,177,178,179,181,184,185,186,187,189,190,192,199],booltensor:[63,190],bootstrap:[41,63,128,192,193],bootstrap_terminal_valu:64,bootstrap_valu:[63,64,181],born:173,borrow:120,bot:27,both:[21,23,28,33,75,115,117,118,120,144,155,157,163,167,171,172,178,179,181,184,185,187,188,190,192,197,199],bottleneck:75,bottom:[123,135,199],bound:[130,183,189,192],bound_typ:[29,34,171,181,185],boundari:120,box2d:[187,202],box:[135,195],bozhidar:177,brain:183,branch:[27,167,168,169,195],branch_prob:[27,155],breakout:135,brief:155,bring:[133,175,187],broadcast:[86,127],broken:199,brownian:178,browser:167,bs:133,bsuit:[137,194],bsuite_env:136,bsuite_id:136,bsuite_num_episod:136,bsuiteenv:136,buffer:[0,3,4,6,39,42,48,62,68,79,94,101,102,107,118,122,123,129,130,132,134,152,155,156,157,162,166,172,178,179,181,184,187,189,190,191,192,194,196,197,200],buffer_:108,buffer_id:[101,102],buffer_logg:134,buffer_tb_logg:134,bug:[168,169],build:[31,67,75,89,93,107,114,138,153,154,159,166,167,183,189,195,199,200],build_activ:[6,70],build_ce_criterion:[6,70],build_checkpoint_help:[6,70,156,166],build_learner_hook_by_cfg:[106,156,164,165],build_log_buff:[6,70,156,166],build_logg:[86,156,166],build_norm:[6,70],build_time_help:86,builg:68,built:[133,159],builtin:27,burda:188,burn:47,burnin:47,burnin_nstep_ob:133,burnin_ob:47,burnin_output:133,burnin_output_target:133,burnin_step:[47,133],busi:[144,152],button:[126,135,138],c029d882:134,c51:[37,133,141,150,151,182,187,194,202],c51dqn:[36,175],c51polici:175,c:[8,62,66,75,114,115,132,155,158,159,161,172,181,183,184,185,192,195,199,200],c_:[173,181,183],c_clip_ratio:[66,172,181],c_i:181,cach:[6,40,41,45,46,80,86,94],cachepool:98,calcuat:172,calcul:[4,38,40,41,43,45,46,47,48,56,59,62,63,66,69,74,75,82,108,110,114,116,123,126,128,129,133,142,151,155,159,160,165,172,176,178,179,181,182,185,186,189,190,192,197,199],call:[0,2,4,19,20,25,27,39,40,41,42,43,45,46,47,48,53,56,58,67,82,83,90,91,92,96,105,107,112,115,123,124,127,131,132,133,135,147,149,154,155,157,160,162,165,179,181,191,193,197,199,200],call_hook:[107,156,157,166,200],callabl:[2,3,8,17,20,27,63,67,71,73,75,76,77,79,82,90,91,92,96,100,105,107,124,156,166],callable_iter:81,callback:[20,96,100,105,153,154,157],callback_fn:[96,100],caller:[91,92],can:[0,2,8,11,12,17,19,21,23,25,26,27,35,40,41,43,45,46,47,48,49,50,56,58,62,68,75,78,79,81,82,90,92,93,94,95,96,101,105,107,108,112,114,115,117,118,119,120,123,124,125,126,129,130,131,132,133,134,135,136,138,140,147,149,151,154,155,157,159,160,161,162,163,165,166,167,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,194,195,197,199,200,202],cancel:19,cannot:[19,23,69,154,155,157,194,197],capabl:136,capac:[91,169,187],capit:[166,167],caption:[178,189,191,192],captur:[136,154],card:[121,154,163,199],care:[131,135,154,199],carefulli:[132,136,181],carla:[143,144,199],carlo:[128,173,183,193,196,197],carri:154,cartesian:126,cartpol:[118,125,150,151,190,199,200,201,202],cartpole_a2c_config:[150,151],cartpole_a2c_create_config:[150,151],cartpole_dqn:[134,200],cartpole_dqn_config:[161,199,200],cartpole_dqn_default_config:199,cartpole_dqn_ev:200,cartpole_dqn_main:[199,200],cartpole_ppg_config:125,cartpole_ppg_create_config:125,cartpole_ppg_main:125,cartpole_ppo_config:117,cartpole_ppo_create_config:117,cartpole_ppo_main:199,cartpole_rainbow_config:130,case1:[33,178,192],case2:[33,178,192],case_sensit:[114,158,159],cat:[161,181,189],catagor:69,catastroph:[117,197],categor:[69,171,181,190],categori:[27,155,197],categoricalpd:[6,70],categoricalpdpytorch:[6,70],caus:[47,92,129,135,147,151,154,169,179,188],causal:180,cc:[8,177],cd1cdd98caab8602ac6501ac:8,cd:[135,136,138,195],cdot:[171,172,176,177,184,189,191],cell:[29,75,168,169],center:[73,178],cento:195,central:[35,174,176,177,186,202],ceph:[84,85,139,140],certain:[68,95,134,147,151,155,165,176,183,197],cfg:[0,2,3,25,26,27,31,39,40,41,42,43,45,46,47,48,49,52,53,54,67,74,82,87,93,94,96,100,101,102,105,107,108,118,121,125,130,132,136,138,140,146,147,155,156,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,199,200],cfg_dict:0,cfg_text:0,chain:178,challeng:[136,174,176,177,178,183,186,193],champion:173,chang:[19,45,68,82,91,114,120,121,123,124,125,126,127,129,133,138,149,165,169,172,173,177,178,185,187,189,191,192,197,199],channel:[14,15,17,19,23,75,135,147,153,154,174],channel_invalid:[14,15],channel_not_found:15,channel_not_given:14,channelshuffl:[6,70],chapter:188,character:175,characterist:197,charat:159,chart:[115,167,184,193],chat:169,check:[4,17,19,23,72,81,82,91,115,147,148,149,152,153,154,169,194,199],check_onli:[114,158,159],checker:166,checkfor:[82,90],checkout:[168,169,194],checkpoint:[25,27,67,107,134,155,156,157,165,166,199],checkpoint_help:[6,40,43,45,46,70,107,202],checkpoint_path:27,checkpointhelp:[6,70],chelsea:180,chess:[121,163,173,193,199],chia:[174,176,177,186],child:[91,131,147,154],chines:[166,167],choic:[160,181],choos:[27,29,33,37,155,167,176,178,179,181,184,192,193,199],chosen:[61,66,181,188],christian:[174,176,177,186],christoph:173,chruncat:163,chunk:[79,145],chunk_siz:[79,145,156],ci:[168,169,202],cicular:163,circular:163,ck:[158,159],ckpt:[25,27,134,165,200],ckpt_:200,ckpt_baselearn:134,ckpt_best:134,ckpt_helper:67,ckpt_name:[107,134,200],ckpt_path:[27,200],ckx:[158,159],cl:[82,107,158,159,181],claim:[185,188],clamp:[172,181,188],clarifi:96,clariti:117,classic:[135,197],classic_control:[121,125,150,151,199,200,202],classifi:[154,174,197],classmethod:[56,93,94,108,163],clean:167,clear:[49,50,52,53,54,79,107,108,118,136,163,167],clear_dat:[52,53,54],clear_data:[49,50,52,53,54,118],clearli:[115,149,154,167,188,199],clh:199,cli:[132,194,195,199,202],client:[14,15,17,19,23,112,149,199],clip:[4,42,45,62,66,120,172,178,181,184,185,188,192],clip_:[45,184],clip_coef:73,clip_momentum_timestep:73,clip_norm_typ:73,clip_rang:[4,120],clip_ratio:[62,185],clip_reward:135,clip_valu:73,clipfrac:[45,123],clipped_c:181,clipped_pg_rho:181,clipped_rho:181,cliprewardenv:[5,120],clone:[45,117,138,168,169,181,191,195,197],close:[2,3,8,11,17,25,68,79,81,96,100,101,102,105,107,108,146,147,154,156,157,163,166,169,172,180,181,191,192,197],closur:73,cluster:[127,154,161,194],cn0014009700m:134,cnn1:[17,20],cnn:193,co:[42,158,159,175,178,192],cobb:184,code:[2,8,12,14,15,17,19,53,107,115,117,118,120,121,124,126,127,128,132,133,140,146,147,149,151,154,155,157,159,160,165,167,168,169,170,172,182,187,191,194,195,199,200],codebas:136,codestyl:166,coeffici:189,collab:176,collabor:[138,154,170,174,176,194],collaq:[6,36,44,133,141,182,194,202],collaqmultiheadattent:36,collaqpolici:[6,44,176],collaqsmacattentionmodul:36,collat:[45,79,80,86,181],collate_fn:[6,79,80,86,156,199],colleagu:169,collecotor:143,collecotr:143,collect:[0,2,3,28,29,34,37,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,63,90,94,95,101,107,110,116,117,118,119,121,122,125,131,133,134,135,136,138,143,144,149,151,155,158,159,162,163,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,194,195,199,200,201],collect_config:117,collect_count:117,collect_data:[49,50,52,53,54,118,119,190],collect_demo_data:117,collect_it:[163,199],collect_kwarg:[130,199],collect_mod:[42,117,121,130,138,162,174,178,192,199,200],collect_model:43,collect_reward:188,collect_s:[42,178,189,192],collect_st:188,collect_state_action_pair:51,collect_tim:134,collection_help:[6,86,202],collectionerror:115,collector0:199,collector1:199,collector:[0,2,6,40,41,43,45,46,47,48,56,59,61,66,67,101,102,104,108,117,118,119,121,125,129,130,131,133,134,138,149,152,155,157,161,162,163,172,175,176,177,179,181,184,186,187,190,194,197,200,202],collector_env:[82,130,138,200],collector_env_cfg:2,collector_env_num:[135,136,138,161,199,200],collector_episode_num:161,collector_host:[0,199],collector_info:67,collector_it:201,collector_logg:134,collector_model:199,collector_port:0,collector_step:[188,201],collector_task:[100,104],collector_task_count:101,collector_task_finish_count:101,collector_task_spac:101,collector_uid:96,collectorslav:98,collid:154,color:[158,159],com:[4,63,75,136,138,139,140,161,188,195],coma:[6,32,36,44,60,133,141,182,194,202],coma_data:57,coma_error:60,coma_loss:57,comaactornetwork:36,comacriticnetwork:36,comapolici:[6,44,177],comb:188,combin:[0,34,39,40,41,42,43,45,46,47,48,151,154,159,171,173,175,178,179,183,184,185,186,187,188,189,190,191,192,193,197,199],come:[78,133,165,181],comm:[6,98,106,156,157,202],comm_collector:132,comm_collector_nam:96,comm_collector_typ:96,comm_coordin:[6,103,202],comm_learn:132,comm_learner_nam:105,comm_learner_typ:105,comm_map:[96,105],comma:166,command:[6,103,129,132,134,135,136,138,147,151,155,157,161,194,195,200,202],command_mod:162,command_mode_policy_inst:202,commander_collector_logg:134,commander_evaluator_logg:134,commander_logg:134,commander_tb_logg:134,commcoordin:[6,103],comment:[53,160,167,169,170,191,194],commit:[167,168,169,200],commlearn:[96,105],commom:160,common:[6,9,16,20,32,78,93,96,107,110,116,120,121,126,132,148,149,151,154,159,160,162,163,166,171,179,192,195,197,199,200,202],common_env:[135,136,195],common_load:114,common_util:202,commonest:[123,197],commonli:[120,135,149,155,165,199],commun:[0,100,147,157,174],compar:[144,155,157,173,176,177,179,180,183,186,187,188,189,190,193,197],comparison:[144,152,175,197],compars:199,compat:[93,108,163,193,199],compens:187,competit:[155,177],competitive_rl:[155,202],compil:[0,199,200],compile_config:[1,138,199,200],compile_config_parallel:1,complet:[8,19,20,23,95,108,121,126,128,130,135,138,147,149,153,154,157,165,169,173,175,188,195,197,199,200],complex:[115,133,147,159,160,163,165,169,183,185,186,188,193,199,200],complic:[40,43,45,46,155,163,169,180,193],compon:[56,107,121,123,151,155,166,197,199,200],composit:[114,115,154],compound:[160,180],comprehens:167,compress:[77,177],compress_fn:77,compressed_data:77,compression_help:[6,86,202],compressor:77,comput:[29,33,34,35,37,38,43,56,61,63,64,68,75,150,151,154,159,171,172,175,176,177,178,179,181,185,186,187,188,189,191,192,193,194,197],compute_actor:[33,34,35,171,177,178,181,185,189,192],compute_actor_crit:[34,171,181,185],compute_crit:[33,34,35,171,177,178,181,185,192],compute_critic_q:189,compute_importance_weight:[60,181],compute_q_retrac:172,concat:53,concat_ob:138,concat_state_action_pair:53,concaten:177,concentr:[123,149],concept:[133,149,154,155,157,194,198],conceptu:126,concern:[38,192],concis:118,conclud:144,concret:[131,195,199,200],concurr:[8,81,154],conda:195,condit:[29,149,169,172,177,186,187,190,199],conduc:165,conduct:[144,187,188,189,200],confer:[174,177,186],confg:202,confid:[183,197],config:[2,3,6,25,26,27,31,39,40,41,42,43,45,46,47,48,49,52,53,54,67,74,87,93,94,96,100,101,102,105,107,108,118,119,121,126,127,128,129,132,133,138,139,140,146,147,149,150,151,152,155,156,162,163,166,171,172,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,192,193,194,202],config_:0,configur:[0,31,114,117,125,135,138,147,149,152,159,165,166,169,178,188,189,192,200,202],confirm:149,conflict:[149,168,169,199],confus:169,conn:[153,154],connect:[6,14,15,16,18,19,20,21,23,29,75,100,112,133,147,153,154,157,174,175,180,191],connect_timeout:[146,147],connectionrefus:[16,22,23],consequ:[27,190],consid:[27,120,128,133,149,154,159,169,176,177,186,188,189,190,192,197],consider:[165,183],consist:[131,155,174,177,180,186,193,199,200],consol:195,constant:[63,64,159,179,181,183,190,191],constantli:197,constitut:149,constrain:[172,178],constraint:[62,114,154,172,186],construct:[43,91,147,159,179,191,197,199,200],constructor:[11,12,14,15,17,19,20,21,23,92,199],consult:147,consum:169,contain:[2,4,25,26,27,37,41,48,59,63,67,75,78,79,82,87,94,96,107,108,124,126,133,135,136,138,147,149,155,157,158,159,161,172,173,183,185,187,189,190,197,202],content:[165,167,199],context:[8,17,75,88,127,140,173,190],context_dim:75,continu:[29,33,34,43,54,123,124,130,135,147,157,165,169,171,172,173,177,178,181,184,185,189,190,192,196,197,199],contrari:[188,197],contribut:[170,176,187,194,195,199],contributor:167,control:[8,42,58,108,125,126,127,129,149,152,153,154,162,165,171,172,177,178,180,181,185,188,189,192,193,197,199,200],controllablecontext:[9,16],controllableservic:[9,16],conv1d:75,conv1d_block:[6,70],conv2d:75,conv2d_block:[6,70],conv:[28,75,173],convencod:[30,188],conveni:[114,115,120,149,165,188,190,199],convenient:132,convent:[151,181],converg:[101,131,172,178,179,181,187,189,190,191,192,197,199],converge_stop_flag:117,convers:[147,159],convert:[0,75,159],convex:175,convient:[120,154],convinc:199,convlut:75,convnet:173,convolut:[28,75,173,187],convolv:75,convtranspose2d:75,cook:138,cooper:[138,174,177,186],coordin:[0,6,96,105,134,156,157,161,174,194,199,202],coordinator_host:0,coordinator_logg:134,coordinator_port:0,coorespond:[3,155],copi:[3,25,138,149,162,178,181,190,192,199],copy_data:3,copyright:166,core:[115,125,132,133,136,157,199],correct:[40,41,43,45,46,47,115,123,129,162,167,172,176,177,179,181,184,186,195,199],correct_terminate_gamma:56,correctli:[17,152,166,169],correl:[120,172,178],correspond:[2,3,27,31,33,34,63,75,77,82,92,93,94,96,101,102,105,107,128,129,133,134,135,140,147,149,151,154,155,157,163,165,166,167,169,171,178,181,185,187,188,190,192,193,195,197,199,201],correspondng:2,cost:[150,151,177,192,199],costli:193,could:[4,84,131,162,188,191],count:[4,27,54,108,118,120,129,134,163,183,199,201],count_factor:[45,184],counter:67,counterfactu:177,countvar:[6,70,156,166],coupl:[62,192,200],cours:[153,154,166],coutinu:197,covari:189,cover:[75,176,199],cp:[158,159],cpong_dqn_default_config:155,cpu:[45,49,52,53,54,96,143,144,145,152,156,166,188,189,194,195,199,200],cramped_room:138,creat:[0,3,12,19,25,26,27,31,58,67,75,89,94,96,101,105,107,108,112,118,124,132,136,147,149,153,154,155,156,157,161,162,163,165,167,169,178,189,197,199],create_cfg:[0,125],create_collector_env_cfg:[2,148,149],create_comm_collector:98,create_comm_learn:106,create_config:[0,127,132,135,136,187,199],create_env_manag:5,create_evaluator_env_cfg:[2,148,149],create_learn:106,create_logg:89,create_model:30,create_nois:58,create_noise_gener:60,create_polici:[132,156],create_reward_model:51,create_serial_collector:98,creation:[149,157],credit:[136,177],criteria:197,criterion:[63,74,150,151,190],critic:[33,34,35,41,42,45,55,125,160,171,172,174,177,181,182,185,188,189,191,193,198,199],critic_head_hidden_s:[33,34,171,178,181,185,192],critic_head_layer_num:[33,34,171,178,181,185,192],critic_loss:[172,178,192],critic_output:[34,171,181,185],critic_twin_loss:[178,192],crlf:[168,169],cross:[74,169],cross_entropi:69,cross_entropy_loss:[6,70],cs:181,csdn:93,cuda10:[150,151],cuda9:[150,151],cuda:[40,41,42,43,45,46,47,48,49,52,53,54,56,79,82,93,107,118,121,128,131,135,136,138,150,151,156,162,164,165,166,172,175,176,177,178,179,181,184,186,187,189,190,192,195,199,200],cuda_launch_block:[107,166],cuda_queu:[79,145],cuda_thread:145,cuda_visible_devic:127,cudafetch:[6,70],cude:82,cum_reward:[4,56,63,190],cumprod:126,cumul:[63,135,188,190,197,199],cup:191,cur:82,cur_collector_envstep:[108,118,119,121,125,130,200],cur_learn_it:102,cur_learner_it:[102,108],cur_lr:[40,41,43,46,47,48,123],cur_lr_avg:134,cur_lr_val:[150,151],current:[4,17,19,20,23,25,27,39,40,41,43,45,46,47,48,52,58,61,66,90,92,95,96,102,108,118,126,134,147,152,154,155,156,157,162,163,165,166,173,175,177,178,179,181,187,192,197,199],current_hav:134,current_lr:45,current_tim:108,curs:180,custom:[40,41,43,45,46,122,133,149,162,165,188,194,200,202],customr:162,cut:[38,162,181],cycl:[154,155],cyclic:147,czarnecki:186,d1:82,d2:82,d:[8,43,117,131,156,158,159,173,178,180,181,184,189,190,191,192,193,196],d_:[172,191],d_k:38,d_model_q:38,d_model_v:38,d_out:38,d_t:133,d_v:38,da:174,daan:[178,179],dabnei:[175,187],daemon:92,daewoo:186,dagger:117,dan:187,danger:190,data:[0,2,3,6,12,14,17,19,20,21,23,26,35,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,59,62,63,66,67,68,69,71,77,81,82,84,86,90,91,94,96,102,105,107,108,114,117,118,120,122,123,124,125,126,127,128,129,131,134,135,147,149,151,152,153,154,155,156,157,159,161,162,164,165,166,171,172,173,176,177,178,180,181,185,186,187,188,189,190,192,193,194,197,200,201],data_compressor:77,data_count:[4,120],data_decompressor:77,data_help:[6,70,199,202],data_id:[40,46,102,133],data_n:[126,128,129],data_path:117,data_preprocess:156,data_preprocess_tim:156,data_sourc:[68,79,145],data_tim:[107,156],dataflow:[124,145,199],dataload:[6,80,86,105,107,156,157,194],dataset:[67,197],datatyp:136,david:[171,175,178,179,186,187,192,193],dblevent:[9,16],dcf5f375b290_886803_logger:134,ddpg:[6,44,133,141,174,177,182,188,189,192,194,196,197,202],ddpgpolici:[6,44,178],de:[172,174,176,177,186],deadlock:92,deal:[56,82,102,197,199],deal_with_collector_clos:96,deal_with_collector_data:96,deal_with_collector_finish_task:102,deal_with_collector_learn:96,deal_with_collector_send_data:102,deal_with_collector_start:96,deal_with_get_data:[156,157],deal_with_learner_finish_task:102,deal_with_learner_get_data:102,deal_with_learner_learn:[105,156,157],deal_with_learner_send_info:102,deal_with_learner_start:[156,157],deal_with_resourc:96,dealt:102,debug:[4,81,107,146,147,149,161,163,166,199],decai:[26,40,41,43,46,47,48,58,135,136,162,175,179,187,197,200],decent:[93,179],decentr:[35,174,176,177,186],decid:[25,92,174,197],decis:[117,174,183,194,196,198,199],decol:78,decompos:[176,186],decomposit:[172,176,179,186],decompress:77,decompress_fn:77,decompressor:77,deconv2d_block:[6,70],decor:[8,115,132,147,149,165],decoupl:[172,181,187,199],decreas:[56,58,82,144,172],decrease_spac:82,decrement:82,dedic:154,deduc:180,deep:[66,133,136,160,171,173,177,178,179,181,183,185,186,187,188,189,190,192,194,200],deep_merge_dict:[86,156,166],deep_upd:86,deepcopi:[26,94,108,117,125,138,162,178,181,190,192],deepli:[82,194],deepmind:[25,63,136,173],def:[23,82,90,92,107,114,115,120,123,124,126,127,128,129,130,131,133,138,142,146,147,153,154,155,156,158,159,166,171,172,181,185,188,189,190,200],defail:160,defalut:[68,75,189],default_col:[80,199],default_config:[3,49,50,94,108,162,163],default_decol:[80,199],default_experi:[107,108,187],default_fn:82,default_func:[9,16],default_get:86,default_get_set:82,default_help:[6,86,131,133,202],default_model:[40,41,43,45,46,133,162,176,177,184,186],default_ret:[82,90],default_valu:82,defaultli:[49,52,53,54],defeat:[27,155,173],defin:[40,41,43,45,46,93,115,117,120,124,127,131,149,152,154,155,162,163,165,168,169,171,172,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,199],definit:[40,41,43,45,46,67,94,120,147,149,155,162,181,191,197,199],del:156,delai:[42,178,192],delet:[19,79,108,151,152,166,167,169],delete_used_data:108,delimit:82,deliv:138,delta:[172,174,175,181],delta_:[171,175,196,197],delta_t:181,demand:[162,194,199],demi:193,demo:[127,135,136,138,150,151,154,155,162,199,200],demonstr:[40,41,43,45,46,117,118,125,127,130,134,163,188,189,190,194],deni:[139,140],denot:[58,118,123,187,188,197],dens:135,densiti:175,depend:[27,33,34,78,91,96,108,133,135,149,151,167,171,175,176,178,181,185,189,192,195,197],deploi:[117,157,161,200],deploy:161,depth:169,dequ:[56,128],dereiv:69,deriv:[25,27,58,96,105,107,108,126,133,149,157,163,166,172,175,191,192,199,200,202],descent:[178,180,188,189,192],descib:169,describ:[117,126,133,135,138,157,161,169,179,181,185,197,199,201,202],descript:[4,40,41,42,43,45,46,47,48,89,149,167,172,175,176,177,178,179,181,184,186,187,189,192,197,199],deseri:84,design:[47,49,50,56,69,107,115,125,136,144,152,155,159,160,161,162,169,175,187,194,197,199,200,202],design_help:[6,86,202],desir:136,destin:[25,161],destroi:147,detach:[172,188,189,190],detail:[26,28,29,33,34,37,75,93,96,105,107,117,120,123,124,127,130,133,135,140,147,149,155,161,163,166,169,171,172,175,176,178,179,181,182,185,186,187,192,197,199,200,201],detect:[93,147],determin:[29,33,34,41,42,63,95,149,171,174,178,181,183,185,188,189,190,192,197,199],determinist:[29,69,175,178,187,188,192,196,197],deterministic_ev:189,determist:[190,197],dev:169,develop:[114,120,135,138,140,161,167,169],devi:174,deviat:[58,134,188],devic:[49,52,53,54,58,68,79,93,127,162,181,188,189,190,199],device_id:127,dhariw:185,dhruv:174,di:[42,45,117,118,120,121,124,125,127,128,129,131,132,134,139,141,143,146,147,148,149,150,152,157,160,163,166,167,171,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200],diagnost:4,diagon:189,diagram:[112,115,149,157,190,197,199,202],dict:[0,2,3,4,8,25,26,27,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,52,53,54,56,67,68,69,74,78,79,82,84,87,89,93,94,95,96,100,101,102,104,105,107,108,114,115,123,124,125,128,129,130,132,133,135,136,139,140,146,147,148,149,155,156,157,159,160,161,162,163,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,199,200],dict_:[114,115,158,159],dict_kei:[40,46,78],dicterror:115,dictionari:[3,29,31,37,53,82,147,165,175,187],dictionri:[34,171,185],dicts_to_list:86,did:134,didn:[95,199],diengin:161,diff:[40,41,43,45,46,47,48,114,172,175,176,177,179,181,184,186,187],diff_shape_col:80,differ:[2,27,42,43,45,47,56,62,78,79,94,95,107,115,117,120,121,127,128,129,130,131,133,134,144,147,149,152,154,155,157,160,161,162,163,165,166,171,172,173,174,175,179,180,181,184,187,188,189,192,193,194,197,199,201],differenti:[55,57,62,66,72,189],differnec:[6,60,197],difficult:[134,167,193],difficulti:[27,136,141,197],dijob:[152,202],dilat:75,dile:84,dilut:177,dim1:78,dim2:78,dim:[28,29,33,38,55,57,61,62,63,66,74,75,78,126,127,135,143,144,176,178,181,186,188,189,190,191,192],dimens:[35,37,38,71,75,78,118,126,136,144,149,176,177,179,180,186,188,193],dimension:[171,178,180,197],dimitri:185,ding:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,58,67,68,69,73,74,75,76,77,79,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,100,101,102,104,105,107,108,117,118,120,121,123,124,125,127,128,130,131,132,133,135,136,138,142,148,149,150,151,152,154,155,157,160,161,162,163,164,165,167,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200,202],ding_root:161,dingenvwrapp:[138,200],dir:[89,161],direct:[133,135,169,174,175,181,185,188,197],direct_print:[89,156,166],directli:[0,12,17,43,56,82,89,107,115,124,129,135,136,138,149,154,157,160,165,167,169,177,181,189,197,199,200],directori:[107,140,151,161,167,187,199,200],dirnam:200,disabl:[79,131,151,199],disadvantag:197,disappear:188,discard:56,disconnect:[15,17,19,21,23,112,157],disconnectionrefus:[16,22,23],discount:[40,41,43,45,46,47,48,56,59,63,66,162,175,176,177,179,184,186,187,188,190,193,197],discount_:[43,47,48,175,179,187],discount_factor:[128,135,136,162,200],discret:[29,33,37,61,66,122,123,130,133,135,136,138,165,171,172,175,176,177,178,179,181,184,185,186,187,190,191,192,194,196,197],discretehead:[30,37,179],discrimin:[134,166,180],discuss:[4,169,194,197],disjoint:184,disk_help:90,dispers:154,displai:[89,134,140,156,161,166],dist:[63,150,151,161,171,189,194],dist_behaviour:181,dist_entri:202,dist_fin:[86,156],dist_info:107,dist_init:[86,156],dist_mod:86,dist_nstep_td_data:63,dist_nstep_td_error:60,dist_target:181,distanc:[53,71],distcontext:127,distil:[45,160,184,188,199],distinguish:[180,199],distort:45,distribut:[6,29,37,42,47,48,58,63,66,70,90,107,117,120,123,127,133,154,155,161,171,172,174,175,178,180,181,187,189,190,192,194,197,199,202],distributionhead:30,distributiontimeimag:86,disturb:[68,107,154],div:172,diverg:[172,184,185,189,191],divers:[131,155,160,181,188],divid:[0,79,82,133,154,157,163,188,199,202],divis:52,dizoo:[121,125,126,127,131,132,135,136,138,150,151,155,187,199,200,202],dn:154,dntd:[150,151],doc:[28,29,31,37,69,75,166,167,172,181,194,195,200,202],docker:135,document:[82,169,170,195,197,199],doe:[27,42,45,75,82,108,128,135,151,157,162,163,197,199],doesn:[166,176,179,200],doi:[173,193],domain:[93,120,173,183,190,193,194,197],don:[58,62,107,127,147,155,188,199],done:[3,4,17,27,39,40,41,42,43,45,46,47,56,59,63,75,120,126,128,129,132,133,135,146,147,148,149,157,162,169,172,178,179,181,187,189,190,191,192,197,199],dontprintsemicolon:191,doron:181,dos2unix:[168,169],dot:[38,181],doubl:[11,42,43,155,160,175,178,179,182,185,189,192],double_dqn:133,doubt:166,down:[8,14,15,19,23,81,126,131,135,138,190],download:195,dozen:138,dp:[196,197],dpg:178,dqn:[6,36,44,47,48,118,124,126,127,128,132,133,134,135,136,141,151,160,161,162,175,176,182,187,190,194,200,201,202],dqn_polici:[132,199],dqn_user_config:199,dqnmultidiscretepolici:126,dqnpolici:[6,44,48,126,132,162,179,187,199,200],drag:78,dragan:190,dramat:[179,183],drastic:144,draw:[26,155,191],drew:190,drl:[134,191,194],drop:[56,151,181],dropout:[38,75],dropout_prob:75,dropout_ratio:75,drqn:[36,43,47,133,176,179,186],ds_store:[168,169],dst_checkpoint:25,dt:[58,158,159],dtype:[3,68,78,130,135,147],dual:[173,185],dual_clip:[62,185],due:[59,117,120,140,144,147,157,160,163,165,173,178,180,188,193,197,199,201],duel:[29,37,38,43,48,136,173,175,176,179,182,186],duelinghead:[30,37,134,160,179],dummy_compressor:86,dummy_decompressor:86,dump:[77,84],dun:181,durat:134,dure:[42,43,45,118,124,125,127,134,135,144,147,149,155,161,163,165,175,177,178,179,184,186,187,188,190,192,194,197,199,200,201],duti:154,dw_t:58,dx:193,dx_t:58,dynam:[2,122,133,135,174,183,188,190,193,194,196,197,199],dynamic_se:[3,82,131,138,200],e:[4,25,27,29,33,34,42,43,49,50,52,53,54,56,61,63,66,71,79,81,88,91,107,108,117,118,120,121,124,126,129,132,133,135,138,139,140,144,155,157,159,160,161,162,163,166,167,169,171,172,174,175,176,177,178,179,181,184,185,187,188,189,190,191,192,193,195,196,197,199,200],e_:[52,196,197],each:[3,25,26,29,33,35,37,38,41,43,53,56,63,64,75,78,79,90,93,94,95,96,105,107,108,118,119,121,123,124,125,126,127,129,131,132,133,134,135,136,138,144,147,149,154,155,157,160,161,163,165,167,169,174,175,176,177,178,179,180,181,186,187,188,189,190,191,192,197,199,200,201,202],each_reward:134,earl:186,earli:147,earlier:165,eas:138,easi:[0,115,133,134,138,154,165,188,197,200],easier:[27,149,193],easiest:188,easili:[93,108,114,117,133,157,163,165,172,186,190,192,197,199],east:138,easydict:[0,2,3,25,26,27,31,33,87,94,96,105,107,108,135,136,156,161,166,178,187,188,192,199,200],easytim:[86,156,166],ecec:173,ed:92,edit:[71,167,169],editor:167,edu:173,edward:[188,193],effect:[4,49,50,52,53,54,63,82,120,165,166,175,188,197],effici:[136,147,151,161,172,173,177,181,183,193,194,196,197,199],effort:165,egorov:177,either:[33,92,117,133,163,178,192,197,199],eject:81,el7:195,el:[40,46,78],elaps:197,eleg:[159,199,200],element:[2,3,33,37,38,43,56,63,68,75,76,78,82,90,91,94,105,108,121,132,149,159,163,175,176,178,179,181,186,192,199],elif:[131,181,188],elig:91,elimin:191,els:[82,121,123,126,146,147,153,154,156,166,178,181,188,189,190,192],emb:169,embed:[28,29,33,34,37,75,171,175,178,181,185,187,188,192],embedding_s:[38,189],emded:38,emerg:174,emphas:166,empir:[175,176,188,197],emploi:[186,189],empti:[68,102,135,149,155,157,178,181,188,189,191,192],empty8:188,enabl:[40,43,46,47,48,81,108,120,127,128,131,138,151,179,190,197,199,200],enable_fast_timestep:133,enable_field:[39,40,41,42,43,45,46,47,48,156,162,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192],enable_grad:181,enable_hpc_rl:[150,151],enable_save_replai:[2,3,135,148,149,200],enc:193,encapsul:[127,165,200],encod:[6,29,30,32,33,34,37,38,75,134,171,174,175,177,178,179,181,185,187,188,192,193,202],encoder_hidden_size_list:[34,37,135,136,171,175,179,181,185,187,200],encount:[136,155,187,195,199,200],encourag:181,end:[4,14,15,17,19,20,23,43,48,56,58,81,91,107,112,120,134,135,136,138,147,149,153,154,155,157,162,163,166,172,174,175,178,179,186,187,189,191,192,193,197,199,200],end_flag:[68,79],end_tim:93,endfor:[178,189,192],endif:[178,189,192],enduro:135,energi:[180,189,190],engin:[20,107,117,118,120,121,124,125,127,128,129,131,132,134,136,138,143,146,147,148,149,150,152,156,157,160,161,163,166,167,171,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200],engine_env_wrapp:131,engineenv:[146,147],english:[166,167],engstrom:185,enhanc:200,eniron:197,enlarg:188,enntropi:74,enough:[25,27,147,155,163,169,187,199],enought:135,enrich:155,ensur:[26,82,93,131,154,165,167,169,172,186,187,192,195,199,200],enter:[8,88,93,157,165,167,199],entir:[82,128,135,169,177,193,197,199],entiti:75,entri:[75,82,107,117,121,125,127,129,131,135,136,150,151,155,157,187,190,200,202],entropi:[41,45,69,74,171,177,180,181,184,189,190,191],entropy_:[41,45,177,184],entropy_loss:[41,45,55,57,123,171,181,185],entropy_weight:41,enumer:[147,159,172,190],env:[0,6,27,28,39,40,41,42,43,45,46,47,48,56,58,94,108,121,122,126,131,132,134,136,138,139,140,141,143,144,145,152,161,162,164,165,172,175,176,177,178,179,181,184,186,187,188,189,190,192,194,195,199,200,201,202],env_el:[148,149],env_element_runn:[148,149],env_fn:[2,3,138,146,147,200],env_id:[3,39,40,41,42,43,45,46,47,48,95,135,136,146,147,161,199],env_info:[3,130],env_manag:[0,5,6,94,135,136,152,187,199,202],env_nam:138,env_num:[3,26,94,95,131,133,134,146,147],env_ref:130,env_wrap:120,env_wrapp:[5,6,120,164,165,202],envel:152,envelementinfo:[3,130,147,148,149],envelementrunn:152,environ:[0,2,3,4,27,94,95,107,117,120,121,124,126,127,130,131,133,134,140,144,147,149,150,151,152,154,155,160,163,165,166,174,175,177,178,179,181,183,187,188,189,190,191,192,193,194,195,196,197,201,202],environment:[147,149,193,197],envmanag:[194,199],envnam:199,envname_policyname_main:199,envstep:[94,107,118,119,121,125,134,138,190,199,200],envstep_count:134,envwrapp:147,eof:[161,199],ep:[29,40,41,43,46,47,48,65,73,118,121,135,136,162,172,175,179,187,190,200],episod:[4,56,59,94,95,108,120,122,128,131,133,134,135,146,147,148,149,163,173,181,188,194,199,201],episode1v1collector:138,episode_buff:[108,121,163,202],episode_collector:199,episode_count:134,episode_lif:135,episode_num:[26,146,147],episode_s:121,episode_serial_collector:[6,98,202],episodecollector:[98,199],episodereplaybuff:[121,152,199],episodiclifeenv:[5,120],epoch:[45,67,150,151,184,185],eposid:134,eps_cfg:200,eps_fn:58,eps_greedi:[40,41,43,46,47,48],eps_greedy_sampl:[40,41,43,46,48,164,165],epsgreedysamplewrapp:[124,164,165],epsgreedysamplewrapper_sql:190,epsgreedysamplewrappersql:190,epsilon:[4,40,41,43,46,47,48,58,124,129,162,165,175,178,179,185,187,188,189,190,192,199],epsilon_:189,epsilon_greedi:[58,118,200],epsiode_lif:135,equ:62,equal:[19,23,56,133,135,136,172,178,181,189,192],equat:[182,196,197],equip:[154,171,175,185,187],equiv:187,equival:[63,110,116,149,159,190,191],erent:[40,41,43,45,46,47,48,172,175,176,177,179,181,184,186,187],erez:178,ermon:180,err:23,error:[12,14,15,19,20,63,82,92,102,117,129,133,146,147,149,152,167,172,175,179,180,187,188,190,192,194,197,199,200],error_cod:[14,15],error_task_start:20,error_wrapp:[86,90],errro_wrapp:86,es:167,eseri:134,especi:[114,144,159,167,181,187,188],espeholt:181,essenc:157,essennti:157,essenti:201,establish:[17,19,23,112,147,153,154,157,188],estim:[4,29,43,47,48,49,50,52,53,54,59,63,64,118,120,121,128,162,171,175,177,179,180,181,182,183,186,187,188,191,192,193,197,199],et:[173,174,176,177,180,186,188],eta:187,etc:[3,29,49,50,52,53,56,79,82,84,91,93,105,107,117,123,128,130,133,135,138,149,151,154,155,157,166,167,169,173,187,194,197,199,200,201],euclidean:53,eval:[39,40,41,42,43,45,46,47,133,135,136,138,162,164,165,188,199,200],eval_flag:[25,27],eval_freq:[135,136],eval_mod:[42,162,174,178,192,199,200],eval_model:[43,199],eval_reward:188,evalu:[0,2,25,27,39,40,41,42,43,45,46,47,93,95,101,107,121,127,131,134,136,138,149,155,157,162,173,175,179,181,187,188,194,195,197],evaluate_tim:134,evaluator1:138,evaluator1_cfg:138,evaluator2:138,evaluator2_cfg:138,evaluator_env1:138,evaluator_env2:138,evaluator_env:[82,200],evaluator_env_cfg:2,evaluator_env_num:[135,136,138,161,199,200],evaluator_episode_num:161,evaluator_it:201,evaluator_logg:134,evaluator_step:[188,201],evalul:199,evalut:197,even:[4,115,188,193,197,199],event:[11,134,153,154,161],everi:[4,27,79,120,123,124,133,135,155,165,197,201],everyth:[172,181,200,201],evn_id:120,evolut:199,exactli:[79,115,120,155],exampl:[3,8,17,20,21,23,29,33,34,37,49,50,58,62,75,76,77,78,82,88,90,92,93,95,107,114,115,119,121,122,123,125,127,128,129,130,131,132,136,140,147,149,151,152,154,155,157,162,165,166,169,171,175,178,179,181,185,187,188,189,190,192,194,197,199,200,201],exc_tb:8,exc_typ:8,exc_val:8,exce:[120,147,154,155,199],exceed:[93,147,199],except:[6,16,19,20,21,23,26,67,82,90,92,96,107,144,147,154,175,202],exception_class:[14,15],exclus:175,excut:154,execut:[17,19,20,23,33,34,43,92,95,100,127,129,140,144,147,149,151,154,155,157,165,171,172,174,177,178,181,185,186,189,192,193,194,195,199],exemplifi:132,exhaust:4,exhibit:[133,199],exist:[19,23,82,107,117,127,149,152,153,155,157,169,193,197,199],exist_ok:200,exit:[2,8,93,147,199],exp:[43,58,135,136,162,179,181,187,189,190,191],exp_nam:[107,108,136,138,187,200],expand:[154,176,183],expans:183,expect:[155,172,175,178,188,189,192,196,197],expect_entropi:191,expens:180,experi:[47,48,107,108,120,121,122,126,131,133,134,135,136,161,162,163,172,174,175,177,179,181,182,188,189,190,193,194,196,197,199,200,201],experiment:[127,152,188],expert:[49,50,52,53,54,117,118,125,162,173,180,190,199],expert_:53,expert_a:53,expert_data:[49,50,52,53,54,117,118,199],expert_data_path:[52,53,54,117,118],expert_polici:[117,199],expertpolici:199,expir:[108,123,142],explain:[124,133,157,166,197,199],explainhow:120,explan:188,exploit:[27,162,174,183,188,196,197,199],explor:[6,40,41,43,46,47,48,60,120,129,136,149,162,173,175,178,179,181,183,187,188,189,190,191,194,197,199,200,202],explos:190,expolit:197,expolr:197,exponenti:[58,171,190,200],expos:[165,180],express:[4,172,189,197],ext_arg:[107,164,165],extend:[2,43,107,121,149,177,179,180,186,197,199],extended_arg:107,extens:[154,182],extern:[149,165],extra:[45,56,71,75,79,123,124,186,195],extra_fn:71,extract:[120,159,193],extractor:199,extrins:188,ey:173,f062:134,f084:134,f1:8,f2:8,f3:8,f:[129,161,168,169,171,172,181,188,191,196,197],f_:[187,189,193],f_z:175,face:[188,190,197],facilit:[120,147,154],fact:[120,154,182],factor:[40,41,42,43,45,46,47,48,56,59,63,66,126,162,175,176,177,178,179,181,184,186,187,188,189,190,192,197],factoris:186,factoriz:186,fail:[12,14,15,20,23,85,96,101,112,135,153,154,195],failur:[21,23,117,136,153,154],fair:[118,162],fairli:199,fake:[43,45,47,179],fake_linklink:[85,202],fakelink:[82,90],fall:197,fals:[0,4,11,17,19,23,25,26,27,28,29,33,34,38,40,41,42,43,45,46,47,48,56,69,72,73,75,81,82,94,108,114,124,128,133,135,138,139,140,146,147,153,154,156,158,159,161,162,166,171,172,175,176,177,178,179,181,184,185,186,187,188,189,190,192,200],famili:194,familiar:[169,188],faq:[152,194],far:[155,165],farquhar:[174,176,177,186],fast:[138,145],faster:[75,120,144,165,197,199],faulti:167,favor:189,fc1:75,fc2:75,fc68e215:134,fc:[28,75],fc_block:[6,29,33,34,37,70,171,175,178,179,181,185,187,192],fcencod:[30,134,188],fd73:134,fe4f:134,feasibl:[117,169,173],featur:[8,28,38,45,73,75,108,114,120,147,159,163,169,173,176,184,187,188,199],feature1:152,feature2:152,feature3:152,feature4:152,fed:187,fedu:187,feed:[28,186],feedback:[154,197],feedforward:[75,133],feel:[129,152,199],femal:114,feng:169,fetch:[68,107,157,168,169,199],few:[118,161,165,172,181,188],ff1:8,ff2:8,ffline:197,ffmpeg:[135,200],fieid:[55,57,62],field:[59,63,66,78,79,133,140,149,161,173,199,200],fifo:199,fig1:183,fight:155,figur:[63,133,147,149,187,190,199,200],file:[0,2,40,41,45,46,47,84,87,88,89,93,96,100,101,102,105,107,108,125,127,132,133,134,135,136,138,140,145,149,151,157,161,163,166,167,169,187,199,200,201,202],file_help:[6,86,202],file_path:[163,199],file_to_dict:0,filenam:0,filesystem:161,filip:185,fill:[3,29,63,133,161,190],final_eval_reward:[135,148,149],final_tanh:29,find:[91,124,132,138,144,155,163,165,172,174,177,178,179,183,189,190,192,195,197,199,200],find_ab:[158,159],find_free_port:86,find_prefixsum_idx:91,finish:[25,26,101,102,125,134,146,147,155,156,157,166],finish_collector_task:101,finish_job:[25,155],finish_learn_info:101,finish_learner_task:101,finish_task_info:101,finished_task:[101,102,105],finit:197,finn:180,finsh_collector_task:101,firdau:185,fire:[4,120,135],fireresetenv:[5,120],firoiu:181,first:[3,25,27,58,63,72,75,78,79,91,96,105,107,114,118,121,131,133,135,147,149,154,155,157,160,161,163,165,166,172,173,175,178,179,180,181,187,188,189,190,192,193,195,197,199,200,201],firstli:[131,200],fit:[40,41,45,46,188,197],five:134,fix:[4,26,27,29,108,120,121,123,135,136,138,163,169,175,177,179,181,188,197,199,201],fixed_sigma_valu:29,fixed_tim:108,flag:[27,42,81,82,140,178,189,192,199],flask:[19,23,96,105,157,161],flask_fs_collector:[6,98],flask_fs_learn:[105,156,157],flaskfilesystemcollector:98,flaskfilesystemlearn:[106,156,157],flatten:82,flatten_dict:86,flexibl:[159,199],flip:126,float32:[4,130,135,136],floattensor:[33,34,37,38,55,57,59,61,62,63,66,71,75,171,175,178,179,181,185,187,190,192],flow:[115,133,167,177,184,193,194,199],fluctuat:[144,151,199],flush:108,fly:173,fn:[53,82,90,93,156,159,166],fo:[40,41,45,46,47,48],focal:74,focu:[177,199],focus:[159,197],foerster:[174,176,177,186],folder:[122,140,169,194,201,202],follow:[0,4,14,15,17,20,29,43,46,107,113,114,117,119,120,121,123,124,125,126,127,128,132,133,134,135,136,138,140,144,147,149,151,154,155,157,159,160,161,162,165,166,167,169,171,172,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,192,193,195,197,199,200,202],footbal:117,footballkaggle5thplacemodel:162,foral:[175,186],forbidden:169,forc:[25,162,169],forcibl:169,forget:174,fork:[154,167,168,169],forked_path:[168,169],form:[21,49,50,52,53,56,89,110,115,116,125,133,142,151,159,172,181,187,189,190,191,193],formal:[128,187],format:[0,27,40,41,43,45,46,49,50,53,67,68,75,77,89,114,118,124,131,135,138,147,149,152,154,156,157,166,167,185,188,190,200],formatted_total_config:[134,199],former:[124,133,149,199],formul:176,formula:[189,193],forward:[3,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,74,75,107,124,126,130,133,151,156,160,162,164,165,171,175,176,177,178,179,181,185,186,187,188,189,190,192,197,199],found:[14,15,19,85,117,120,124,133,135,136,153,154,155,159,163,165,171,185,186,188,194],four:[26,96,155,157,165,193],fourroom:188,frac:[65,172,173,175,178,181,183,184,185,186,187,189,191,192,193],fraction:92,fragment:94,frame:[4,67,120,135,199],frame_stack:[135,161],frameskip:[4,120],framestack:[5,120],framework:[110,112,113,115,154,159,177,181,186,191,194,197,199,202],free:[92,129,160,171,172,174,175,176,177,178,179,181,183,184,185,186,187,189,190,191,192,193,196,197,199],freez:[108,155],freita:172,freq:[45,107,162,164,165,184],frequenc:[43,45,47,123,162,179,184],frequent:187,friction:178,from:[0,2,4,14,15,17,19,21,23,25,26,27,29,33,39,40,41,42,43,45,46,47,48,52,53,54,58,63,64,67,68,69,75,79,82,84,87,92,93,96,102,105,107,108,112,114,115,117,118,120,121,123,124,125,126,127,128,130,132,133,134,135,136,138,142,146,147,148,149,150,151,153,154,155,157,159,161,162,163,164,165,166,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,195,197,199,200,202],front:[166,181],frozen:155,fs_type:84,ft1:8,fujimoto:192,fulfil:162,full:[81,113,117,125,136,152,159,167,199],fulli:[20,75,120,138,149,175,177,197],func1:20,func2:20,func3:20,func:[8,67,92,93,115],functool:[146,147],fundament:187,further:[4,27,41,63,82,108,120,144,154,169,185,192,195,197],fusion:188,futur:[40,41,43,45,46,47,48,56,59,63,66,120,162,175,176,177,179,184,186,187,188,193,197,199],fx:8,g:[25,27,29,43,49,50,52,53,54,79,81,91,107,108,117,118,124,126,129,133,135,144,155,157,159,160,161,162,163,166,167,169,172,174,175,176,177,186,187,193,195,199,200],g_:[128,172,177],g_t:[172,196,197],gae:[6,45,56,60,150,151,171,184,185,199,202],gae_:[45,184],gae_lambda:56,gail:[6,51,182,194],gail_irl_model:[6,51,202],gailrewardmodel:[51,118],gain:[173,175,183,199],game:[4,25,26,27,101,117,120,121,126,133,135,138,155,163,173,185,187,188,197,199],gamma:[40,41,43,45,46,47,48,56,59,63,64,66,74,128,162,171,172,174,175,176,177,178,179,181,184,186,187,189,190,191,192,193,196,197],gamma_:[187,193],gan:180,gap:[163,199],garbag:2,gate:[75,174],gather:172,gauss:[165,173,192],gaussian:[58,178,189],gaussiannois:60,gender:114,gener:[3,8,17,19,27,39,40,41,42,43,45,46,47,48,56,58,59,75,82,88,112,115,117,118,121,122,128,130,131,135,136,138,140,144,147,149,151,154,155,160,161,163,165,166,167,169,171,172,179,180,181,183,186,188,189,190,191,194,197,199,200,201],generalis:190,generalized_lambda_return:60,georg:[175,187],geq:[181,186],gervet:174,get:[2,3,4,11,12,19,20,21,25,26,27,28,38,39,40,41,45,46,48,49,50,52,53,54,56,58,68,74,75,77,79,81,82,87,88,89,90,91,92,94,95,96,101,102,105,107,108,120,121,123,126,128,129,130,133,144,146,147,148,149,153,154,155,156,157,161,162,165,166,169,172,177,179,181,185,188,194,199],get_attribut:[118,121,125,146,147,190,200],get_cached_data_it:81,get_collector_task:101,get_cuda_time_wrapp:86,get_current_episod:[95,199],get_data:[105,107,156,157],get_data_compressor:86,get_data_decompressor:86,get_data_thread:[79,145],get_env_cl:5,get_env_manager_cl:5,get_episode_info:95,get_episode_reward:[95,199],get_epsilon_greedy_fn:[60,200],get_ga:[56,199],get_gae_with_default_last_valu:56,get_group:86,get_ip:86,get_job:[27,155],get_job_info:[25,155],get_kei:26,get_latest_reward:95,get_learner_task:101,get_lstm:[6,70,133],get_master_exception_by_error:[13,16],get_master_exception_class_by_error_cod:[13,16],get_nstep_return_data:[56,128,133,199],get_operator_server_kwarg:86,get_pid:86,get_policy_update_info:96,get_random_polici:130,get_rank:[82,86,156,166],get_residual_spac:82,get_rw_file_lock:86,get_serial_collector_cl:98,get_slave_exception_by_error:[13,16],get_slave_exception_class_by_error_cod:[13,16],get_tabulate_var:89,get_tabulate_vars_hor:123,get_task_uid:[86,156,166],get_tensor_data:[6,70],get_train_sampl:[43,56,121,128,133,162,181,199],get_vec_env_set:5,get_world_s:86,getattr:[123,156],getpid:92,gfootbal:202,gif:168,git:[138,139,140,170,194,195],github:[4,63,135,136,138,139,140,188,195],gitignor:[168,169],gitlab:[168,169],give:[67,117,181,188,197],given:[2,4,14,15,19,25,26,27,29,31,33,34,43,53,58,61,63,64,67,68,74,75,83,88,96,100,105,107,112,117,120,126,131,133,136,149,157,163,165,171,172,175,178,181,183,185,188,189,190,192,197,200],global:[27,35,38,126,131,176,186,197],global_obs_shap:[38,176,186],global_st:[35,38,176,177,186],glu:[6,70],go:[17,121,173,191,193,197,199],goal:[124,138,166,188,197],godlewski:183,gonzalez:176,good:[135,155,181,188],googl:[25,117,173,183],gopher:187,gotten:4,govern:183,gpu:[0,43,96,107,122,145,151,152,154,162,166,179,194,195,199],gracefulli:195,grad:[61,68,72,107,127],grad_clip_typ:73,grad_context:181,grad_fn:[33,34,171,178,181,185,192],grad_ignore_typ:73,grad_norm_typ:73,grade:191,gradient:[43,47,66,123,125,127,162,171,174,177,178,179,180,181,182,184,185,188,189,191,192,198,199],gradual:[136,188],graepel:[186,193],grammar:166,graph:[35,37,38,43,68,133,160,167,182,199],grasp:147,grave:[171,179],gre:[127,199],great:199,greater:[27,43,58,91,179,185,187,188],greatli:[147,172,178,192,199],greedi:[58,124,162,165,175,179,187,190,197,199],greedili:190,green:[158,159,188],gregori:[174,176,177,186],grei:188,grep:[17,19],greyscal:135,grid:[134,197],ground:74,group:[75,90,92,144,161,168,169,174],group_foo:[168,169],group_num:75,group_siz:90,gru:[38,75,133,176,186],grusli:186,guarante:[107,108,178,186,192],guard:172,guassian:[42,178,192],guez:193,gui:[186,200],guid:[161,174,177,195],guidanc:173,guidelin:200,gupta:177,gym:[2,4,120,126,135,146,147,148,149,164,165,199,200],gym_env:136,gym_wrapp:136,gymfromdmenv:136,h:[65,75,124,156,174,176,177,178,180,181,186,188,189,191,192,195,199],h_:191,ha:[4,8,15,26,27,41,59,63,92,93,95,115,117,118,120,123,124,128,130,131,132,133,134,135,147,149,153,154,155,157,159,161,165,172,173,175,177,179,181,187,188,189,190,192,193,195,197,199,201],had:159,hado:187,half:[138,167,169],halfcheetah:[42,141,178,189,192],ham:71,hamming_dist:[6,70],han:197,hand:[138,157,167,194,197,199],handi:165,handl:[4,56,63,64,90,127,154,200],handwrit:133,happen:[67,92,115,133,190],harb:177,hard:[43,47,121,133,160,179,188],hardcod:[138,190],hardest:27,harlei:[171,181],hasattr:[131,156],hassabi:193,hasselt:187,hat:[171,174,175,176,184,185,188],have:[8,27,58,68,75,78,82,90,93,95,107,120,121,123,124,126,128,131,135,136,138,147,149,151,154,159,163,166,169,173,178,181,188,190,191,195,197,199,200,201],head:[6,30,32,33,34,37,38,75,134,163,166,171,173,175,176,178,179,181,184,185,186,187,188,192,199,202],head_cl:29,head_cls_map:29,head_dim:75,head_hidden_s:[37,175,179,187],head_kwarg:29,head_layer_num:[37,175,179,187],head_num:75,heartbeat:[19,23],heartbeat_check_span:19,heartbeat_span:23,heartbeat_toler:19,heat:75,heess:[172,178],height:75,hello:77,help:[4,48,52,53,54,67,120,133,149,157,167,174,176,197,199],helper:[67,156,166,200],henc:[136,188,197],her:[121,202],her_cfg:121,her_episod:121,her_model:121,her_reward_model:202,here:[19,23,39,40,41,42,43,45,46,47,88,96,118,120,123,125,126,127,128,133,142,149,153,154,157,159,160,161,162,163,166,172,178,181,187,188,192,199,200],herk:192,herrewardmodel:121,hessel:187,hessian:185,heta:58,heterogen:180,heurist:189,hex:8,hidden:[29,35,38,41,47,75,118,124,165,176,177,186],hidden_channel:75,hidden_dim:[75,118],hidden_s:[28,29,33,34,35,37,75,171,175,178,179,181,185,187,192],hidden_size_list:[28,35,38,176,186,188],hidden_st:[40,41,46,133,164,165],hiddenstatewrapp:[124,133,164,165],hierarchi:155,high:[59,121,127,135,144,150,151,171,172,178,179,180,188,192,194,199],higher:[107,154,165,188,193,197],highest:[91,107,134,179,199],highli:[96,120,159,192,193],highlight:69,hilton:184,hindsight:[121,163,199],histor:[25,26,27,133,155],histori:[129,177],historicalplay:155,ho:180,hold:[133,155,157,197],home:26,home_id:26,homogen:199,honglak:193,hoof:192,hook:[106,152,156,157,166,194,199,200],hook_cfg:[164,165],hook_map:107,hook_typ:107,hooks1:107,hooks2:107,hooks4cal:[105,156,157],hooktoregist:107,hope:[155,172,181],hopper:141,horgan:187,horizon:190,horizont:201,host:[0,17,19,23,87,92,161],hostallero:186,hostpath:152,hot:[75,187],hour:169,how:[40,41,42,43,45,46,47,48,58,95,96,108,122,128,132,152,157,161,162,163,172,174,175,176,177,178,179,181,184,186,187,188,190,192,194,197,200],howev:[56,108,117,123,125,132,134,135,136,138,162,163,169,178,179,181,185,189,190,192,197,199],hpc:[75,133,150,152,194,202],hpc_:[150,151],hpc_rl:202,html:[69,75,166,167,188],http:[4,12,14,15,17,19,20,23,42,46,53,54,63,69,75,93,136,138,139,140,154,171,172,173,175,178,179,181,183,184,185,186,187,188,189,190,192,193,195],http_engin:20,httpengin:20,httperror:[12,14,15,154],huazh:176,hub:135,huber:175,hubert:[181,193],huge:[173,183],hugo:187,human:[117,138,173,188],humancompatibleai:138,humanoid:141,hung:[174,176,177,186],hunt:178,hurt:188,hybrid:[33,178,192,194],hyper:[129,162,175,178,186,190,199,200],hypernet:38,hypernet_emb:38,hyperparamet:[190,199],hypothesi:188,i:[4,29,33,34,42,49,52,53,54,56,61,63,66,71,78,79,88,91,108,117,118,119,120,121,123,125,126,131,132,135,138,145,152,155,157,159,164,165,171,174,175,176,178,181,184,185,186,187,188,189,190,191,192,193,195,196,197,199,200,201],iain:181,ibuff:[0,101,152,199],icml:171,id:[3,8,14,15,17,19,20,23,25,26,27,40,41,42,43,45,46,47,48,95,101,102,146,147,155,168,169,172,175,176,177,178,179,181,184,186,187,189,192],idea:[117,149,159,168,169,175,185,186,188,199],ideal:[187,197],ident:[155,178,188],identif:[149,154],identifi:[27,159],idl:[20,132,154],idx:[91,94,156,172],iff:197,ignor:[42,43,45,47,63,68,78,132,140,162,166,178,179,187,189,192],ignore_:[43,47,179],ignore_coef:73,ignore_don:[42,162,178,189,192],ignore_kei:68,ignore_momentum_timestep:73,ignore_norm_typ:73,ignore_valu:73,igor:177,iit:[158,159],il:[117,133,202],il_config:117,illustr:[167,197,200],ilpolici:162,ilya:185,imag:[4,120,135,161,163,199,202],imahg:136,imit:[122,180,190,194,200],immedi:[3,8,19,147,153,154,175,193],immens:167,imodelwrapp:[124,164,165,190],impact:[181,197],impala:[66,133,182,194,202],impalapolici:181,imped:174,implement:[2,23,54,55,57,59,62,63,66,75,79,91,93,96,101,105,107,108,117,118,120,121,123,124,125,126,127,128,129,132,133,135,136,140,144,149,151,152,154,157,159,160,162,163,165,166,167,169,182,194,197,199,200],implic:181,implicit:[175,180],impliment:75,import_help:[6,86,202],import_modul:[25,86,107],import_nam:[27,31,40,41,43,45,46,96,101,105,132,133,135,136,187],importance_weight:181,imposs:172,improv:[47,48,124,131,151,171,172,173,175,176,177,178,179,181,183,187,188,193,197],in_channel:[28,75],in_featur:134,inaccuraci:192,inclu:129,includ:[0,2,33,35,38,39,40,41,42,43,45,46,47,48,63,74,75,96,101,102,107,108,115,124,127,134,135,136,144,149,155,157,159,161,163,167,169,173,174,176,177,178,184,186,187,189,190,191,192,197,199,200,202],incom:[147,149],incomplet:169,inconveni:134,incorpor:190,incorrect:167,incorrectli:123,increas:[82,118,131,135,136,151,172,181,187,188,192,199],increase_spac:82,increment:[27,54,82],increment_eval_difficulti:27,increment_or_not:27,inde:185,independ:[29,34,38,149,154,157,159,171,174,177,178,181,185,186,187,189],index:[29,38,61,63,66,91,94,156,164,165,166,167,176,186],indic:[39,40,41,42,43,45,46,47,48,95,107,108,135,149,154,167,178,180,188,189,192,195,197,199,200],individu:[75,176,177,186,197],induc:[59,117,192,193],industri:120,inevit:154,inf:[62,158,159,190],infer:[39,40,41,42,45,46,47,48,133,143,144,145,191],inferfac:[40,41,43,45,46],infinit:197,influenc:131,info:[2,3,4,25,27,40,41,43,45,46,67,81,89,95,96,102,104,105,107,108,120,123,126,134,135,147,148,149,156,157,163,164,165,166,199,200],info_dict:[39,40,41,42,43,45,46,47,48],info_templ:[148,149],inform:[0,4,12,25,26,27,35,38,62,63,75,95,96,107,127,134,135,136,140,147,149,154,155,157,160,162,172,173,174,177,180,186,188,190,195,197,199,200,201],infti:[181,191],ingredi:138,inher:133,inherit:[48,93,124,126,127,131,147,149,153,154,165,175,187,199],init:[0,2,28,29,33,34,37,39,40,41,42,43,45,46,47,48,58,75,79,88,90,91,93,95,96,100,101,102,104,105,107,124,125,133,134,146,147,148,149,162,166,169,171,175,178,179,181,185,187,192],init_fn:124,init_payoff:27,init_typ:75,init_v:[67,156,166],initi:[2,4,11,20,25,26,27,28,35,38,43,52,53,54,58,75,81,82,91,94,95,96,105,107,108,120,121,124,127,129,147,149,153,154,155,156,157,162,163,165,166,176,177,178,186,188,189,190,191,192,194,199],initiali:189,inner:114,inplac:75,input:[0,2,4,26,29,33,34,35,37,38,39,40,41,42,45,46,47,48,52,53,55,56,57,58,59,62,63,66,68,69,71,74,75,76,77,78,79,82,83,91,96,118,120,124,127,133,135,136,147,149,151,160,165,166,171,173,175,176,177,178,179,181,185,186,187,189,190,191,192,193,197,199],input_data:77,input_dim:[75,118],input_s:[35,75],input_typ:75,insensit:159,insert:[129,152,165,166,181],insid:[19,23,161,167,200],insight:188,inspect:[159,174],instabl:179,instal:[150,151,194,200],instanc:[2,25,26,27,58,74,82,83,89,94,96,105,107,108,120,123,135,147,149,153,154,165,199,202],instance_nam:[107,108,138],instanti:[27,147,153,154,155,156,157,166,194],instead:[63,72,85,107,114,117,120,129,147,161,163,167,175,178,189,190,197,199,200],instruct:162,int64:135,integ:[39,40,41,42,43,45,46,47,48,126,131,135,136],integr:[4,120,131,152,155,169,174],intellig:[173,177,194,197],intend:169,intent:[169,174],inter:[147,174,180],interact:[6,39,40,41,42,43,45,46,47,96,102,110,134,138,149,152,155,161,176,179,180,188,190,194,196,197,199,200,201,202],interaction_serial_evalu:0,interactionserialevalu:[0,101],interactor:100,intercollector:100,interest:[123,188,197],interfac:[0,2,3,4,12,25,26,27,28,33,34,35,38,40,41,45,46,49,50,52,53,54,56,58,67,68,69,73,74,75,79,81,82,83,88,91,92,93,94,95,96,100,101,102,104,105,107,108,120,126,136,147,149,152,156,157,160,163,166,171,174,175,176,177,178,179,181,183,184,185,186,187,188,192,193,199,200],interfer:184,intermedi:128,intern:[28,81,133,151,154,174,177,186],interplai:192,interpol:[42,178,189,192],interpret:174,interv:[81,107,114,115,123,147,158,159,197],intranet:154,intrins:188,intrinsic_reward:188,intrinsic_reward_typ:188,intro:152,introduc:[82,115,121,123,128,130,134,154,155,157,163,172,173,175,181,185,188,189,192,199],introduct:[114,194,197],inv_trans_fn:[63,151],invad:[135,141,187],invalid:[14,75,114,153,154,156],invers:[49,50,63,122,180,188,194],inverserl:162,invert:189,investig:[136,154],invok:92,involv:[188,193],io:188,ioanni:[179,193],ip:[2,17,19,92,157],ipc:199,iqn:[36,133,141,182,194,202],iqn_nstep_td_error:175,iqnpolici:175,irl:[118,180,194,202],irl_config:118,irl_util:118,irrelev:169,is_al:92,is_auto_alpha:189,is_avail:131,is_clos:11,is_connect:[17,153,154],is_differenti:[6,70],is_fake_link:[82,90],is_finish:95,is_open:11,is_train:135,is_trained_enough:[27,155],is_typ:[110,116,158,159],is_weight:[40,41,45,46,176,177,181,184,186],isaim2010:173,iserialcollector:[98,199],isinst:[29,37,126,127,131,166,175,179,181,187,188,190,199],issu:[4,125,136,139,140,152,166,168,169,179],issubclass:166,isw:[6,60,202],item:[3,52,55,57,62,66,68,94,108,114,115,123,127,129,146,147,156,158,159,188,191,199],iter:[29,40,41,43,45,46,47,48,52,53,54,58,67,68,73,76,79,81,102,107,108,118,119,123,129,134,155,156,157,162,163,164,165,166,172,175,176,177,179,180,181,183,184,186,187,197,199,200,201],iter_:76,iter_map:86,iterable_list:76,iteration_0:134,iteration_561:134,iteration_:200,iteraton:199,its:[4,8,19,75,78,91,93,94,115,118,120,123,124,126,129,132,133,134,147,149,153,154,155,157,163,166,173,175,177,180,188,190,191,193,197,200,201,202],itself:[8,14,15,43,96,105,135,149,154,155,157,165,179],itt:[158,159],ityp:[115,158,159],j:[91,173,174,175,176,177,178,183,184,186,187,188,189,191,192],j_:189,jacek:183,jacob:184,jaderberg:186,jakob:[174,176,177,186],jame:187,janoo:185,jayesh:177,jean:177,jiam:180,jiang:174,jie:173,jiechuan:174,job:[25,26,27,79,154,155,157,161,199],job_id:92,job_info:[25,26],job_queu:[79,145],joel:186,joell:174,john:[184,185],join:[8,19,20,23,26,79,92,105,108,138,153,154,200],joint:[176,177,184,186],jointli:[173,176],jonathan:[178,180],joseph:[176,187],joshua:174,json:[114,154],ju:186,judg:[25,27,68,72,101,147,155,159,197,199],judge_fn:82,judge_snapshot:[25,155],julian:193,jump:167,junhyuk:193,just:[63,64,115,123,127,136,142,149,153,154,157,181,195,199,200],k8:[161,194,199],k8s_helper:[6,86,202],k:[38,123,133,171,172,173,177,178,184,187,188,192,193,199],k_attr:123,kaim:75,kaiq:174,kang:186,kappa:175,karen:[181,193],karg:107,karl:[184,186],kavukcuoglu:[171,172,179,181],ke:173,keep:[68,108,115,120,123,131,133,154,158,159,167,169,177,178,179,192],keepdim:[189,190,191],kei:[3,4,21,25,26,27,29,31,33,34,35,38,39,40,41,42,43,45,46,47,48,52,53,54,56,58,67,68,75,78,82,84,94,96,105,107,108,118,121,123,124,126,128,129,132,133,147,149,153,154,155,160,163,182,194,200],kernel:75,kernel_s:75,keutzer:176,keyerror:[25,26,27,58,96,105,107,114,158,159,188],keyword:[8,92],kickoff:200,kill:[17,19,202],kim:186,kind:[114,154,160,179,181,193,199],kkt:172,kl:[172,184,185,189,191],kl_gradient:172,klimov:[184,185],know:[4,95,107,123,147,151,157,166,174,188,199,200],knowledg:[160,173,183,184,193],known:197,kochenderf:177,konrad:183,korai:[171,172,179,181],kp:[158,159],kubectl:161,kubenet:161,kubernet:161,kullback:191,kurt:176,kwarg:[4,27,42,75,83,87,88,92,94,96,107,120,124,146,147,156,164,165,166,190],kyunghwan:186,l156:131,l1:[115,158,159],l2:115,l74:63,l:[77,114,115,117,142,171,174,175,176,179,184,185,186,190,191,192],l_2:181,l_:172,label:[19,74,161,168,169,178,188,189,192],labelsmoothceloss:[6,70],lack:140,lambda:[8,41,45,56,59,63,64,66,76,124,146,147,150,151,156,171,177,184],lambda_:[66,181,191],lanctot:186,languag:167,laptop:154,larg:[93,127,135,144,147,154,169,173,174,176,185,187,188,194,197,199],larger:[123,159,175,187,188,199],largest:[48,175,187],larochel:187,larri:185,lass:181,last:[4,27,37,56,63,64,75,79,94,108,120,128,133,142,147,156,166,179,181,187,188,190,195,199,201],last_act:35,last_data:181,last_enough_step:27,last_epoch:67,last_fn_typ:[56,181],last_fram:67,last_it:[67,107,123,156,157,166,200],last_valu:56,latenc:175,later:[4,120,128,157,161,169],latest:[95,134,147],latter:[133,149,155,199],launch:[3,25,27,81,127,140,146,147,153,154,161,199,200],launch_play:[25,26],laurent:193,layer:[26,28,29,33,34,37,38,75,118,149,165,171,175,176,178,179,181,185,186,187,189,192],layer_fn:[29,33,34,37,75,171,175,178,181,185,187,192],layer_num:[29,75],layout_height:138,layout_width:138,lazi:[2,148,149,161],lazili:135,lazyfram:4,lcmp:114,ldot:171,le:172,lead:[117,188,191,197],leaf:91,leagu:[6,132,152,162,194,202],league_map:25,league_mod:162,league_typ:25,leagueexploit:155,leaguemetricenv:27,leaky_relu:75,leaner:199,learn:[4,27,29,39,40,41,42,43,45,46,47,48,56,63,74,75,96,105,107,118,119,120,121,122,123,124,125,126,127,131,133,135,136,138,149,151,154,155,156,157,160,161,162,166,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,188,189,190,191,192,193,194,196,197,199,200,201],learn_aux:[45,123,184],learn_info:[105,107,156,157,166],learn_mod:[42,138,156,162,174,178,192,199,200],learn_model:199,learnabl:189,learner0:199,learner1:138,learner2:138,learner:[0,4,6,40,41,46,47,48,66,96,101,102,104,108,118,119,121,122,125,127,132,133,134,138,145,152,155,161,162,163,164,165,166,181,190,194,200,202],learner_aggreg:202,learner_cfg:156,learner_comm:[6,106],learner_get_data_task:[156,157],learner_hook:[6,106,123,156,157,164,165,202],learner_host:[0,199],learner_it:123,learner_learn_task:[156,157],learner_logg:134,learner_map:[107,166],learner_nam:107,learner_port:0,learner_start_task:[156,157],learner_step:[105,123],learner_task:[100,104],learner_task_finish_count:101,learner_task_spac:101,learner_tb_logg:134,learner_typ:[25,107],learnercommhelp:107,learnerhook:[106,123,152,156,164,165],learnerslav:157,learnig:120,learning_r:[40,41,45,46,47,48,135,136,162,188],learning_rate_actor:[178,192],learning_rate_alpha:189,learning_rate_crit:[178,192],learning_rate_valu:189,least:[26,39,40,41,42,43,45,46,47,48,52,53,54,56,82,144,147,181,199],leav:190,lee:[173,193],left:[27,91,123,126,135,136,138,165,171,172,175,178,179,184,185,187,189,191,192,193],leftarrow:[178,189,191,192],legal:[82,130,149],legg:181,legitimaci:149,leibler:191,leibo:186,len:[40,46,56,75,78,118,119,123,126,131,133,172,181,188,189,190,199],length:[8,26,38,39,40,41,42,43,45,46,47,48,56,59,63,78,81,94,95,108,114,121,123,129,133,157,162,163,166,172,176,179,181,186,188,199],less:[101,128,155,199],let:[114,123,154,157,172,188,199],letter:166,level:[82,89,136,154,155,167,169,173,183,192],levenshtein:71,levenshtein_dist:[6,70],lever:186,leverag:[191,192],levin:190,lf:[168,169],lfunc:115,lh:199,li:128,liao:169,lib:[150,151,169],librari:140,licens:166,life:[4,120,154],light:[154,159],lik:127,like:[4,8,17,19,29,56,62,67,74,75,77,91,93,95,96,105,107,108,112,113,114,115,120,123,124,125,128,133,134,135,147,153,154,155,160,162,163,165,180,191,194,199,200,201,202],likelihood:[189,190],lil:188,lilianweng:188,lillicrap:[171,178,193],limit:[114,161,163,167,172,188,192,197],limitedspacecontain:86,limits_:179,line:[20,136,142,151,153,154,166,169,188,194,200,202],linear:[28,43,58,75,134,172,179,186,187,189,197,200],link:[20,46,82,90,118,135,136,138,166,186,187,194],linklink:[74,82,85,90],linklink_dist_help:[82,90,202],linlink:[139,140],linux:[139,140,150,151,195],lisa:166,list:[2,3,26,33,35,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,67,68,72,75,76,78,82,84,85,89,92,94,95,96,102,105,107,108,115,121,123,124,125,126,128,129,131,132,133,136,146,147,156,159,167,169,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,194,197,199],list_next_st:75,list_split:[86,133,181],lists_to_dict:[56,86,181],littl:181,live:[4,135],ll:[124,155,193],llection:[42,178,192],ln:[151,183],load:[27,40,43,45,46,67,102,105,107,108,115,117,134,155,157,161,162,163,165,166,199],load_and_record_to_csv:136,load_ckpt:[164,165],load_ckpt_before_run:[164,165,200],load_ckpt_freq:107,load_expert_d:[49,50],load_expert_data:[49,50,52,53,54],load_from_id:136,load_path:[67,136,156,166,200],load_state_dict:[40,43,45,46,67,102,108,163,200],loadckpthook:[106,164,165],loader:[110,114,152,194,202],loader_v0:114,loader_v1:114,local:[0,17,19,35,38,84,134,150,151,167,169,174,176,177,186,195,197,199],local_parallel:202,local_seri:202,locat:[75,108,126,127,160,161,165,167,199],lock:[88,134,153,154],lock_help:[6,86,202],lockcontext:[26,86],lockcontexttyp:88,lockhart:193,log:[40,41,43,45,46,68,69,89,100,107,108,118,122,127,134,138,156,157,161,165,166,169,171,172,174,177,181,188,189,190,191,194,199],log_:133,log_buff:[68,107,123,156,157,166],log_help:[6,86,202],log_pi:191,log_prob:[171,181,189],log_reduc:[164,165],log_reduce_freq:107,log_show:[164,165],log_show_after_it:[164,165],log_softmax:191,log_std:189,log_var:[123,156],logan:185,logdict:68,loggedvalu:[123,142],logger:[49,52,53,54,67,89,100,107,108,123,134,152,156,157,162,166,199],logger_prefix:67,loggerfactori:86,logginglogg:89,logic:[114,115,149,154,159,199],logit:[29,33,34,35,37,38,42,43,45,55,57,61,66,69,74,124,126,133,164,165,171,175,176,177,178,179,181,185,186,187,190,191,192],logit_new:[62,185],logit_old:[62,185],logp:171,logreducehook:[106,164,165],logshowhook:[106,123,164,165],longer:[108,114,121,155,163,173,199],longtensor:[55,57,61,62,63,66,71,74,75,181,190],look:[92,132,165,194,197,200,201],lookahead:193,loop:[121,185,194,197,199,200],lose:155,loss:[4,6,23,26,39,40,41,42,45,46,47,48,55,57,62,63,64,66,69,70,72,73,75,117,123,126,127,128,129,151,155,160,169,172,174,175,176,177,178,179,181,184,186,187,188,189,190,191,192,199,201,202],loss_:126,loss_dict:[178,189,192],loss_entropi:181,loss_polici:181,loss_tot:181,loss_valu:181,lost:[4,23,117],lot:[128,134,173,179,199],low:[135,172,173,177,178,192,199],lower:[107,130,193],lr:[39,42,45,73,123,178,189,192],lr_schduler:67,lstm:[6,38,70,124,133,150,151,174,176,186],lstm_type:[38,75,176,186],lstmforwardwrapp:[6,70],lu:174,lunarland:[187,189,190,199,202],lunarlander_dqn_create_config:187,lunarlander_dqn_default_config:187,lunarlander_env:187,lunarlander_exp:187,lunch:102,lz4:77,lz4_data_compressor:86,lz4_data_decompressor:86,m:[26,37,38,53,75,78,127,132,150,151,161,175,176,179,186,187,190,193,196,197,199,200],machin:[127,154,174,186,194,199],maciej:183,maco:[168,169,195],maddpg:177,made:[92,117,134,149,167,173],madri:185,magail:180,magnitud:187,mai:[40,41,43,45,46,47,48,85,92,95,121,123,124,125,140,151,161,165,169,175,176,177,179,184,186,187,190,197,199,200,201,202],main:[0,27,28,39,42,43,45,78,79,112,117,126,129,134,136,138,150,151,154,155,160,163,166,167,178,188,189,192,193,199,200,201],main_config:[0,127,135,136,187,199],main_ob:[47,133],main_play:27,mainexploit:155,mainli:[127,151,157,165,169,183,193,199,202],mainplay:155,maintain:[124,133,147,149,154,155,165,169,178,179,187],mainten:154,maintian:124,major:[117,169,178,193],make:[0,4,17,19,23,27,35,45,56,63,88,94,120,123,124,126,129,130,131,133,135,136,140,149,152,155,157,159,164,165,167,169,171,174,180,183,188,191,193,195,199,200],makefil:202,male:114,man:[174,176,177,186],manag:[3,17,25,100,102,104,127,130,138,139,140,143,144,149,152,154,155,161,169,190,194,199,200,202],manager_cfg:3,manager_config:[146,147],manger:190,mani:[3,40,41,42,43,45,46,47,48,62,92,95,96,108,117,120,121,124,125,130,133,134,135,157,161,162,163,165,172,173,175,176,177,178,179,181,184,185,186,187,188,189,191,192,197,199],manifest:165,manipul:120,manner:[147,180,193],manual:[82,117,147,157,169,195],manual_se:131,map:[8,12,17,19,20,21,23,75,76,78,82,115,126,151,153,154,159,175,178,193,197],map_loc:200,mapsto:193,mara:[40,176],marc:[175,186],marget_ob:133,margin:[175,177],marginalis:177,marian:186,mark:[147,175,187,195],markov:[155,196,198],marl:[40,194],martin:179,mask:[35,38,75,138,190],massiv:135,master:[6,13,15,16,21,23,75,96,112,127,152,153,157,161,168,169,173,185,193,195,202],master_address:23,master_token_invalid:[14,15],master_token_not_found:15,master_token_not_given:14,masterchannelinvalid:[13,16],masterchannelnotgiven:[13,16],mastererrorcod:[13,16],mastermastertokeninvalid:[13,16],mastermastertokennotgiven:[13,16],masterresponseexcept:[13,16],masterselftokeninvalid:[13,16],masterselftokennotgiven:[13,16],masterslavetokeninvalid:[13,16],masterslavetokennotgiven:[13,16],mastersuccess:[13,16],mastersystemshuttingdown:[13,16],mastertaskdatainvalid:[13,16],match:[14,15,26,37,133,179,199],math:[38,65,75,78,110,116,159,176,181,186,190,191],math_help:202,mathbb:[172,174,175,176,177,178,179,184,185,189,191,193],mathbf:[187,189,191,193],mathcal:[174,175,176,178,186,189,191,192],mathemat:[159,173,197],mathop:[179,186],mathrm:[171,173,175,184,191],matrix:[185,197],matteo:187,matter:[123,182,185],max:[4,17,19,23,75,82,91,108,120,123,126,130,134,135,147,162,163,166,172,175,179,180,181,184,185,186,187,188,191,192,193,199],max_:[186,196,197],max_a:[196,197],max_fram:4,max_it:[164,165],max_iter:[138,156,157,199,200],max_retri:[146,147],max_us:125,max_val:[75,82],maxandskipenv:[5,120],maxim:[177,190,191,197],maximis:197,maximum:[4,48,81,94,129,136,147,154,165,172,179,189,190,191],maxlen:[81,94],mayb:[8,133,163,195,199],mc:[41,45,85,177,184,197],mcmp:[158,159],mct:[173,182,193,194],md:202,md_dqn:126,md_space:126,mdp:[117,133,198],mdthod:135,mean:[4,8,11,12,17,19,20,23,27,40,41,43,45,46,47,48,56,58,62,69,75,79,91,107,108,117,120,123,126,129,133,134,135,136,138,144,147,149,155,162,163,171,172,175,176,177,178,179,181,184,186,187,188,189,190,191,192,197,199],mean_relative_error:[150,151],meaning:155,meantim:199,measur:[149,163,166,180,181,188],mechan:[81,129,132,147,149,157,159,163,174,199],median:199,mediat:180,meger:192,mehdi:171,member:[14,15,20,27,69,75,149,155,160,169],memcach:[84,139,140],memori:[3,94,107,133,134,136,151,152,163,199],memory_len:136,memory_len_0_dqn:136,memory_len_0_dqn_config:136,memory_len_0_dqn_create_config:136,memory_len_env:136,memoryless:197,mention:[62,154,157,160,161,162,165,193,199],mere:120,merg:[82,94,107,167,168,169,187,199,200],merge_hook:[106,156],merged_dict:82,messag:[12,19,21,23,96,153,154,157,174],meta:[96,105,134,152,199],metadata:[27,96,157],meter:189,method1:[135,136,138],method2:[135,136,138],method:[0,2,12,17,19,21,23,25,27,39,40,41,42,43,45,46,47,54,56,58,67,69,75,82,89,92,93,94,95,96,100,102,105,107,108,112,120,123,124,125,127,128,129,130,133,147,149,154,155,156,157,159,160,161,162,163,165,166,169,171,172,173,174,177,178,179,180,181,183,184,186,188,190,192,193,196,197,199,200],method_name_list:3,metric:[6,70,179,187,202],metric_env:27,mi:[158,159],micro:161,micromanag:[176,177,186],mid:[171,178,184,185,189,191],middl:[143,144,145],middlewar:[152,202],might:[48,123,128,140,162,163,167],migrat:114,mikayel:[174,176,177,186],mike:174,mimic:192,min:[82,91,108,123,126,130,134,135,163,172,175,178,180,181,185,188,189,191,192],min_:[189,192],min_val:82,mind:167,mini:[133,177,188,192],minibatch:185,miniconda:195,minigrid:188,minim:[45,117,133,172,175,186,187,188,189],minima:177,minimis:197,minimum:[19,23,48,197],minor:167,minsegmenttre:91,minu:[115,135,158,159,188],mirza:171,misconnect:154,mismatch:151,miss:[19,188],miss_num:181,misspecif:188,mistak:117,misus:115,mitig:175,mix:[38,41,63,66,177,186,194],mixer:[36,176,186],mixing_embed_dim:38,mkdir:200,mlp:[6,29,33,34,35,37,70,118,164,165,171,175,178,181,185,187,192],mlp_num:75,mmm2:141,mmm:141,mnih:[171,172,179,181],moba:185,mod:192,modayil:187,mode:[0,33,34,35,39,40,41,42,43,45,46,47,48,69,75,81,94,107,108,113,123,133,144,147,152,154,161,163,164,165,166,171,172,175,176,177,178,179,181,184,185,186,187,189,192],model1:138,model2:138,model:[0,3,6,17,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,50,52,53,54,67,72,73,82,90,93,110,111,117,118,120,121,122,126,132,134,135,136,138,149,152,155,156,162,163,164,166,169,171,172,174,175,176,177,179,180,181,182,183,184,185,186,187,188,189,190,191,193,194,198,201,202],model_info:[40,41,43,45,46],model_output:[39,40,41,42,45,46,47,129,133],model_wrap:[124,133,162,164,165,178,192,199],model_wrapp:[124,133,160,164,165,190],moder:159,modif:[118,127,169,173,183,190],modifi:[26,118,119,120,128,147,152,155,163,165,169,173,179,190,199],modul:[2,17,28,29,31,33,34,37,38,39,40,41,42,43,45,46,47,48,56,63,67,69,72,74,75,85,120,124,127,132,133,136,147,149,151,152,155,157,159,160,161,167,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,193,194,199,201,202],modular:199,modulelist:189,moethod:[41,48],mohammad:187,moment:197,momentum:[40,41,46,73,176,177,178,186,192],monitor:[41,45,62,81,107,108,123,135,152,156,157,162,166,199],monitor_interv:81,monitor_var:123,monoton:186,mont:[128,173,183,193,196,197],montezuma:[187,188],montezumareveng:135,mordatch:177,more:[4,19,26,27,28,29,33,34,37,40,41,43,45,46,47,48,73,75,79,95,114,115,117,120,121,123,124,127,128,130,131,133,136,149,154,155,156,157,159,160,161,163,165,167,169,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,192,193,194,197,199,200],moreov:[172,199],most:[4,43,120,123,133,135,149,155,160,162,165,173,187,191,193,194,197,199,200,201],mostli:[49,50,124,167,183,193],mothod:162,motiv:193,mount:161,mountpath:161,move:[135,140,173,183],mp4:[135,200],mpi:127,mpo:191,mr:169,mse:[63,151,188],mse_loss:[129,171,181,188,191],mseloss:190,mt:[158,159],mu:[29,33,58,172,174,178,181,189,192,196,197],mu_:[178,192],much:[129,134,167,175,176,180,181,186,187,188,193,199],mujoco:[120,148,149,152,178,189,192,197,202],mul:172,multi:[29,38,40,41,43,46,75,107,108,115,122,125,147,154,155,162,171,173,174,175,176,177,179,180,182,184,185,186,189,191,194,200],multi_buff:125,multi_discret:126,multi_gpu:[127,162],multi_head_dqn:132,multi_logits_loss:[6,70],multiag:[155,177],multiagent_particl:202,multidiscret:126,multidiscreteenv:126,multihead:[30,75],multilevel:93,multilogitsloss:[6,70],multimod:175,multimoni:138,multinomi:[69,124,175,179,187,191,199],multinomial_sampl:[164,165,188,199],multinomialsamplewrapp:[124,164,165],multipl:[0,3,20,25,26,74,79,122,126,131,147,154,160,162,174,176,181,194,199,200],multipli:[26,71,129,144,175],multiprocess:[79,140,146,147],multistep:[41,63,190],multistep_forward_view:60,multivari:189,muno:[172,175,181],must:[8,23,25,27,37,40,41,43,45,46,47,58,74,75,84,90,92,93,96,105,107,121,123,124,125,129,130,132,133,135,142,147,149,154,157,160,161,162,163,166,169,177,179,181,184,185,190,199],mutat:[25,27,155],mutate_ckpt_path:27,mutate_prob:27,mutation_result:27,mutual:108,muzero:[183,193],my:19,my_address:[17,19],my_env_manag:[146,147],my_test_project:[168,169],mycontrollablecontext:8,mycontrollableservic:8,myhook:[164,165],mykel:177,mymast:[153,154],myopic:197,myslav:[153,154],mywrapp:[164,165],n0:[33,178,192],n1:[33,71,127,178,192],n2:[33,71,127,178,192],n3:[33,178,192],n:[26,29,33,34,37,38,39,43,47,48,53,55,56,57,58,61,62,63,66,71,74,75,78,122,133,134,135,136,138,141,150,151,162,171,175,176,177,178,179,181,183,184,185,186,187,189,190,191,192,193,194,199],n_:[173,183,187],n_atom:[29,37,48,63,175,187],n_episod:[95,118,162,163,199],n_evaluator_episod:[135,136,199],n_frame:[4,120],n_head:38,n_len:172,n_output:64,n_sampl:[43,47,118,130,133,134,135,136,162,163,179,199],n_step:[39,48,150,151,187],n_t:177,nabla:174,nabla_:[171,172,174,176,177,178,181,189,192],naiv:[101,104,108,121,133,155,163,171,181,199],naive_buff:[108,163,202],naive_sp_play:155,naivebuff:199,naivecollector:98,naivereplaybuff:[138,152,199],naiveresourcemanag:[6,103],naivespplay:155,name1:132,name2:132,name:[0,3,19,33,40,41,42,43,45,46,47,48,52,56,75,77,78,82,83,85,87,88,89,92,94,96,104,107,108,114,123,124,127,132,134,136,144,149,150,151,153,154,156,157,161,162,164,165,166,168,169,172,175,176,177,178,179,181,184,186,187,188,189,192,195,197,199,200,201],name_of_hook:107,named_paramet:127,namedlist:[2,148,149],namedtupl:[3,27,39,40,41,42,43,45,46,47,55,57,59,62,63,66,82,94,101,107,129,133,148,149,171,181,185,190,199],namespac:[83,87,161],nando:172,nanta:[174,176,177,186],nardelli:[174,176,177,186],narrow:192,natur:[4,120,142,173,180,190,197],naturaltim:142,nature24270:173,navi:155,navig:167,ndarrai:[3,4,26,39,40,41,42,43,45,46,47,48,68,69,135,199],nearbi:176,nearest:75,nearestupsampl:[6,70],necessari:[3,25,27,29,33,34,35,39,40,41,42,43,45,46,47,48,96,105,107,108,149,154,156,157,169,171,172,174,177,178,181,185,188,192],necessarili:[27,197],need:[2,4,17,29,40,41,42,45,46,48,56,58,75,81,82,94,95,96,101,107,108,114,115,117,121,123,124,127,129,131,133,134,135,136,140,144,147,149,151,154,155,156,157,160,161,162,163,165,166,167,172,173,174,176,180,181,186,187,188,190,193,195,197,199,200],need_tb:89,need_text:89,neew:197,neg:[82,175,189],neglogp:69,neighbor:175,neither:[115,180],nest:[4,82,165,200],net:[35,38,45,48,75,93,173,175,176,182,186],network1:[178,192],network2:[178,192],network:[6,9,16,20,29,33,34,35,37,38,40,41,42,43,45,46,47,48,61,64,66,70,107,124,125,133,134,150,151,152,155,160,162,164,165,171,172,173,174,175,176,177,179,180,181,182,183,184,185,186,188,189,191,193,197,199,200,202],neural:[133,134,155,160,171,172,173,178,179,180,183,186,187,188,189,193,199,200,202],neurip:193,neutral:91,neutral_el:91,never:[27,117,169,188],new_connect:[17,19,20,112,153,154],new_data:[118,119,125,130,190,199,200],new_data_count:118,new_dict:82,new_episod:121,new_hook:107,new_keys_allow:82,new_loader_v0:114,new_q_valu:189,new_shap:[4,120,148,149],new_task:[17,20,112,153,154],newdata:82,next:[3,38,45,75,79,94,117,128,133,155,156,165,176,178,186,189,192,193,195,197,199,200,202],next_act:[178,189,192],next_data:[178,189,192],next_input:133,next_n_act:[63,190],next_n_dist:63,next_n_q:[63,190],next_ob:[39,40,42,43,46,48,56,94,108,126,129,163,178,181,189,192,199],next_sate_predict:188,next_stat:[35,38,75,124,133,176,177,186],nextstat:75,nf2:[158,159],nf:[158,159,161],nfqca:178,ni:29,nicola:[172,178,186],nightli:135,nine:123,nintendo:126,niuyazh:[168,169],nm:177,nn:[28,29,31,33,34,37,38,39,40,41,42,43,45,46,47,48,63,67,72,74,75,124,127,129,133,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,194],nn_modul:[6,70],nn_test_help:[6,70,202],nndarrai:135,nnode:127,no_grad:[126,133,172,178,181,188,189,191,192],node:[91,127,133,154,161,183,199],node_rank:127,nois:[29,42,48,58,69,75,124,136,165,178,179,187,192,197],noise_:192,noise_block:[6,70],noise_clip:192,noise_gener:58,noise_kwarg:192,noise_logit:69,noise_map:58,noise_mod:69,noise_net:48,noise_rang:192,noise_sigma:[42,178,192],noise_typ:[58,192],noiselinearlay:[6,29,70],noisi:[29,37,48,175,182,188],non:[91,140,152,155,175,186,188,197],none:[0,2,3,8,11,17,19,20,21,23,25,26,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,58,62,63,67,68,69,72,73,74,75,77,78,79,81,82,84,85,90,91,92,94,95,96,100,101,102,104,105,107,108,114,118,119,121,123,124,125,127,128,129,131,133,143,144,148,149,153,154,156,157,158,159,161,163,164,165,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,200],nonloc:[153,154],noop:[126,135],noop_max:[4,120],noop_reset:135,noopresetenv:[5,120,164,165],noqa:[123,156,166,188],nor:180,noreturn:0,norm:[45,75,110,114,116,152,158,184],norm_func:75,norm_typ:[28,29,33,34,37,75,171,175,178,179,181,185,187,192],normal:[4,6,28,29,33,34,37,45,62,70,84,92,117,120,121,147,151,154,162,165,171,175,178,179,181,184,185,187,188,189,191,192,199,200],normal_env:199,normalis:190,normalist:120,normalizt:75,normfunc:[115,158,159],north:138,notat:181,note:[3,4,27,67,69,96,107,120,133,135,138,149,151,155,159,161,166,167,169,181,187,188,190,191,193,197,200],noth:[19,20],notic:[64,123,128,181],notify_fail_collector_task:101,notify_fail_learner_task:101,notimplementederror:156,notion:192,novel:[186,188,192],novelti:[179,188],now:[0,26,58,68,75,95,129,132,135,138,149,151,157,165,167,181,190,199],noweight:188,nowrap:[178,189,192],np:[3,4,26,39,40,41,42,43,45,46,47,48,69,126,130,131,135,136,189,190,199],np_seed:131,nproc_per_nod:127,nstep:[43,47,48,56,63,126,128,129,135,136,143,162,175,179,187,190,199],nstep_return:190,nstep_return_data:190,ntask:127,null_data:181,null_pad:[56,133,181],null_transit:56,num:[29,33,34,37,38,40,41,46,47,48,57,63,67,75,94,102,107,134,143,144,171,175,178,181,185,187,190,192,199],num_direct:75,num_episod:136,num_first:75,num_lay:75,num_quantil:[29,37,175],num_work:[79,145,156],numba:163,number:[0,4,27,28,29,35,37,38,42,43,47,48,56,63,67,75,79,82,90,91,92,94,95,108,115,121,124,128,131,133,134,135,136,138,147,149,154,155,157,162,163,165,175,176,177,178,179,186,187,188,189,190,192,193,197,199],numer:[151,179],numpi:[3,4,26,68,69,82,131,188],numtyp:4,nvidia:161,nx:[143,144],o1:29,o2:29,o3:29,o:[145,174,176,184,188,193,196,197,201],o_:176,ob:[3,4,33,35,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,94,108,126,129,133,135,138,146,147,148,149,160,163,176,177,178,186,188,189,190,192,199],obei:[40,41,43,45,46,166,199],oberv:120,obeserv:[4,120],obj:[3,4,8,26,33,53,54,67,68,69,75,82,90,120,124,126,131,166,172,178,181,190,192],object:[2,8,11,12,14,15,17,19,20,25,27,45,49,50,58,68,76,77,81,82,83,84,92,112,115,136,149,153,154,156,160,166,176,180,184,189,191,197,200],objstor:199,obs_:199,obs_alon:[38,176],obs_along:[38,176],obs_dict:3,obs_shap:[4,28,33,34,35,37,38,127,135,136,148,149,171,175,176,177,178,179,181,185,186,187,188,192,199],obs_spac:[4,135,148,149],obscur:157,observ:[2,3,4,28,33,34,35,37,38,39,40,41,42,43,45,46,47,78,120,133,143,144,146,147,148,149,171,174,175,176,177,178,179,181,185,186,187,188,189,192,193,196,197],observation_spac:4,observationwrapp:120,obsnormenv:[5,120],obstransposewrapp:[5,120],obtain:[133,147,149,154,157,165,176,177,186,187,188,190,197],obviat:188,obviou:199,occup:180,occur:[19,20,82,90,92,147,149,151,152,194,199],odot:187,off:[40,41,43,45,46,47,48,147,161,162,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,196,197,200],offer:[0,160,161,199],offici:[169,195],offlin:[173,196,197],often:[107,120,135,160,162,163,172,183,195,197,199],oftern:135,oh:193,ointment:173,ok:115,old:[151,159,185],older:181,oleg:[184,185],omega:187,omit:[157,166,188,202],on_complet:[20,153,154],on_fail:20,on_polici:[40,41,43,45,46,47,48,128,162,172,175,176,177,179,181,184,186,187,199],onc:[3,4,42,54,81,110,116,120,136,155,157,163,165,172,178,181,192,197,199],one:[2,3,25,26,27,38,40,41,42,43,45,46,47,48,56,58,75,78,82,92,95,96,105,107,108,114,118,120,121,123,128,129,131,133,134,135,138,144,147,149,153,154,155,156,157,160,162,163,169,172,174,175,176,177,178,179,181,183,184,186,187,188,189,190,192,193,197,199,200],one_hot:[6,70],one_phase_step:27,one_vs_one_collector:202,one_vs_one_leagu:[6,24,155,202],one_vs_one_parallel_command:202,ones:[4,54,75,79,186],ones_lik:[171,181,190],onevoneevalu:138,onevsoneleagu:155,onli:[0,2,4,19,27,40,41,42,43,45,46,47,48,54,75,78,79,82,89,91,95,96,107,108,114,117,118,120,121,123,125,126,127,131,133,135,147,149,151,154,155,156,157,162,163,165,166,167,169,172,173,175,176,177,178,179,181,184,186,187,188,189,190,192,193,197,199,200,201],onlin:[19,23,117,167,173,190,197],online_net:54,onppo:188,onto:175,onward:197,op:[4,67,88,90],open:[11,95,120,129,149,167,169,195],openai:[4,120,148,149,188,200],opendilab:[135,161,195],oper:[19,27,40,43,45,46,47,59,75,78,88,91,92,115,120,121,127,133,147,149,150,152,154,157,159,160,163,165,172,174,175,178,186,194,199],operator_serv:202,operatornam:[175,185,187,192],oppon:[27,155],opportun:184,opt:[177,188],optim:[29,39,40,41,42,43,45,46,47,48,62,67,73,117,125,129,151,155,157,162,163,172,176,177,178,180,181,183,184,185,188,189,190,191,192,194,198,199],optim_typ:73,optima:197,optimiazt:200,optimis:197,optimizer_help:[6,70,202],option:[0,3,8,11,17,19,20,21,23,25,27,28,29,33,34,37,38,39,40,41,42,43,45,46,47,48,56,58,67,69,71,73,74,75,79,82,89,90,91,92,94,101,107,108,124,125,133,149,158,159,163,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,193,195,199],optioncondit:193,orchestr:[152,194],order:[19,23,26,75,88,94,115,120,131,132,135,138,147,151,154,159,161,165,169,177,178,181,188,193,199,200],ordereddict:67,ordinari:154,org:[42,46,53,54,69,75,161,171,172,173,175,178,179,181,183,184,185,186,187,188,189,190,192,193],organ:128,orgin:135,origin:[3,4,12,14,15,17,19,45,75,77,78,82,108,120,125,126,131,133,138,142,144,150,151,159,165,168,169,177,181,184,186,187,188,192,199],origin_data:77,origin_env:120,origin_model:124,origin_path:[168,169],orign:135,ornstein:[42,58,178,192],orthogon:75,os:[92,107,138,166,200],ostrovski:[175,187],other:[0,3,4,19,25,27,38,40,41,42,43,45,46,47,48,58,68,94,95,96,105,107,108,117,120,121,124,125,127,128,131,147,149,152,154,155,160,162,165,166,167,169,171,172,173,175,176,177,179,180,181,182,184,186,187,190,193,194,197,199],otherwis:[19,23,25,27,45,56,59,75,79,82,90,101,112,123,138,147,153,154,157,160,181,187,188,195],otyp:[115,158,159],ou:[164,165],ounois:60,our:[42,62,95,117,120,124,136,141,144,159,175,178,181,187,188,189,191,192,197,199,200],out:[11,63,75,78,92,108,121,132,134,138,140,154,157,163,177,188,190,193,199],out_channel:75,out_featur:134,outcom:193,outer:[78,108],outermost:[161,165],outlin:199,outperform:[144,188],output:[4,19,23,28,29,33,34,37,38,39,40,41,42,43,45,46,47,48,58,61,64,66,75,77,89,107,118,120,124,126,129,133,149,156,160,162,165,166,171,174,175,176,178,179,181,185,186,187,188,190,191,192,193,195,199],output_devic:127,output_dim:75,output_s:29,output_size_list:29,outsid:157,over:[4,63,64,120,121,123,135,157,162,178,187,188,190,192,194,195,197,199],overal:[27,174,176,177,186,188,193,199],overcook:[137,194],overcooked_ai:138,overcooked_demo_ppo_config:138,overcooked_vac:138,overcookgameenv:138,overestim:[175,179,192],overhead:188,overid:93,overlap:[75,151],overli:169,overlin:191,overload:159,overrid:[43,86,92,126,129,149,155,156,157,166,199],overridden:82,override_all_if_type_chang:82,overriden:157,overrod:126,overroidden:163,overview:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,55,56,57,58,59,61,62,63,64,65,66,67,68,69,71,72,73,74,75,76,77,78,79,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,100,101,102,104,105,107,108,117,120,124,126,131,152,166,182,200],overwrit:169,overwritten:[108,133],own:[56,94,115,124,125,126,129,132,133,134,138,149,154,155,157,160,162,165,169,176,188,199,200],owner:169,p:[37,38,75,127,155,161,171,173,174,175,176,178,183,185,186,187,191,196,197,199],p_:[52,175,187],p_i:175,pack:[59,75,160,199],packag:[23,82,131,150,151,167,194,195,200],pad:[75,172,181],pad_typ:75,page:[126,135,167,169,200,201],pai:[121,123,125,159,169,195,199],paid:169,pair:[53,94,117,123,129,135,147,149],paper:[4,42,46,47,75,120,125,138,155,172,173,178,181,185,186,187,188,189,192,193,199],paradigm:[174,177,186],paragraph:155,paral:147,parallel:[0,90,101,102,107,127,129,147,151,152,156,163,194],parallel_collector:132,parallel_commander_typ:101,parallel_entri:202,parallel_pipelin:199,parallelli:200,param:[73,126,127,164,165,188],paramet:[0,2,3,29,33,34,37,40,41,46,56,59,62,75,79,107,127,129,131,133,134,135,144,147,149,151,154,155,157,160,162,163,165,171,172,174,175,176,177,178,181,185,186,187,188,189,190,191,192,194,197,199,200,201],parameter:[175,178,181,189,193,196,197],parameteris:197,parameteriz:69,parametr:[29,175,187,197],parent:[27,131,149,155],parent_id:27,parikh:174,pariti:133,parsed_info:114,part:[0,38,40,43,45,46,56,62,90,100,114,115,120,124,125,126,133,136,140,149,151,155,157,160,165,167,172,176,179,181,187,191,193,197,199,201,202],partial:[123,142,146,147,174,176,177,186,197,199],particip:[90,155],particl:178,particular:[136,189,190],partit:199,partition_nam:127,pass:[3,8,17,33,34,37,56,63,64,91,92,94,96,101,102,124,132,133,135,147,149,153,154,157,159,160,162,171,173,175,178,179,181,185,187,192,199,200],past:[27,155],path:[0,2,3,25,27,40,41,43,45,46,67,84,89,96,105,107,118,132,134,136,138,139,140,155,161,167,187,195,197,199,200],pattern:[149,173,194],payoff:[6,24,25,27,152],payoff_map:26,pd:[6,70],pdeil:[6,51],pdeil_irl_model:[6,51,202],pdeilrewardmodel:51,pdf:[42,53,173,175,178,189,192],peak:[173,192],penal:175,pend:147,pendulum:[189,199,202],pendulum_td3_main:199,peng:177,peopl:[131,169],per:[40,41,43,45,46,47,48,119,122,127,134,172,175,176,177,179,181,182,184,186,194,199,201],per_collect:[40,43,46,47,48,172,175,176,179,181,186,187],per_collect_target:94,perceptron:75,perfect:183,perform:[43,73,117,128,131,135,136,138,144,149,152,154,157,165,169,173,176,179,183,184,186,187,188,190,193,194,197,199,200],period:[108,123,133,134,155,157,166,187,197,199,201],permiss:[139,169,194],permit:123,personal_info:114,personnel:154,perspect:[175,180,193],perturb:[58,136],peter:186,pfsp:[27,155],pg_loss:181,pg_rho:181,phase:[27,45,161,183,184,188,193,199],phasic:[123,125,184],phi:[172,175,177,178,181,187,189,191,192],phi_1:[189,192],phi_2:[189,192],phi_:[172,175,178,189,192],phi_i:[189,192],philip:[174,176,177,186],physic:178,pi:[128,133,171,172,175,177,180,181,184,189,191,196,197],pi_:[117,172,181,184,185,189,191,192],pi_act:[190,191],pice:82,pick:[138,190],pickl:[77,84],pictur:197,pid:92,piec:[78,79,82,94,120,162,163,165,181,199],pieter:177,pin:167,pineau:174,pinelin:173,ping:[14,15,19,23,153,154],piot:187,pip:[135,136,138,139,140,150,151,195],pipe:[110,116,199],pipelin:[0,101,121,129,132,157,160,162,194,202],piplin:[117,133,155],pit:169,pitfal:135,pkl:[117,118,161,199],pl:[158,159],place:[52,54,75,123,134,138,149,160,161,165],placehold:[40,41,42,43,45,46,47,48,172,175,176,177,178,179,181,184,186,187,189,192],plai:[25,155,162,173,179,194,199],plan:[169,183,193,197],plantuml:112,plantumlcli:112,platform:[0,200],player:[6,24,25,26,121,132,135,152,173,199,202],player_id:[25,26,27],player_info:25,player_map:27,player_typ:27,playerr:27,pleas:[2,4,17,19,23,28,29,31,33,34,35,37,38,69,76,77,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,107,115,127,128,131,140,141,142,149,154,156,157,159,165,166,167,169,172,181,188,190,195,197,199,200],plenti:[130,199],plu:[115,133,158,159],plugin:[40,41,46,48,107],pm5gv:161,pmatrix:186,pmi2:127,pmlr:[174,186],pod:161,point:[48,92,107,149,156,163,166,169,181,188,197],polci:172,polic:[132,197],polici:[0,6,39,40,41,42,43,45,46,47,48,52,61,62,64,66,82,94,96,101,105,107,117,118,119,120,121,123,124,125,126,127,128,129,130,132,134,135,136,138,143,144,146,147,150,151,152,155,156,157,160,164,165,166,171,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191,194,198,201,202],policy1:138,policy2:138,policy_0d2a6a81:134,policy_:189,policy_buff:125,policy_cfg:156,policy_data:[125,185],policy_factori:[130,202],policy_info:185,policy_kwarg:[118,121,130,190,199,200],policy_loss:[41,45,55,57,62,123,171,181,185,189],policy_output:[39,40,41,42,43,45,46,47,48,185],policy_registri:[40,41,42,43,45,46,47,48,132,162,172,175,176,177,178,179,181,184,186,187,189,192],policyfactori:130,policynet:189,polyak:[42,178,189,192],polymorph:149,pomdp:[197,202],pong:[4,135,141,145,190],pong_dqn_config:135,pong_dqn_create_config:135,pongnoframeskip:[126,135,164,165],pool:[4,94,120,155],poor:177,pop:[156,190],popular:[138,193],port:[2,17,19,23,87,92,154,157],portion:[127,133],posit:[58,94,107,128,156,157,164,165,173,188],possibl:[118,120,136,138,149,154,155,167,169,174,192,197,199],post:[75,199,200],postion:172,pot:138,potenti:[159,169,187],pow:[172,189],power:[91,112,115,154,199],pp:173,ppg:[6,44,123,125,133,135,141,182,194,202],ppgpolici:[6,44,184],ppo:[6,45,60,117,123,133,138,141,150,151,181,182,184,188,189,194,202],ppo_data:62,ppo_error:[60,185],ppo_info:[62,123],ppo_loss:[62,123,185],ppo_policy_data:185,ppo_policy_error:185,ppo_value_data:185,ppo_value_error:185,ppopolici:[138,185,188],practic:[114,154,159,179,190,194,199],prafulla:185,prajit:187,pre:[118,121,135,151,156,157,175,188,199,200],precedur:133,precis:[135,183],pred:[29,71],pred_extra:71,predecessor:193,predefin:199,predefined_config:202,predict:[29,33,34,37,39,40,41,42,43,45,46,47,48,74,75,171,174,175,178,179,181,183,185,187,188,189,192,193],predict_featur:188,predictor:188,prefer:[195,200],prefix:[67,96],prefix_op:67,prefixsum:91,preliminari:154,prelu:75,premis:167,prepar:[25,45,117,156,165,195,199],preprint:[174,176,177,180,186],preprocess:[19,35,40,41,45,46,75,199],prerequisit:194,present:[92,177,183,186,197,200],preserv:[45,108,159,163,175,184,187],press:126,pressur:81,pretrain:[27,155],pretti:89,pretty_print:[86,156,166],prev:124,prev_stat:[35,38,40,41,46,47,75,78,124,133,176,177,186],prevent:[147,159,167,169,185,190],preview:167,previou:[4,38,75,117,133,147,154,165,175,176,179,181,186,191,197],prime:[171,175,178,179,187,191,192,193],primit:193,principl:159,print:[23,72,76,78,81,82,88,89,102,108,134,135,136,142,153,154,157,162,164,165,195,199,201],print_instead:72,prior:[173,184],priori:173,priorit:[48,108,122,152,175,179,182,194,199],prioriti:[40,41,43,45,46,47,48,102,107,108,123,125,128,129,135,156,157,162,163,164,165,166,175,176,177,179,181,184,186,187,199,201],prioritizedbufferr:129,priority_:[40,41,45,46,176,177,181,184,186],priority_avg:[123,134],priority_i:[43,47,179,187],priority_info:[105,107,156,157,166],priority_is_weight:[129,162],priority_max:[123,134],priority_min:[123,134],priorityl:108,pritzel:178,privat:[154,168,169],pro:[168,169],prob:[27,69,190,191],probabilist:191,probabl:[27,69,75,129,165,172,174,175,180,185,187,191,197,199],probil:69,problem:[95,117,131,133,136,147,150,151,154,155,157,162,166,169,173,176,177,179,180,183,186,188,191,193,194,195,198,199],problemat:117,procecur:43,procedur:[127,157,163,167,195,199,200],proceed:177,proces:79,process:[15,17,19,23,40,41,42,43,45,46,56,58,67,74,75,78,79,90,96,108,110,111,116,118,121,124,126,127,129,131,133,135,138,145,147,149,152,153,154,155,156,162,165,169,173,178,180,181,188,190,192,193,196,198,200],process_transit:[43,199],processg:170,processgroup:90,processs:79,prod:189,prod_:181,produc:[61,66,68,133,144,149,183,186],product:[19,23,38,121,126,129,161,175,181],profession:173,profil:[152,163],program:[0,147,151,165,197,199],programmat:138,progress:[147,168,169,188],proj_bar:[168,169],project:[167,169,175],project_path:[150,151],promot:174,prone:[177,197],prop_nam:[123,142],propabl:163,propag:[72,92,151,172,174,189],propagatingthread:86,propcess:118,proper:[0,2,19,133,167,195,199],properli:[19,23,136,154],properti:[0,3,4,12,17,19,20,21,26,27,42,53,54,81,94,96,101,102,105,107,108,120,123,124,142,147,148,149,155,156,166,174,178,192,197],propoerti:128,proport:[129,188,190],propos:[25,47,171,173,174,175,178,179,180,184,185,186,187,188,189,190,192,193,197],proprieti:136,propto:187,protect:[23,147],protocol:174,protoss:27,proven:172,provid:[75,82,108,115,117,118,120,124,126,128,133,140,147,149,151,154,155,157,160,161,165,169,178,186,192,197,199,200],proxi:[17,187],proxim:[62,185],prv_state:75,ps:121,pseudo:[147,182,199],pseudocod:182,psi:187,pth:[25,134,200],publish:173,puct:[173,183],pull:135,pure:[68,144,173,199],push:[79,81,108,118,119,121,125,130,134,163,168,169,190,199,200],push_count:[108,163],push_data:81,push_data_count:108,pushed_in:134,put:[68,78,79,117,120,124,129,134,155,157,169,199],pwil:[6,51],pwil_irl_model:[6,51,202],pwilrewardmodel:51,py3:[150,151],py:[0,2,4,28,29,31,33,34,35,37,38,63,76,77,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,105,107,117,120,121,123,124,125,126,127,128,130,131,132,133,134,135,136,138,148,149,150,151,152,155,156,157,161,163,164,165,167,175,190,195,199,200,202],pyarrow:199,pymarl:[38,141],pypa:[139,140],pypi:195,pytest:[138,195],python3:[150,151,199,200],python:[0,40,41,43,45,46,62,127,132,135,136,150,151,159,166,167,195,199,200],pythonunbuff:[161,199],pytorch:[69,75,133,145,195,200,202],pytorch_ddp_dist_help:[6,86,127,202],pytorchlstm:[6,70],q0:[191,196],q0_a:191,q0_loss:191,q0_targ:191,q1:[194,196,197],q1_a:191,q1_loss:191,q1_targ:191,q2:[194,196,197],q3:[194,196,197],q4:[194,196,197],q5:[196,197],q6:[196,197],q7:196,q:[29,33,34,37,38,42,63,124,126,132,133,152,164,165,171,174,175,176,177,178,179,181,182,185,189,190,191,192,193,198,201],q_:[172,176,177,178,186,187,189,191,192,193,196,197],q_a:186,q_alone_network:[38,176],q_backup:191,q_data0:189,q_data1:189,q_data:189,q_dim:38,q_gather:172,q_learn:[6,32,36,43,127,133,175,179,187],q_loss:189,q_network:[38,176],q_nstep_sql_td_data:190,q_nstep_sql_td_error:190,q_nstep_td_data:[63,126,128,129,190],q_nstep_td_error:[60,126,128,129],q_nstep_td_error_with_rescal:60,q_retrac:172,q_s_a:190,q_targ:191,q_tot:38,q_twin_loss:189,q_valu:[33,35,37,38,43,47,48,57,63,126,128,129,133,150,151,162,172,175,176,177,178,179,186,187,189,192],q_value_dict:[178,192],q_value_twin:[178,192],qac:[6,32,35,36,177,178,192],qbert:[135,141,151,161,202],qbert_dqn_config:161,qbert_dqn_config_k8:161,qbert_dqn_system_config:161,qbertnoframeskip:161,qi:173,qmix:[6,32,35,36,40,44,133,141,176,182,194,202],qmixpolici:[6,44,186],qn:29,qn_output:29,qntd:[150,151],qntd_rescal:[150,151],qr:175,qrdqn:[29,36,133,141,182,194,202],qrdqn_nstep_td_error:175,qrdqnhead:30,qrdqnpolici:175,qtran:[141,186],quad:[171,172,193],qualiti:[108,134,152,197,199],quantifi:188,quantil:[29,37,175],quantile_embedding_s:[29,37,175],quantile_net:29,quantilehead:30,quantiti:[199,201],quatilehead:29,queri:[75,89],question:[149,166,197],queue:[68,79,81,96,105,154,157,163,199],queue_siz:68,quick:[154,182,194,199],quickli:[149,154,165,187],quit:[78,88,117,153,154,166,199],quotat:195,r0:195,r2d2:[6,44,150,151,179,202],r2d2polici:[6,44],r2d3:125,r:[43,156,158,159,166,173,174,175,176,178,179,186,187,188,189,190,191,192,193,196,197],r_0:172,r_:[128,171,181,185,187,191,193,196,197],r_k:172,r_t:[133,172,181,185,191,196,197],rabbat:174,race:27,radford:185,radio:154,rai:[178,189,192],rainbow:[6,29,37,44,129,133,141,175,182,194,202],rainbowdqn:[36,187],rainbowdqnpolici:[6,44,187],rainbowhead:[30,37,187],rais:[12,19,21,23,25,26,27,58,82,92,93,96,105,107,115,144,153,154,156,169,188,197],ram:[4,120],ramachandran:187,ramwrapp:[5,120],randint:[131,190],randn:[29,33,34,37,171,175,178,179,181,185,187,192],random:[0,4,8,58,69,75,82,122,130,147,149,163,178,183,187,188,190,192,194,197,199],random_:[42,178,189,192],random_act:135,random_collect_s:[130,178,192],random_data:199,random_polici:[130,199],random_token:[9,16],randomli:[17,42,104,122,155,163,178,188,189,192,194,197],randompolici:199,rang:[38,75,78,91,115,118,119,121,125,126,131,135,136,138,146,147,155,156,163,164,165,172,176,181,183,189,190,192,193,195,199,200],range_valu:[123,142],rank0:[134,156,166],rank:[82,90,107,127,156,157,166],rapid:185,rashid:[174,176,177,186],rate:[26,27,40,41,42,43,45,46,47,48,75,141,163,178,179,187,189,192,201],rather:[58,96,134,163,173,175,177,179,199],ratio:[45,62,64,74,119,145,163,172,184,185,197,199],ratio_gath:172,raw:[4,28,49,50,52,53,56,120,158,159,181],rcwmc:161,re:[53,127,173,175,191],reach:[56,59,63,101,107,134,136,147,153,154,157,163,173,188,197,199],reachabl:4,react:58,reaction:58,read:[0,84,88,105,108,132,154,155,157,165,169,188,199],read_config:1,read_config_yaml:1,read_fil:86,read_from_ceph:86,read_from_fil:86,read_from_mc:86,read_from_path:86,read_from_redi:86,read_from_redisclust:86,reader:188,readi:[161,169],readm:202,ready_ob:[3,146,147,199],real:[8,33,79,91,135,144,147,178,183,192,197],realiz:[107,154,165],realli:[135,199],realloc:151,reason:[96,117,134,140,169,179,181,187,188,190],rebas:[168,169],receiv:[17,23,81,90,96,117,129,149,154,157,174,188,197,199,200],recent:[4,108,120,173,183,191],recogn:23,recognis:120,recognit:133,recommand:160,recommend:[19,23,58,75,129,132,135,147,149,151,154,159,166,167,169,175,181,188,195,199],record:[25,26,40,41,43,45,46,102,107,108,134,142,149,155,156,160,163,166,172,199,200,201],record_target_v:190,recorddict:26,recurr:[47,133,171],recurs:[82,127,172,181],recycl:154,red:[6,51,158,159,188],red_irl_model:[6,51,202],reddi:190,redefin:180,redi:[84,85,140],redisclust:[84,85],redisu:75,redrewardmodel:51,reduc:[74,81,91,107,151,171,173,177,179,184,192,197,199],reduce_result:91,reduct:[69,129,171,181,188,190,192],reevalu:73,ref:166,refer:[2,4,28,29,31,33,34,35,37,38,40,41,42,43,45,46,47,48,53,62,63,69,75,76,77,78,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,105,107,108,117,123,126,127,128,130,133,135,136,140,141,154,155,157,160,162,165,168,169,182,189,191,194,195,197,199,200],referenc:138,reflect:[75,197],refus:[15,21,23,163],regard:[27,135,140,149,154,193],regardless:107,region:172,regist:[25,27,40,41,42,43,45,46,47,48,58,96,105,107,123,124,132,134,157,162,165,166,172,175,176,177,178,179,181,184,186,187,189,192],register_attribute_valu:[108,123,142],register_hook:[107,156,157,166],register_learn:166,register_learner_hook:[106,164,165],register_wrapp:[164,165],registr:[117,124],registri:[40,41,42,43,45,46,47,48,122,162,172,175,176,177,178,179,181,184,186,187,189,192,194,202],registry_factori:202,regrad:190,regress:[29,33,75,175,178,192],regressionhead:30,regul:[121,136,176],regular:[41,42,45,176,177,178,182,184,189,190,191],regularli:157,reinforc:[40,41,46,47,120,124,131,133,136,149,151,154,155,171,173,174,175,176,177,178,179,180,181,185,186,187,188,189,190,191,193,194,196,197,199],reinnforc:135,reinstal:[140,151],reject:154,rel:[91,165,172,187,188,189,190,193],relat:[3,4,27,91,107,108,123,124,127,131,134,140,149,151,154,157,160,162,165,167,169,176,180,188,189,191,195,197,199,200,202],relationship:[149,151,152,154,155,157,186,191,197],releas:[3,43,82,88,101,118,147,153,154,157,169,178,192,194],release_spac:82,relev:[149,151,183,193,194],reli:[173,176,177],reliabl:199,reload:19,relu:[28,29,33,34,37,75,134,171,175,178,179,181,185,187,192],remain:[81,131,133,144,157,173,192,199],remain_data_count:81,remark:187,rememb:123,remi:[172,181],remind:188,remot:[154,168,169],remov:[38,67,84,108,114,134,140,149,163,176,186,190,191,199],remove_data_count:108,remove_fil:86,renam:199,render:[4,148,149,200],reocrd:160,reorder:26,reourc:104,repali:107,repaly_buffer_idx:108,repara_:189,reparameter:[29,33,178,189,192],reparameterizationhead:30,reparametr:189,repeat:[4,29,120,144,147,151,157,178,189,192,197,199],repeatedli:197,repetit:152,replac:[3,108,149,172,179,185,193,197],replai:[2,3,6,42,47,48,79,109,118,122,133,152,155,156,157,162,166,172,173,175,178,179,181,182,189,190,191,192,194,196,197,199,200,201],replay_buff:[6,101,109,118,119,121,125,129,130,135,136,162,163,199,200,202],replay_buffer_demonstr:190,replay_buffer_idx:[108,156],replay_buffer_new:190,replay_buffer_s:[108,125,135,136,162,163],replay_path:[2,3,135,200],replay_unique_id:[108,156],replaybuff:181,replaydataset:67,replic:[75,131],replica:161,repo:[138,160,169,178,192],report:[147,168,169,188],repositori:[94,167,168,169],repres:[19,21,78,92,133,136,149,184,186,197,200],represent:[75,177,187,193,197],reprocess:149,reproduc:[108,131,200],request:[12,14,15,17,19,20,23,68,123,152,157,161,167,168,169],request_retri:[17,19,23],request_retry_wait:[17,19,23],requestexcept:[19,20,23],requir:[40,41,45,46,61,77,108,124,125,133,135,136,138,147,149,151,157,161,163,165,167,177,193,195,197,200],requires_grad:[61,127,181,188,189],requires_grad_:189,requri:167,res_block:[6,28,70],res_typ:75,resampl:187,resblock:[6,28,70],rescal:[47,63,150,151],research:[117,133,138,191,194],reset:[2,3,4,27,40,46,48,58,75,93,94,101,108,120,124,130,131,133,135,136,143,144,146,147,148,149,155,162,164,165,178,189,192,199],reset_env:[94,199],reset_nois:75,reset_param:[3,146,147],reset_paramet:75,reset_polici:[94,130,199],reset_st:124,reset_timeout:[146,147],resfcblock:[6,28,70],reshap:4,resid:157,residu:[56,75,82,101,133,173,181],residul:82,resnet:173,resolut:169,resolv:[26,169],resouc:104,resourc:[3,90,96,100,104,107,147,149,152,153,154,157],resource_info:104,resource_manag:[6,103,202],respctiv:129,respect:[3,79,92,125,134,154,169,172,174,175,178,181,188,189,190,192,197,199],respond:157,respons:[12,14,15,149,155,157,162,199],responseexcept:[13,16],rest:120,restart:[149,161],restor:[40,43,45,46],restrict:[4,184,185,199],result:[4,17,19,20,21,25,26,29,37,38,40,41,43,45,46,63,69,72,75,76,82,87,89,91,95,96,108,114,115,121,123,131,135,136,144,147,149,151,153,154,155,157,163,165,166,171,173,175,176,177,178,179,181,182,183,184,185,186,187,189,192,193,197,199,200],results_dir:136,resum:200,ret:[27,38,63,64,78,82,156,166,172,176,186],retain:144,retrac:182,retri:[17,19,23,146,147,199],retriev:[96,105,107,124,172],retry_waiting_tim:[146,147],return_:[171,181,185],return_t_plus_1:181,return_valu:8,returnkei:[33,178,192],returnn:3,returnskei:[25,33,34,35,37,39,40,41,42,43,45,46,47,48,108,171,175,177,178,179,185,187,192],reulst:123,reus:[159,165,184],reveng:[187,188],revers:[26,78,159,172,181],revert:159,review:[167,168,169,183],revisit:187,rew:[147,188],rew_shap:[4,148,149],rew_spac:[135,148,149],reward:[0,3,4,6,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,57,59,63,64,66,95,107,108,117,118,120,121,126,127,128,129,133,134,148,149,160,162,163,172,175,176,177,178,179,180,181,182,183,184,186,187,189,190,191,192,193,194,198,199,200,201,202],reward_discount:4,reward_factor:53,reward_max:134,reward_mean:[134,138,187,188,201],reward_min:134,reward_model:[0,49,50,52,53,54,118,132,188,202],reward_rang:4,reward_std:134,reward_t:53,rewardnormenv:[5,120],rewrit:[52,53,54,73,125,127,154,188],rewritten:200,rf:[150,151],rgb:[135,197],rho:[61,64,66,172,176,178,181,189,191,192],rho_:[175,181,189],rho_clip_ratio:[66,181],rho_pg_clip_ratio:[66,181],rho_t:[172,181],rich:155,richer:186,riedmil:179,right:[91,126,135,136,138,171,172,175,178,179,184,185,187,189,191,192,193],right_ok:[158,159],ring:127,rishabh:187,rl:[6,40,41,42,43,45,46,47,48,49,50,66,82,117,122,124,133,136,149,160,162,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,199,200,202],rl_tuil:[6,60],rl_util:[6,60,63,128,133,150,151,172,175,181,190,199,200,202],rl_utilr:133,rllab:[178,189,192],rllib:[141,178,189,192],rm:[4,120,150,151],rmsprop:[6,70],rnd:[182,194,202],rnd_rew:188,rnd_reward:188,rnd_reward_model:[188,202],rndnetwork:182,rndrewardmodel:182,rnn:[6,38,43,47,70,122,124,171,175,176,179,185,186,187,194],robot:[193,197],robust:[27,138,190,193,199],rock:155,rollout:[173,193],romoff:174,room:188,root:[91,140],rosin:173,round:[118,155,174],rout:197,row:[53,188],rowland:[175,187],rsampl:189,rst:167,rstep:147,rt:155,rudner:[174,176,177,186],rudolph:185,rule:[52,136,155,160,165,166,167,173,178,199],run:[0,2,3,4,19,23,25,29,34,37,68,81,92,93,105,120,131,132,134,135,136,138,140,144,146,147,149,150,151,154,156,157,161,163,165,167,169,171,175,181,183,185,187,188,194,195,197,199],run_until_ctrl_c:[153,154],runnabl:127,runningmeanstd:[5,120,188],runtim:[105,107,149,195,199],runtimeerror:92,rwlock:88,rwlockfaird:88,ryan:177,s10472:173,s1:53,s2:53,s3:[25,84],s41586:193,s:[0,2,3,17,19,23,25,26,27,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,56,58,67,69,72,75,78,79,81,82,88,89,91,92,93,94,96,101,102,105,107,108,114,117,118,121,123,124,125,129,130,131,132,133,134,135,138,140,144,145,147,155,156,157,159,161,162,163,166,167,169,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,189,190,191,192,193,196,197,199,200],s_0:[117,196,197],s_1:[117,196,197],s_2:197,s_:[128,133,171,176,177,178,184,185,187,191,196,197],s_i:181,s_n:[179,196,197],s_size:53,s_t:[128,133,179,191,196,197],sac:[42,133,141,178,182,188,191,192,194,202],sacpolici:189,safe:[26,81,108,147,172],safeti:88,sai:[173,188,197,199],said:173,same:[2,4,8,29,33,34,37,40,41,43,45,46,58,62,63,68,75,78,90,92,94,107,108,115,120,121,123,125,126,127,131,134,135,147,149,154,155,157,160,161,162,165,169,171,175,178,181,185,186,187,188,189,192,193,197,199,200],same_shap:[6,70],samller:197,sampl:[4,17,29,39,40,41,42,43,45,46,47,48,56,61,63,64,69,94,96,102,108,115,118,119,120,121,122,124,125,129,133,134,138,144,152,155,157,162,165,172,173,175,176,177,178,179,180,181,183,184,186,187,188,189,190,191,192,193,194,196,197,199,200,201],sample_act:190,sample_check:163,sample_collector:199,sample_data:108,sample_data_count:108,sample_min_limit_ratio:163,sample_rang:108,sample_s:121,sample_serial_collector:[6,98,202],samplecollector:[98,199,200],sampled_data:108,sampled_out:134,sampleddataattrmonitor:123,sampler:69,samplewrapp:124,samvelyan:[174,176,177,186],santurkar:185,sarsa:[178,189,192],satind:193,satisfi:[27,58,197],save:[0,2,3,27,34,40,43,45,46,67,84,89,90,94,96,105,107,123,124,127,133,134,147,149,156,157,163,165,166,171,185,187,197,199,201],save_cfg:[0,138,200],save_checkpoint:[25,67,107,138,156,157,166,199,200],save_ckpt:[164,165],save_ckpt_after_it:[164,165],save_ckpt_after_run:[107,156,164,165],save_ckpt_freq:107,save_config:1,save_config_pi:1,save_config_yaml:1,save_fil:86,save_file_ceph:86,save_file_redi:86,save_file_redisclust:86,save_format:0,save_path:0,save_prev_st:[124,133],saveckpthook:[106,164,165],saved_hidden_st:133,saved_hidden_state_timestep:133,sawicki:183,sb3:141,sc2:[141,199],scalabl:[66,127,136,177,180,181,194],scalar:[40,41,43,45,46,62,68,71,193],scale:[4,38,135,136,144,154,159,172,174,188,189,191,194],scale_factor:75,scaledfloatfram:[5,120],scatter:[75,150,151],scatter_connect:[6,70,150,151],scatter_typ:75,scatterconnect:[6,70],scenario:[149,163,176,180,186],scene:[4,144],schaul:187,schduler:67,schedul:[67,154,169,194],scheme:[160,177,199],schmitt:193,schrittwies:[173,193],schroeder:[174,176,177,186],schulman:[184,185],scipt:82,scissor:155,score:[134,135,138,199],scott:192,scratch:[117,169],screen:135,script:[127,161,167,202],scriptmodul:28,sea:136,search:[140,165,173,183,193,194,197],sec:142,second:[11,17,19,23,81,92,93,114,134,144,155,161,163,177,181,189,192,195,201],secondari:154,section:[82,121,123,125,130,133,165,167,169,195,197,199,200],sedol:173,see:[4,26,28,29,33,34,37,52,53,54,75,82,93,114,123,130,133,140,157,161,165,171,173,175,178,179,181,185,187,192,195,199,200],seed:[0,3,82,117,122,127,136,138,146,147,148,149,150,151,187,188,194,199,200],seek:[190,197],seem:134,seen:[157,165,188],segment:[90,91,108,163,199],segment_tre:[6,86,202],segmenttre:[6,86],seiral:117,select:[0,27,138,154,155,160,173,174,178,179,183,187,189,192,197,199],select_fn:27,self:[2,4,8,14,15,20,23,27,28,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,79,83,91,107,108,120,123,124,126,127,128,129,130,131,133,142,153,154,155,156,162,164,165,166,173,176,178,181,187,188,189,190,191,192,194,199],self_featur:38,self_feature_rang:[38,176],self_token_invalid:[14,15],self_token_not_found:15,self_token_not_given:14,selfplay1_evaluator_step:138,selfplay2_evaluator_step:138,selfplay_demo_ppo:138,selfplay_evaluator1:138,selfplay_evaluator2:138,semi:177,send:[17,19,81,100,102,105,133,134,147,152,157,197,199],send_collector_task:100,send_learn_info:[105,156,157],send_learner_task:100,send_metadata:96,send_polici:[105,156,157],send_stepdata:96,sendpolicyhook:105,senet:54,sensit:189,sent:[19,20,23,90,96,105,112,147,149,153,154,157,199],sentenc:[166,167],sep:173,separ:[3,118,121,134,151,163,166,167,172,173,177,178,184,189,190,191,192,199],seq:75,seq_len:[75,150,151],sequenc:[28,68,78,107,128,133,157,162,181,197,202],sequence_op:63,sequencetyp:[28,29,33,34,35,37,171,175,177,178,179,181,185,187,188,192],sequenci:194,sequenti:[38,75,92,134],sequential_pack:[6,70],sergei:190,seri:[133,149,154,160,197,199],serial:[40,41,43,45,46,47,48,94,101,107,108,117,127,129,138,147,157,162,163,172,175,176,177,179,181,184,186,187,194,200],serial_collector:132,serial_entri:[107,117,131,202],serial_entry_il:[117,202],serial_entry_reward_model:202,serial_entry_sqil:190,serial_pipelin:[0,107,117,125,127,130,131,132,135,136,150,151,187,199],serial_pipeline_il:117,seriou:188,serv:161,server:[2,17,19,23,154,160,161,199],servic:[8,14,152,157,161,194,202],set:[2,3,4,27,28,29,33,34,37,38,40,41,43,45,46,48,49,52,53,54,58,62,63,68,69,72,73,75,79,82,89,90,91,96,107,117,118,119,121,125,126,127,128,129,130,131,133,134,135,136,138,141,142,144,147,149,151,152,154,156,157,159,160,162,163,166,169,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,194,195,197,199],set_pkg_se:[86,131,138,200],set_set:174,setalgolin:191,setattr:[123,127,156],setkwinout:191,setlevel:89,setstretch:191,setter:[156,166],settinng:75,setup:[4,29,33,34,37,107,156,166,167,171,175,178,181,185,187,192,195,200],setup_dataload:[107,156,157,166],sever:[47,48,79,85,115,131,135,136,154,157,163,172,187,199],sh:202,shane:181,shape:[3,4,26,28,29,33,34,35,37,38,40,41,42,43,45,46,47,48,53,55,57,58,59,61,62,63,66,68,71,74,75,78,120,129,135,138,147,148,149,150,151,160,166,171,172,175,176,177,178,179,181,184,185,186,187,189,190,192],shapingin:138,share:[3,25,26,27,28,34,45,127,136,155,162,163,165,171,174,177,181,184,185,187,192],share_encod:[34,171,181,185],shared_memori:[139,140,146,147,148,149,161],shared_payoff:[6,24,202],shell:[127,195,201],shibani:185,shimon:[174,176,177,186],shmbuffer:5,shmbuffercontain:5,shogi:193,shonw:127,shoul:[62,160,162],should:[25,26,27,38,41,47,54,56,58,59,63,67,69,75,78,79,90,91,92,96,101,105,107,108,114,115,120,121,123,124,125,126,127,128,129,132,133,135,149,152,157,160,161,163,166,167,169,172,176,181,185,188,189,193,195,197,199,200],should_ev:[138,199,200],shouldn:67,show:[2,17,107,115,120,124,125,128,136,144,154,157,161,172,184,187,188,192,199,200,201],show_hook:[164,165],shown:[55,57,62,66,115,119,126,131,133,135,138,144,147,149,155,161,175,176,177,178,179,181,184,185,186,187,189,190,192,193,199,200,201,202],shuffl:75,shut:[14,15,81],shutdown:[8,14,15,19,23,102,153,154],siddharth:190,side:[49,50,52,53,54,75,82,154],sifr:193,sig_dfl:93,sigalrm:93,sigma0:75,sigma:[29,33,42,58,178,189,192],sigma_typ:[29,34,171,181,185],sign:[4,65,120,166,187],signal:[19,23,93,178,189,192,196,197],signatur:[4,52,53,54],signific:[173,197],significantli:[127,136],signl:108,silver:[171,173,175,178,179,187,193],sim:[58,172,174,175,176,178,189,191,192],simga0:75,similar:[39,40,41,42,43,45,46,47,78,115,121,133,147,154,155,160,165,178,180,181,184,188,192,195,199,200,201],similarli:[154,177],simon:193,simonyan:[173,181,193],simpl:[4,17,20,93,114,118,126,133,140,147,149,154,157,159,160,161,165,169,173,189,190,193,197,199,200],simpler:[165,185,199],simplest:[117,183],simpli:[40,43,45,46,82,127,136,159,165,178,180,181,183,192,195,197,199,200],simplic:188,simplif:193,simplifi:[114,147,159],simul:[82,144,149,183,197,199],simultan:178,simutan:118,sinc:[4,26,40,41,46,123,129,151,177,178,181,188,189,192,199],singh:193,singl:[53,73,82,115,125,126,127,135,147,152,155,174,177,178,181,192,194,197,199,200],single_step:[38,176,186],singleton:149,singletonmetaclass:86,site:[150,151,160],situat:[154,165,169,190,197],six:144,size:[4,28,29,33,34,35,37,38,40,41,43,45,46,47,53,55,57,58,59,61,62,63,64,66,71,75,78,79,105,108,118,121,123,136,145,147,151,163,171,172,175,176,177,178,179,181,185,186,187,189,190,192,199],size_averag:74,sketch:188,skip:[4,120,123],sl:114,slave:[6,13,14,16,17,19,79,96,105,112,152,153,156,157,202],slave_already_connect:15,slave_connection_refus:15,slave_disconnection_refus:15,slave_not_connect:15,slave_token_invalid:14,slave_token_not_given:14,slavechannelinvalid:[13,16],slavechannelnotfound:[13,16],slaveconnect:[16,18],slaveconnectionproxi:[16,18,19],slaveerrorcod:[13,16,19],slavemastertokeninvalid:[13,16],slavemastertokennotfound:[13,16],slaveresponseexcept:[13,16],slaveselftokeninvalid:[13,16],slaveselftokennotfound:[13,16],slaveslavealreadyconnect:[13,16],slaveslaveconnectionrefus:[13,16],slaveslavedisconnectionrefus:[13,16],slaveslavenotconnect:[13,16],slavesuccess:[13,16],slavesystemshuttingdown:[13,16],slavetaskalreadyexist:[13,16],slavetaskrefus:[13,16],sleep:[17,19,23,68,142],slice:108,slide:123,slightli:75,slow:[131,145],slowli:178,slurm:[0,92,127,154,199],slurm_dist:202,slurm_dist_multi_gpu:202,slurm_help:202,slurm_parallel:202,smac:[38,152,176,177,186,197,199,202],small:[48,143,144,145,159,163,175,181,187,188,190,192],smaller:[93,101,181,188],smallest:[48,175,187],smoo:[42,178,192],smooth:[74,182],smooth_ratio:74,snapshot:[25,27,155],snapshot_or_not:25,snapshot_play:27,snippet:[136,167,188],so:[17,19,38,62,78,82,90,92,94,107,108,114,115,120,123,125,127,130,133,134,138,149,150,151,154,155,157,163,165,169,172,176,179,186,188,191,197,199],socket:92,soft:[42,74,75,178,189,190,191,192,196],soft_argmax:[6,70],soft_q_:189,soft_q_valu:190,softargmax:[6,70],softfocalloss:[6,70],softmax:[69,187,190,191],softqnet:189,sole:173,solo:[26,101],solo_parallel_command:[6,103,202],solosharedpayoff:[26,27],solut:[117,140,172,199],solv:[95,131,133,157,162,166,172,173,174,188,193,197,199],some:[0,4,27,28,40,43,45,46,47,49,50,52,53,54,59,63,75,91,93,94,95,107,108,114,115,117,119,120,121,122,123,124,125,128,129,133,134,135,140,144,147,149,151,155,157,159,160,162,163,165,166,169,172,173,179,181,188,190,191,193,194,195,197,199,200,202],some_kei:78,some_seq:78,someth:[88,142,153,154],sometim:[4,115,120,140,152,163,166,197,199],son:186,song:180,sonnerat:186,soon:[19,23],sort:[26,79,107],soup:138,sourc:[0,2,3,4,8,11,12,14,15,17,19,20,21,23,25,26,27,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,58,67,68,69,73,74,75,79,81,82,83,88,90,91,92,93,94,95,96,100,101,102,104,105,107,108,120,121,132,138,154,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,202],south:138,soyer:181,sp:[27,155],space:[2,3,4,33,34,37,61,66,75,82,101,120,124,126,130,133,141,148,149,160,171,172,173,175,176,177,178,179,180,181,184,185,186,187,189,190,191,192,193,198],spaceinvad:127,spaceinvaders_dqn_config_multi_gpu_ddp:127,spaceinvaders_dqn_config_multi_gpu_dp:127,span:23,spars:[40,41,43,45,46,47,48,117,135,138,175,176,177,179,184,186,187,188,190,197],spatial:[75,176],spatial_s:75,speak:[147,165,191],spec:161,special:[63,64,94,134,149,155,169,187,199],specif:[27,29,94,96,107,108,118,124,135,136,140,147,149,151,154,155,156,157,159,160,161,162,163,166,167,169,178,179,189,192,193,194,195,197,199,200],specifi:[68,71,75,92,94,117,123,125,130,133,140,147,161,165,167,178,187,199,200],speech:133,speed:[58,131,147,151,152,163,172,177,179,181,187,194,195,199],speedup:151,spend:134,sphinx:167,spiningup:141,spinningup:[178,189,192],split:[56,75,82,114,123,133,172,181,184,199],split_data:181,splite:82,splitter:114,spot:27,sqil:[117,182,194],sql:190,sqlpolici:190,sqn:[133,182,194,202],sqrt:[58,65,173,183,187],squar:172,squash:189,squeez:[26,86,189],squeezebackward1:[33,34,171,178,181,185,192],src:90,src_arr:3,src_checkpoint:25,srun:[127,199],ss_loader:114,stabil:[154,155,169,172,178,191],stabl:[69,75,107,161,175,178,194],stabler:120,stack:[4,39,40,41,42,43,45,46,47,48,56,120,135,176,188,199],stackrel:181,stage:[118,120,155,173,190],stai:[78,138],stale:[108,123,163,199,201],staleness_avg:[123,134],staleness_max:[123,134],stand:[75,135,154],standard:[52,58,92,114,134,144,170,176,185,188,199],standbi:[154,157],starcraft2:[143,144,155],starcraft:[27,78,174,176,177,186],starcraft_play:[27,202],start:[8,17,19,20,23,42,43,48,58,68,84,91,92,93,96,100,102,105,107,108,120,125,132,133,135,136,149,153,154,155,156,157,162,163,165,166,169,173,175,178,179,187,189,192,194,199],start_fail:20,start_tim:[93,102],startup:154,state:[2,4,28,35,38,40,41,43,45,46,47,49,50,52,53,58,59,63,64,75,94,102,105,108,117,120,124,128,136,146,147,148,149,154,162,163,165,174,176,177,178,179,181,183,186,187,188,189,190,191,192,193,198],state_action_input:189,state_dict:[40,43,45,46,67,102,105,107,108,117,127,156,157,163,199,200],state_dict_handl:174,state_dict_mask:67,state_dim:38,state_id:124,state_info:124,state_num:[124,133],stateless:[148,149],statement:166,stationari:175,statist:[163,199],statu:[11,12,17,19,20,147,152,153,154,155,165,188],status_cod:[12,19],std:[4,62,120,188,189,199],sted:128,stefano:180,step2:187,step:[2,3,4,19,23,27,39,40,41,42,43,45,46,47,48,56,58,63,64,66,73,79,82,96,101,108,117,118,120,122,123,124,126,127,129,132,133,135,136,138,141,143,144,146,147,148,149,150,151,155,162,164,165,169,171,172,175,178,179,181,182,184,185,188,189,190,191,192,193,194,197,199,200,201],step_count:134,step_timeout:[146,147],step_wait_timeout:[146,147],stepdata:[96,105],still:[4,17,19,23,92,105,133,134,135,138,147,149,153,154,157,169,173,188],stocat:197,stochast:[180,187,188,189,190,193,196,197],stop:[68,81,93,101,153,154,190,199,200],stop_flag1:138,stop_flag2:138,stop_flag:199,stop_valu:[135,136,138,157,161,199],storag:[2,152],store:[3,40,46,69,94,96,105,108,121,133,134,147,157,161,163,178,189,192,194,197,199],storkei:188,stpe:155,str:[0,2,3,8,12,17,19,20,21,23,25,26,27,28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,49,52,53,54,56,58,67,68,69,73,74,75,77,78,79,82,84,85,88,89,92,93,94,96,100,101,102,104,107,108,123,128,133,142,153,154,156,158,159,166,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192],straightforward:181,strategi:[27,39,40,41,45,46,47,124,129,155,165,174,175,188,189,190,192,197,200],strcutur:4,stream:[187,188],strict:[40,43,45,46,67],stride:75,string:[23,27,84,89,102,114,149,159,200],strong:27,strong_win_r:27,stronger:[58,155],strongli:[58,154],structencod:30,structur:[8,12,17,26,81,91,112,114,120,124,154,155,159,160,173,186,188,194,199,200],struggl:117,stuck:[147,177],studi:[136,173,185],style:[169,192,199],sub:[82,117,135,138,147,156,159,166,177],sub_:190,subclass:[23,68,92,107,120,149,163,165,166,199],subfold:134,subjec:172,subkei:82,submiss:167,submit:[152,167,169],submodul:199,subprocess:[3,135,143,144,147,187,190,199],subprocess_env_manag:[5,6,148,149,152,199],subprocessenvmanag:152,subsequ:[175,188,197],substanti:[167,187],substitut:75,subtl:181,subtract:[181,188],succe:[26,155],succeed:161,succes:[135,138],success:[12,14,15,19,23,26,112,136,151,153,154,157,183],successfulli:[151,155,157,169,195],suffer:[180,186,192],suffici:[140,193,197,199],suffix:200,suggest:[114,169,195],suitabl:[152,169],sum:[4,43,47,48,59,91,114,120,123,126,142,153,154,162,172,175,179,186,187,189,190,191,193,196,197,199],sum_:[91,171,173,175,177,178,179,181,183,186,187,189,191,192],sum_a:[181,191],summar:199,summari:[49,52,53,54,107,155,197],summarywrit:[49,52,53,54,89,107,108,138,188,200],sumsegmenttre:91,sunehag:186,superclass:[8,82],superhuman:[183,193],superset:199,supervis:[27,74,117,173,190,193,196,199],suport:0,suppli:161,support:[3,8,17,20,26,43,48,58,68,69,73,75,77,84,93,110,116,123,124,125,127,129,131,132,133,135,138,147,152,154,159,161,163,165,171,172,175,176,179,181,184,185,186,187,188,190,194,195,199,200,202],suppos:[95,199],sure:[17,19,23,27,45,88,123,124,129,130,133,169,188,195,199],surpass:[166,173,179],surrog:180,surround:197,suscept:192,sutton:63,sv:138,swap:114,sweep:136,swig:195,sy:169,symbol:[40,41,42,43,45,46,47,48,167,172,175,176,177,178,179,181,184,186,187,189,192],sync:[107,127,143,144,146,147,162,166,169],sync_gradi:[127,162],syncbn:75,synchron:[93,127,157,169,181,199],syncsubprocessenvmanag:[5,139,146,147,194,199],syntax:167,synthesi:134,system:[0,84,87,96,102,105,107,131,132,134,135,151,157,159,163,166,177,180,195,197,199],system_cfg:0,system_config:[161,199],system_help:[6,86,202],system_shutdown_flag:102,system_shutting_down:[14,15],t:[38,40,46,56,57,58,59,61,62,63,64,66,67,75,77,78,82,92,95,107,127,128,130,133,147,150,151,155,166,171,172,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,193,196,197,199,200],t_traj:[63,64],tabish:[174,176,177,186],tabl:[134,144,167,179,190,197,199],tabular:[89,188],tag:195,tail:163,take:[2,4,40,41,45,46,47,61,66,75,77,120,121,123,125,128,130,132,133,155,157,162,165,174,177,179,184,186,188,189,190,193,194,197,200],taken:[64,92,136,193,197],tamar:177,tamer:174,tanh:[29,189],tar:[134,200],targ:[178,184,189,192],target:[0,27,39,40,41,42,43,46,47,48,63,64,66,71,74,91,92,94,124,126,128,129,150,151,160,162,164,165,169,172,174,175,176,177,179,181,182,186,187,188,189,190,191,193,197],target_:[40,41,43,46,47,176,177,179,186],target_extra:71,target_featur:188,target_log_polici:189,target_new_data_count:118,target_ob:[47,133],target_output:[61,64,66,181],target_pi:172,target_q_act:[126,128,129,133],target_q_valu:[57,126,128,129,133,178,189,191,192],target_theta:[42,178,189,192],target_update_freq:[135,162],target_v:190,target_v_valu:191,target_valu:189,targetnetworkwrapp:[124,164,165,178,192],tarmac:174,tarun:177,task:[6,14,15,16,17,18,19,21,23,27,96,101,102,104,112,120,132,133,138,144,149,152,153,155,157,165,166,169,174,175,176,189,193,197,199],task_already_exist:15,task_count:101,task_data_invalid:14,task_id:[20,101,102],task_info:[96,156],task_refus:15,task_spac:101,taskfail:[16,22,23,96,153,154],taskrefus:[16,22,23],taskresulttyp:[16,18],taskstat:[6,103],taskstatu:[16,18,153,154],tassa:178,tate:102,tau:[29,37,117,175,177,178,186,191],tautolog:159,tb:[69,108,134,199],tb_logger:[49,52,53,54,89,107,108,118,123,125,138,156,157,166,188,200],tbd:[173,174,183,193,199],tcc:191,td3:[42,123,141,178,182,188,189,194,197,202],td3polici:192,td:[6,41,43,45,60,122,126,129,133,150,151,175,177,179,184,187,190,191,192,194,196,197,199,202],td_:[41,177],td_data:[126,178,192],td_data_twin:[178,192],td_error:[63,190],td_error_per_sampl:[63,126,128,129,178,189,190,192],td_error_per_sample0:189,td_error_per_sample1:[178,189,192],td_error_per_sample2:[178,192],td_error_per_sample_:126,td_lambda:63,td_lambda_error:60,teach:125,teacher:[160,164,165],teachernetworkwrapp:[164,165],team:169,techniqu:[186,197],tell:121,temper:197,temperatur:[183,189,191],templat:[6,32,43,127,133,147,149,160,161,167,170,171,175,176,177,178,179,181,185,186,187,192,202],tempor:[6,60,75,133,178,181,192,193,199],temporarili:147,ten:123,tend:[180,187,197],tendenc:197,tensor:[28,29,33,34,35,37,38,39,40,41,42,43,45,46,47,48,53,55,56,57,58,61,62,63,64,66,68,69,71,72,74,75,78,79,84,90,94,126,127,129,160,171,172,175,176,178,179,181,185,186,187,188,189,190,192,197,199],tensor_to_list:[6,70],tensorboard:[40,41,43,45,46,89,107,108,123,134,162,163,190,199,200],tensorboardx:200,tensorflow:182,term:[58,59,154,172,174,176,189,190,196,197],termin:[4,43,45,47,59,63,64,79,89,92,136,147,151,156,162,166,178,179,189,192,193,195],terran:27,tesla:[150,151],test:[81,85,117,136,138,144,150,151,167,169,195,199,200,202],test_cach:81,test_ga:151,test_overcooked_env:138,test_serial_entry_il:117,text:[0,40,41,43,45,46,69,89,100,108,123,134,162,163,172,175,176,178,179,183,185,187,189,191,192,193,199],text_level:89,text_logg:[156,166],textbf:[176,177,186,191],textlogg:89,texttt:192,tfboard:89,tfevent:134,th:[4,120,134],than:[4,27,43,58,75,79,91,95,96,101,121,123,128,134,144,155,156,159,160,163,169,173,175,177,179,181,185,186,188,193,197,199],thei:[31,79,96,108,115,123,136,151,154,155,162,163,165,172,181,187,190,191,192,197,199,201],them:[27,55,57,62,66,75,123,124,128,130,133,154,155,163,178,181,186,190,197,199,201,202],themselv:[2,27,199,201],theoret:190,theori:174,therebi:[45,151],therefor:[29,48,117,120,121,147,154,157,159,160,163,181,187,190,192,197,199],thereof:92,theta:[58,117,171,172,174,175,178,181,184,185,186,187,189,191,192,193,196,197],theta_1:192,theta_2:192,theta_:[171,177,178,184,185,192],theta_a:172,thi:[0,4,11,17,19,20,21,23,25,26,27,29,40,41,42,43,45,46,47,48,49,50,52,53,54,56,59,61,62,66,67,69,75,78,79,81,82,90,91,92,93,94,107,108,112,114,115,117,118,119,120,121,123,124,125,126,127,129,130,131,133,134,135,136,138,142,147,149,151,152,153,155,156,157,159,161,162,163,165,166,167,169,172,174,175,176,177,178,179,180,181,184,185,186,187,188,189,190,192,193,195,197,199,200,201,202],thing:[42,75,95,121,156,166,178,192,199],think:[187,199],thirti:177,thoma:193,thore:[186,193],those:[108,123,132,157,162,181,187,200],though:[4,159],thought:174,thread:[6,9,16,19,23,26,68,79,81,88,92,96,100,102,105,108,144,152,199],thread_lock:88,three:[118,123,134,144,155,157,165,181,187,190,194,197,199],threshold:[66,175],through:[42,92,96,117,127,132,135,136,147,149,151,154,155,157,165,166,169,173,174,178,181,187,189,192,193,195,197],throughout:[135,173],throughput:[108,134,152,199],throughtput:108,thrown:[82,147,154],thruput:163,thruput_log:108,thruputcontrol:163,thu:[136,180,190,191,193,197],tian:176,tianjun:176,tianshou:[141,143,144,178,189,192],tick_tim:[156,157,166],tickmonitor:123,ticktim:142,tild:[174,189],tim:[171,174,176,177,181,186],time:[4,11,17,19,23,42,45,58,63,64,81,92,93,102,107,108,114,115,118,119,120,123,125,127,128,133,134,141,143,144,145,147,149,150,151,155,156,157,163,164,165,166,169,178,179,181,184,187,188,189,192,193,194,197,199,201],time_:[93,108,123,142],time_help:[6,86,202],time_wrap:166,time_wrapp:[93,156],timehelp:93,timelin:142,timemod:142,timeourerror:93,timeout:[11,27,81,92,93,143,144,146,147,154,195],timer:93,timespan:19,timestamp:142,timestep:[2,3,38,39,40,41,42,43,45,46,47,56,58,61,63,66,78,129,133,135,136,146,147,162,176,181,186,190,199],timestep_col:80,timewrapp:86,timewrappercuda:93,timewrappertim:86,timothi:[171,178,193],titl:173,tmp_retrac:172,to_devic:[6,70,199],to_dtyp:[6,70],to_list:[6,70],to_ndarrai:[6,70],to_tensor:[6,70,188,199],to_tensor_transit:98,to_typ:[110,116,158,159],todo:[138,166,168,169,191],togeth:[114,159,190,199],toi:126,token:[8,14,15,17],toler:[19,199],tolist:129,tom:[114,178,181,187],toni:166,too:[114,118,134,152,163,178,185,188,199],tool:[108,120,165,194,195,199,200],top:[82,172,173,197,199],torch:[6,28,29,31,33,34,35,37,38,39,40,41,42,43,45,46,47,48,53,55,56,57,58,59,61,62,63,64,66,67,68,69,71,72,74,75,78,79,82,84,93,126,127,129,131,133,134,160,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,191,192,194,199,200],torch_util:[28,29,33,34,37,40,43,45,46,67,68,69,73,74,75,107,127,133,150,151,160,171,175,178,179,181,185,187,192,199,202],torchdataload:145,torr:[174,176,177,186],tot:186,total:[27,38,41,90,94,95,127,134,176,179,181,186,188,197,199,201],total_agent_step:27,total_config:[0,134,199],total_dur:134,total_envstep_count:134,total_episode_count:134,total_loss:[40,41,43,45,46,47,48,123,129],total_loss_avg:134,total_loss_v:[150,151],total_q:[38,176,186],total_q_loss:191,total_reward:4,total_train_sample_count:134,touch:167,tow:26,toward:[172,174,197],tp:191,trace:181,trace_loss:66,track:[123,163,168,169,178],track_used_data:108,tractabl:189,trade:[41,171,177,188,199],tradeoff:188,tradit:[129,193,197,200],train:[25,27,29,31,39,40,41,42,43,45,46,47,48,49,50,52,53,54,56,62,63,90,93,105,107,117,118,119,120,121,122,124,125,126,129,130,131,132,133,136,138,149,151,152,154,155,156,161,162,163,164,165,166,172,173,174,175,176,177,179,180,181,182,184,186,187,189,190,191,193,194,195,196,197,201,202],train_config:117,train_data:[118,119,121,125,138,188,190,200],train_data_demonstr:190,train_data_new:190,train_episod:121,train_epoch:[45,184],train_it:[107,118,119,121,125,134,138,190,199,200],train_iter:[25,27],train_sample_count:134,train_tim:[107,156],train_time_v:[150,151],trainabl:160,trainsit:197,traj:[39,40,41,42,46,47,48,56,181],traj_len:94,trajactori:48,trajbuff:98,trajectori:[39,40,41,43,45,46,48,59,61,63,64,66,94,105,117,133,155,162,172,181,198,199],tran:193,trans_fn:[63,150,151],transfer:[68,75,79,147,197],transform:[6,8,14,15,38,56,68,70,82,110,115,116,151,176,186,188,193,199],transform_scalar:94,transformerlay:[6,70],transfrom:63,transit:[39,40,41,42,43,45,46,47,49,50,56,94,108,121,129,133,162,175,178,181,187,188,189,190,192,193,197,199],translate_dict_func:[9,16],transmiss:154,transops:75,transpos:[4,75,120],treat:[117,154,191],treatment:94,tree:[91,108,134,163,173,183,193,202],trfl:63,tri:117,triantafyllo:177,tribut:[42,178,192],trick:[47,182,188,189],trick_mod:162,trigger:[153,154,165,169],trough:[178,189,192],trpo:[172,180,185],truncat:[135,172,181,187,188],trust:[91,172],trust_cal:91,trust_region:172,trust_region_valu:172,truth:74,try_import_ceph:86,try_import_link:86,try_import_mc:86,try_import_redi:86,try_import_redisclust:86,ts:[143,144],tsipra:185,tt:[158,159],tune:[162,163,189,190,199],tupl:[0,2,3,4,26,40,41,43,45,46,53,58,68,69,73,75,82,107,124,133,185,188,197],turn:[110,116,124,138,147,154,163],tutori:[169,194],tuyl:186,tv:188,twin:[33,178,192],twin_:[42,178,192],twin_crit:[33,178,192],twin_q:189,two:[0,25,26,27,38,42,43,45,79,82,107,118,120,121,123,125,127,133,134,135,136,138,149,154,155,157,159,161,163,169,173,176,178,179,181,183,184,187,188,189,190,192,197,199,200,201],txjk:161,txt:134,type:[0,2,3,4,14,15,20,26,27,28,29,31,33,34,35,37,39,40,41,42,43,45,46,47,48,52,53,54,56,58,68,69,75,79,82,83,84,88,91,93,96,101,105,107,108,115,121,125,127,128,130,132,133,135,136,144,147,149,151,154,155,159,160,162,163,164,165,166,167,169,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,195,199,200],type_:[0,88],type_help:[28,29,33,34,35,37,171,175,177,178,179,181,185,187,192,202],typeerror:[115,158,159],typic:[117,180],typo:167,u013548568:93,u:[127,173,175,177,183,184,186,189,191,199,200],u_:189,ubuntu:195,uc:173,ucolor:[158,159],uct:183,uer:79,uhlenbeck:[42,58,178,192],uid:92,uint8:135,ultim:197,uml:[112,167],unattain:173,unavail:138,unbias:197,unbound:189,uncertain:[151,190],uncertainti:[147,197],unchang:[4,68],unclear:191,uncontrol:159,undefin:[4,117],under:[127,136,138,144,151,165,169,172,179,197],underbrac:[176,179,191],underestim:175,underli:[183,188,193],underset:[187,191],understand:[122,149,157,169,180,188,194,197],understood:[157,165,180],unexpect:159,unexpectedli:142,unfamiliar:188,unfinish:147,unfreez:108,unhandl:92,unifi:199,uniform:[29,129,179,183],uniformli:[144,187,191,199],union:[3,4,27,33,34,35,37,38,39,40,41,42,43,45,46,47,48,58,72,75,78,79,82,89,94,96,108,123,128,131,142,171,172,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192],uniqu:[19,27,107,149,155],unit:[17,19,75,144,151,159,169,174,199],unittest:195,unix:[168,169],unknown:[183,197],unless:[147,169],unlik:[42,197,199],unnecessari:[154,199],unpredict:154,unrealist:154,unrol:[39,40,41,42,43,45,46,47,48,56,133,172,179,181,199],unroll_len:[43,47,56,133,162,172,179,181],unrollen_len:181,unseg:133,unsqueez:[172,189],until:[4,8,11,19,20,23,92,120,147,153,154,157,178,189,192,197],untrunc:181,unupdat:155,up:[3,38,75,82,92,117,126,132,133,135,138,147,154,157,160,169,178,188,192,194,197],upat:155,updat:[4,25,26,27,29,33,34,37,40,41,42,43,45,46,47,48,49,50,52,53,54,56,62,67,69,82,91,94,95,96,102,104,107,108,118,120,122,123,127,128,129,133,134,155,156,157,162,163,166,167,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,197,199,200,201],updata:69,updata_prob:69,update_:[40,46,176,186],update_active_play:[25,155],update_freq:[42,43,47,178,179,192],update_gradi:172,update_info:95,update_kwarg:[162,178,192],update_learner_info:101,update_logit:69,update_per_collect:[118,119,121,125,135,138,162,163,190,199,200],update_reward:95,update_shap:[5,120],update_theta:[40,41,46,176,177,186],update_typ:[162,178,192],upgo:[6,60,150,151,202],upgo_loss:60,upgo_return:60,upon:[47,48,187,193],upper:[130,167,183,192],upsampl:75,upstream:169,upward:179,us:[0,4,8,17,19,20,21,23,26,27,28,29,31,33,34,35,37,38,40,41,42,43,45,46,47,48,49,50,52,53,54,56,59,61,62,63,66,67,69,75,78,79,81,82,84,89,90,91,93,94,95,96,105,107,108,114,115,117,120,122,123,124,126,130,131,132,134,135,138,142,144,147,149,150,152,155,156,157,159,160,161,162,163,165,166,167,168,169,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193,194,195,197,199,200,201,202],usabl:124,usag:[2,4,8,20,28,29,31,33,34,35,37,38,49,52,53,54,76,77,81,82,83,84,85,87,88,89,90,91,92,93,94,95,96,97,99,107,115,134,147,151,154,159,160,164,165,167,169,194,195,199,200],usaual:82,use_avg:[123,134],use_count:[163,199],use_cuda:[82,131,138,156,166,200],use_distribut:[156,166],use_dropout:75,use_lock:84,use_max:[123,134],use_shaped_reward:138,use_value_clip:[62,185],used_data_remov:108,useddataremov:163,user:[40,41,43,45,46,94,107,117,120,121,124,133,135,139,140,147,149,151,154,155,159,160,162,163,165,167,168,169,195,199,200],user_baz:[168,169],usernam:169,usual:[3,4,8,26,27,29,40,43,45,46,49,50,61,66,82,108,117,120,124,129,131,133,136,149,155,157,160,162,163,171,172,175,178,179,180,181,183,187,193,197,199,200],util:[6,28,29,30,32,33,34,35,37,67,79,81,98,109,123,125,126,127,131,132,133,136,138,142,144,160,163,171,175,177,178,179,181,185,187,191,192,194,199,202],uuid:20,v0:[135,188,200],v100:[150,151],v2:[168,169],v4:[126,135,161,164,165],v:[38,123,134,171,172,181,184,191,195,196,197],v_1step_td_data:[178,189,192],v_1step_td_error:[178,189,192],v_:[128,172,175,181,184,187,193,196,197],v_dim:38,v_layer_num:29,v_max:[29,37,48,175,187],v_min:[29,37,48,175,187],v_pred:172,v_valu:189,vac:[6,32,36,171,181,185],vae:199,val:[40,41,43,45,46,47,48,67,75,91,101,123,172,175,176,177,179,181,184,186,187,200],valid:[14,15,20,40,41,43,45,46,47,48,108,110,116,134,163,172,175,176,177,179,181,184,186,187,197,199],valid_count:108,valid_id:124,valu:[3,4,8,14,15,19,20,21,23,25,26,27,29,33,34,37,39,40,41,42,43,45,46,47,48,49,50,52,54,55,56,58,59,62,63,64,66,67,75,78,82,91,93,94,96,105,107,108,115,119,120,123,124,125,126,128,129,134,135,136,142,144,147,149,150,151,154,156,159,161,164,165,166,171,173,174,175,176,177,178,179,181,182,183,184,185,186,187,188,189,190,191,192,193,198,199,200,201],valuabl:[0,180,188],value_:[41,45,47,59,177,184,189],value_buff:125,value_clip:62,value_data:[125,185],value_gamma:[43,63,126,128,181,190],value_inv_transform:[60,63],value_loss:[41,45,55,57,62,123,171,181,185],value_network:189,value_new:[62,185],value_old:[62,185],value_op:63,value_rescal:[6,47,60,63,202],value_transform:[60,63],value_wight:41,valueerror:[114,115,158,159],valy:[29,37,175],van:[187,192],vanilla:[179,189],var_dict:123,vari:[40,41,43,45,46,47,48,136,167,172,175,176,177,179,181,184,186,187,189,191],variabl:[4,40,41,43,45,46,89,101,107,108,120,133,140,147,149,151,152,156,157,160,162,163,165,166,189,195],varianc:[4,45,59,121,144,171,172,184,187,192,197],variant:[133,179,187,192],variat:[173,183],varibl:75,varieti:169,variou:[0,149,165,174,179,194,197,199,200,202],vasilev:177,vdn:[176,186],vdot:186,vector:[2,33,38,43,71,75,147,175,178,192,197,199,200],vectorevalmonitor:[98,199],veloc:178,veri:[27,117,120,130,155,163,165,181,188],verif:[151,159],verifi:[108,140,151,159,188],versa:[178,192],version:[43,75,107,125,126,141,151,155,173,177,179,185,188,189,191,194,199],vert:181,vetor:135,via:[172,174,175,176,177,179,186,187,189,190,193],vice:[178,192],victor:172,video:[138,149,200],viedo:135,view:[46,108,152,165,166,173,180,186,193],viewpoint:199,viniciu:186,virtual:195,visit:[117,135,183,188,190,191],visual:[69,115,136,149,183,193],viz:69,viz_featur:69,vlad:181,vmpo:191,vol:173,volodymir:181,volodymyr:[171,172,179],volum:[82,161],volumemount:161,volumn:75,vpn:[173,182,194],vs:[25,41,63,66,141],vscode:[168,169],vtrace:[6,60,150,151,181,202],vtrace_advantag:181,vtrace_data:66,vtrace_error:[60,181],vtrace_item:181,vtrace_loss:181,vtrace_nstep_return:181,vtrace_return:181,w:[37,75,175,179,187,199],w_:175,w_entropi:181,w_t:58,w_valu:181,wa:[157,165,173,175,179,180,184,185,187,188,190,193],wai:[4,62,75,89,107,120,124,133,135,146,147,154,155,162,165,181,188,191,197,200],wait:[8,11,19,20,23,92,138,143,144,147,153,154,157],wait_for_clos:11,wait_for_open:11,wait_num:[143,144],wait_tim:93,walker2d:141,wan:186,wang:[172,176],want:[40,43,45,46,62,68,84,95,107,108,115,120,123,124,125,128,132,133,142,149,154,165,166,169,174,187,194,195,199,200],ward:181,warmup:199,warn:[118,161,194],warp:[4,120],warpfram:[5,120],warpper:200,was_real_don:4,wast:149,watchdog:[86,199],we:[4,40,41,43,45,46,58,59,62,75,82,94,95,107,114,115,117,118,121,123,124,125,126,127,128,130,131,132,133,134,136,138,144,149,151,154,155,157,160,161,162,163,165,166,167,169,172,173,175,178,181,184,187,188,189,190,191,192,197,199,200],weak:27,web:19,websit:195,weight1000:188,weight100:188,weight:[40,41,43,45,46,47,55,57,61,62,63,66,71,74,75,126,128,129,162,171,172,175,176,177,178,179,181,184,185,186,188,189,190,192],weight_decai:[73,178,192],weight_init:[6,70],weiner:58,welcom:[154,167],well:[19,25,26,115,117,129,140,163,165,167,169,173,178,188,190,191,197,199,200,201],were:[173,188,190],west:138,wether:176,what:[115,120,128,149,152,157,165,174,197,199],whatev:115,wheel:169,when:[0,2,4,17,19,20,23,26,27,29,34,40,41,42,43,45,46,47,48,59,63,66,75,79,82,84,85,89,90,92,101,102,107,115,117,121,124,127,129,131,132,133,134,135,136,140,147,149,151,152,153,155,156,157,159,163,165,167,169,171,174,175,176,177,178,179,181,184,185,186,187,188,189,190,192,193,197,199,200],whenev:[67,107],where:[0,2,33,34,37,38,45,55,57,58,59,61,62,63,66,75,82,91,117,121,128,133,135,144,163,165,171,172,174,175,176,178,179,180,181,183,185,186,187,188,189,190,192,197,199],wherea:[188,197],whether:[4,17,19,25,26,27,28,29,33,34,37,38,40,41,42,43,45,46,47,48,56,61,62,63,68,69,72,75,81,82,84,89,90,91,92,93,94,95,101,102,108,115,124,129,130,135,136,138,140,147,149,155,159,162,165,171,172,174,175,176,177,178,179,181,184,185,186,187,189,190,192,199,200],which:[0,4,12,17,19,25,26,27,38,40,41,43,45,46,47,48,49,50,52,53,54,56,58,59,61,63,66,67,68,75,78,79,81,82,91,93,95,96,105,107,108,115,117,120,121,124,125,126,127,128,129,131,133,134,135,136,138,144,147,149,151,154,155,157,159,160,161,162,163,165,166,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,197,199,202],whitelist:82,whiten:188,whiteson:[174,176,177,186],whl:[150,151],whl_name:[150,151],who:[174,199],whole:[45,90,121,127,133,160,163,172,181,184,194,195,199],whom:174,whose:[67,74,78,92,96,118,144,175,176,179,181],why:[96,134,152,197],wide:[17,166,179,200],width:[75,167],wierstra:[178,179],wildli:138,william:187,win:[26,27,141,155,169,199],win_rat:26,window:[123,168],windows10:195,winrat:155,wip:[168,169],wise:175,wiser:199,within:[135,163,165,174],without:[20,21,27,38,68,107,124,146,147,154,159,173,174,176,183,188,190,193,199],witt:[174,176,177,186],wojciech:186,wolski:185,won:[82,117],word:[25,27,58,96,105,107,181],work:[4,90,94,95,120,128,133,136,154,157,161,167,168,169,175,188,191,200,201],worker:[0,6,79,98,103,106,109,121,123,138,145,152,156,157,163,164,165,200,202],worker_id:104,worker_process:145,workflow:[157,200],workshop:173,workstat:154,world:[144,173,183,184,197],world_siz:[90,107],worth:155,would:[17,25,56,78,89,92,129,131,135,162,199],wouold:56,wrap:[4,17,67,69,75,82,90,93,107,115,120,124,126,147,162,165,166,200],wrape:[82,90],wrapped_cartpole_env:200,wrapped_env:120,wrapped_model:124,wrapped_overcookgam:138,wrapper:[4,41,67,82,90,93,107,122,126,135,136,148,149,151,152,156,162,166,190,192,194,200,202],wrapper_nam:[4,124,133,162,164,165,178,192,199],wrapper_name_map:[124,164,165],wrapper_registri:124,wrapper_typ:93,write:[88,125,132,152,169,190,199],writer:107,written:197,writtern:167,wrt:189,wsgi:161,wu:[176,177],x00:77,x00r:77,x01:77,x04:77,x04j:77,x05hello:77,x0:58,x14:77,x1e:77,x80:77,x86_64:195,x8c:77,x90:77,x94:77,x95:77,x99:77,x9ck:77,x:[4,8,28,29,33,34,35,37,53,58,65,69,75,76,77,93,115,129,133,135,156,158,159,171,175,178,179,181,183,184,185,187,188,189,192,193],x_0:172,x_1:133,x_2:133,x_3:133,x_4:133,x_5:133,x_6:133,x_:[133,172,181],x_k:172,x_t:[58,172,181],xa999:77,xac:77,xavier:75,xc9:77,xca:77,xf4:77,xf9:77,xi:187,xiaolong:176,xlab:[168,169],xu:176,xue:169,xx:132,xxpolici:123,xxx:[107,132,134,135],xxx_space:[148,149],xxxenv_xxxpolicy_main:82,xxxpolici:123,xxxx_config:132,y:[8,75,158,159,174,176,178,186,187,188,189,192],y_1for:192,y_2:192,y_:[186,192],y_t:191,yaml:[0,161,202],yang:174,ye:[25,27,159],year:[133,173],yei:15,yet:[20,56,112,147,153,154],yi:[176,177,186],yield:186,yoshua:187,yotam:181,you:[8,17,19,23,40,43,45,46,58,62,75,84,92,96,105,107,108,115,117,118,119,121,123,124,125,126,127,129,130,132,133,134,135,136,138,140,142,147,149,151,153,154,157,159,161,162,165,166,167,169,172,174,186,194,195,199,200],your:[115,120,122,123,124,125,129,132,136,138,149,154,161,165,169,188,194,195,199,200],your_ckpt_path:200,your_polici:133,your_replay_save_dir_path:200,your_rnn_model:133,your_wrapper_nam:[124,164,165],yourself:[132,149,169],yourwrapp:124,yuandong:176,yung:186,yuval:178,z:[172,175,177,186],z_:175,z_i:[175,187],z_j:175,zambaldi:186,zation:189,zerg:27,zergling_collector:202,zero:[63,75,78,91,133,138,173,179,181,188,189,190],zero_grad:[127,178,188,189,192],zeros_lik:[127,172,181],zhang:[174,176],zhihu:75,zhuanlan:75,zhuoran:174,zip:[172,188,190],ziyu:172,zlib:77,zlib_data_compressor:86,zlib_data_decompressor:86,zongq:174,zoo:[141,194],zoom:135,zsh:195},titles:["config.config","Config","envs.env","envs.env_manager","envs.env_wrappers","Env","API Doc","interaction.base.app","interaction.base.common","interaction.base","interaction.base.network","interaction.base.threading","interaction.exception.base","interaction.exception","interaction.exception.master","interaction.exception.slave","Interaction","interaction.master.connection","interaction.master","interaction.master.master","interaction.master.task","interaction.slave.action","interaction.slave","interaction.slave.slave","League","league.league","league.payoff","league.player","common.encoder","common.head","Common","common.utils","Model","template.QAC","template.VAC","template.coma","Template","template.q_learning","template.qmix","A2C","CollaQ","COMA","DDPG","DQN","Policy","PPG","QMIX","R2D2","Rainbow","Base Model","Gail","Reward Model","Pdeil","Pwil","Red","rl_utils.a2c","rl_utils.adder","rl_utils.coma","rl_utils.exploration","rl_utils.gae","RL Utils","rl_utils.isw","rl_utils.ppo","rl_tuils.td","rl_tuils.upgo","rl_tuils.value_rescale","rl_tuils.vtrace","checkpoint_helper","data_helper","distribution","Torch Utils","metric","nn_test_helper","optimizer_helper","loss.cross_entropy_loss","network.activation","utils.collection_helper","utils.compression_helper","data.collate_fn","data.dataloader","utils.data","cache","utils.default_helper","utils.design_helper","utils.file_helper","utils.import_helper","Utils","utils.k8s_helper","utils.lock_helper","utils.log_helper","utils.pytorch_ddp_dist_helper","utils.segment_tree","utils.system_helper","utils.time_helper","worker.collector.base_serial_collector","worker.collector.base_serial_evaluator","worker.collector.comm","worker.collector.episode_serial_collector","Collector","worker.collector.sample_serial_collector","worker.coordinator.comm_coordinator","worker.coordinator.commander","worker.coordinator.coordinator","Coordinator","worker.coordinator.resource_manager","worker.learner.comm","Learner","worker.learner","worker.replay_buffer","Buffer","Architecture Design","Interaction Framework","Interaction Model","Interaction Processes","Advantages","Loader Calculation Process","Loader Framework","Imitation Learning","Inverse RL","Customization 1: Dynamic Update Step","How to Customize an Env Wrapper","How to use Episode Replay Buffer?","Best Practice","Learner log","How to Customize Model Wrapper","How to use multiple buffers?","Multi-Discrete Example","How to Use Multi-GPUs to Train Your Model","N-step TD","How to Use PER(Prioritized Experience Replay)","How to randomly collect some data sample at the beginning?","Random seed","Registry","How to use RNN","How to understand training generated folders?","Atari","Bsuite","RL Environments Tutorial","Overcooked","FAQ","FAQ","Algorithm Overview","Autolog Overview","Collector Overview","Collector Overview","DataLoader Overview","Env Manager Overview","Env Manager Overview","Env Overview","Env Overview","HPC_RL Overview","DI-hpc Overview","Feature","Interaction Overview","Interaction Overview","League Overview","Learner Overview","Learner Overview","Loader Overview","Loader Overview","Model Overview","DI-orchestrator Overview","Policy Overview","Replay Buffer Overview","Wrapper & Hook Overview","Wrapper & Hook Overview","Code Comment","Documentation Contribution Guide","Git \u534f\u4f5c\u6307\u5357","Git Collaboration Guide","Developer Guide","A2C","ACER","AlphaGo","ATOC","C51","CollaQ","COMA","DDPG","DQN","GAIL","IMPALA","Hands on RL","MCTS","PPG","PPO","QMIX","Rainbow","RND","SAC","SQIL","SQN","TD3","VPN","Welcome to DI-engine\u2019s documentation!","Installation","Basic Concepts","Basic Concepts","Introduction to RL","Key Concept","Quick Start","Tensorboard and Logging demo","Tutorial-Developer"],titleterms:{"1":[119,123,125,161],"2":[123,125,161],"3":[123,161],"4":161,"5":161,"6":161,"\u4ee5\u53ca\u4f55\u6545\u4f5c\u6b64\u8bbe\u8ba1":153,"\u4ef7\u503c\u51fd\u6570":196,"\u4f18\u5316":196,"\u4f55\u4e3a\u975e\u963b\u585e\u5355\u7ebf\u7a0b\u4efb\u52a1":153,"\u5173\u4e8e\u4f7f\u7528\u65f6\u51fa\u73b0\u7684warn":139,"\u5176\u4ed6":150,"\u52a8\u4f5c\u7a7a\u95f4":196,"\u534f\u4f5c\u6307\u5357":168,"\u534f\u4f5c\u6d41\u7a0b":168,"\u57fa\u4e8e\u6a21\u578b":196,"\u5956\u52b1":196,"\u5982\u4f55\u4f7f\u7528":150,"\u5982\u4f55\u6b63\u786e\u5c06master\u548cslave\u6574\u5408\u8fdb\u73b0\u6709\u4e1a\u52a1\u670d\u52a1\u4e2d":153,"\u5982\u4f55\u8bbe\u7f6esyncsubprocessenvmanager\u7684\u76f8\u5173\u8fd0\u884c\u53c2\u6570":139,"\u5b89\u88c5\u4e4b\u540e\u65e0\u6cd5\u4f7f\u7528di":139,"\u5b89\u88c5\u65f6\u51fa\u73b0":139,"\u5e38\u89c1\u95ee\u9898":[153,158],"\u5e94\u8be5\u5982\u4f55\u5904\u7406":153,"\u6027\u80fd\u5bf9\u6bd4":150,"\u611f\u89c9loader\u6709\u4e9b\u65f6\u5019\u5199\u8d77\u6765\u592a\u957f\u4e86":158,"\u629b\u51fa\u5f02\u5e38":153,"\u6709\u6ca1\u6709\u66f4\u597d\u7684\u89e3\u51b3\u65b9\u6848":158,"\u6982\u8ff0":[150,153,158],"\u6ca1\u6709\u6743\u9650":139,"\u6d4b\u901f\u5b9e\u9a8c":[143,145],"\u6f14\u5458":196,"\u72b6\u6001\u7a7a\u95f4":196,"\u76ee\u524d\u652f\u6301\u7684\u7b97\u5b50":150,"\u76f8\u5173\u9519\u8bef":139,"\u793a\u4f8b":158,"\u7b56\u7565":196,"\u7b56\u7565\u68af\u5ea6":196,"\u800c\u4e14\u90fd\u662f\u91cd\u590d\u7684":158,"\u8bc4\u8bba\u5bb6":196,"\u8f68\u8ff9":196,"\u9a6c\u5c14\u53ef\u592b\u51b3\u7b56\u8fc7\u7a0b":196,"do":154,"engine\u547d\u4ee4\u884c\u5de5\u5177":139,"function":[78,115,124,196,197,199],"git\u89c4\u8303":168,"import":140,"interaction\u6a21\u5757\u9002\u5408\u4f7f\u7528\u7684\u95ee\u9898\u6709\u54ea\u4e9b":153,"loader\u548cnorm\u7684\u533a\u522b\u548c\u5173\u7cfb\u662f\u4ec0\u4e48":158,"long":159,"master\u548cslave\u5728\u53d1\u9001\u7f51\u7edc\u8bf7\u6c42\u65f6\u51fa\u73b0\u9519\u8bef":153,"master\u7aef":153,"public":[178,189,191,192],"return":[196,197],"slave\u7aef":153,A:[154,196,197],And:123,In:123,Is:159,No:140,On:199,The:[120,188,199],To:120,_iresponseinform:12,_islaveconnect:17,a2c:[39,55,171],a2c_error:55,a2cpolici:39,about:136,access:165,acer:172,action:[21,135,136,138,196,197],activ:75,activeplay:27,actor:[178,192,196,197],adam:73,adder:56,advanc:123,advancedreplaybuff:[108,163],advantag:114,after:[135,140],aggreg:200,algorithm:[135,138,141],all:159,allreduc:90,alphago:173,alphagozero:173,an:[120,154],analysi:157,api:6,app:7,ar:154,architectur:110,arrang:133,assign:161,async:79,asyncdataload:79,asyncsubprocessenvmanag:3,atari:[135,141],atoc:174,attent:75,author:188,auto_checkpoint:67,autolog:142,base:[7,8,9,10,11,12,49,157,196,197],base_comm_collector:96,base_env:2,base_env_manag:[3,146,147],base_leagu:25,base_learn:107,base_parallel_command:101,base_reward_estim:49,base_serial_collector:94,base_serial_command:101,base_serial_evalu:95,basecommand:101,basecommcollector:96,basecommlearn:[105,157],baseenv:[2,148,149],baseenvmanag:[3,146,147],baseleagu:25,baselearn:107,basenois:58,baserewardmodel:49,baseserialcommand:101,baseserialevalu:95,basic:[123,196,197],battlerecorddict:26,battlesharedpayoff:26,befor:135,begin:130,benchmark:[135,138,141,188],besid:123,best:122,better:159,between:[135,151,159],bilinearupsampl:75,binary_encod:75,block:154,broadcast:90,bsuit:136,buffer:[108,109,121,125,163,199,201],build:133,build_activ:75,build_ce_criterion:74,build_checkpoint_help:67,build_learner_hook_by_cfg:107,build_log_buff:68,build_logg:89,build_norm:75,build_time_help:93,burn:133,busi:154,c51:175,c51dqn:37,cach:81,cachepool:94,calcul:[115,188],cannot:140,categoricalpd:69,categoricalpdpytorch:69,channelshuffl:75,check:[135,138,161,195],checkpoint:200,checkpoint_help:67,checkpointhelp:67,cli:[139,140],cliprewardenv:4,code:[135,136,138,166,171,173,175,179,180,183,184,185,188,190,193,202],collabor:169,collaq:[38,40,176],collaqmultiheadattent:38,collaqpolici:40,collaqsmacattentionmodul:38,collat:78,collate_fn:78,collect:[115,130],collect_state_action_pair:53,collection_help:76,collector:[94,95,96,97,98,99,143,144,199,201],collectorslav:96,coma:[35,41,57,177],coma_error:57,comaactornetwork:35,comacriticnetwork:35,comapolici:41,comm:[96,105],comm_coordin:100,command:[101,140],commcoordin:100,comment:166,common:[8,28,29,30,31,115],comparison:151,compile_config:0,compile_config_parallel:0,compon:133,compression_help:77,comput:199,compute_importance_weight:61,concept:[196,197,199],config:[0,1,125,130,161,199,200],configur:[136,161],connect:17,connectionrefus:21,contribut:167,control:163,controllablecontext:8,controllableservic:8,conv1d_block:75,conv2d_block:75,convencod:28,coordin:[100,101,102,103,104],correctli:154,countvar:67,cpu:161,create_buff:108,create_comm_collector:96,create_comm_learn:105,create_env_manag:3,create_leagu:25,create_learn:107,create_model:31,create_noise_gener:58,create_parallel_command:101,create_payoff:26,create_play:27,create_reward_model:49,create_serial_collector:94,critic:[178,192,196,197],cross_entropy_loss:74,cudafetch:68,current:151,custom:[119,120,124,199],data:[78,79,80,130,133,163,199,202],data_help:68,datadistributedparallel:127,dataload:[79,145],dataparallel:127,dblevent:11,ddp:127,ddpg:[42,178],ddpgpolici:42,decis:197,deconv2d_block:75,deep_merge_dict:82,deep_upd:82,default_col:78,default_decol:78,default_func:8,default_get:82,default_help:82,defin:[161,200],delet:161,demo:[117,201],demostr:199,descript:136,design:[110,123,154],design_help:83,detail:188,develop:[123,130,170,194,195,202],di:[123,130,133,135,136,138,140,151,155,161,164,165,194,202],dicts_to_list:82,diff_shape_col:78,differ:[135,138,159],differnec:63,dijob:161,ding:[146,147],disconnectionrefus:21,discret:126,discretehead:29,dist:199,dist_fin:90,dist_init:90,dist_mod:90,dist_nstep_td_error:63,distribut:69,distributionhead:29,distributiontimeimag:89,doc:6,document:[167,194],doe:123,doubl:187,dp:127,dqn:[37,43,179,199],dqnpolici:43,drl:199,drqn:37,duel:187,duelinghead:29,dummy_compressor:77,dummy_decompressor:77,dure:140,dynam:119,e:123,easytim:93,encod:28,engin:[123,130,133,135,140,155,164,165,194,202],entri:199,env:[2,3,4,5,120,130,135,146,147,148,149],env_manag:[3,146,147],env_wrapp:4,envel:[148,149],envelementrunn:[148,149],environ:[135,136,137,138,161,199,200],episod:121,episode_serial_collector:97,episodecollector:97,episodereplaybuff:[108,163],episodiclifeenv:4,epsilon:200,equat:[171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,188,189,190,191,192,193],equival:114,error:[140,154],error_wrapp:82,errro_wrapp:90,estim:172,evalu:[135,199,200,201],exampl:[118,120,124,126,133,135,138,159,161],except:[12,13,14,15],execut:200,exist:154,experi:[129,143,145,187],experiment:161,explor:58,extens:[171,173,174,175,176,177,178,179,180,183,184,185,186,187,189,191,192,193],fact:[135,136,138,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193],faq:[139,140,159],fc_block:75,fcencod:28,featur:[152,194],feature1:163,feature2:163,feature3:163,feature4:163,feel:159,file_help:84,find_free_port:92,fireresetenv:4,flask_fs_collector:96,flaskfilesystemcollector:96,flaskfilesystemlearn:105,flatten_dict:82,flow:202,folder:134,form:114,format:[136,159],framestack:4,framework:[111,116],full:163,g:123,gae:59,gail:[50,118,180,199],gail_irl_model:50,gailrewardmodel:50,gaussiannois:58,gener:[120,134],generalized_lambda_return:63,get_buffer_cl:108,get_cuda_time_wrapp:93,get_data_compressor:77,get_data_decompressor:77,get_env_cl:2,get_env_manager_cl:3,get_epsilon_greedy_fn:58,get_group:90,get_ip:92,get_lstm:75,get_master_exception_by_error:14,get_master_exception_class_by_error_cod:14,get_operator_server_kwarg:87,get_pid:92,get_rank:90,get_rw_file_lock:88,get_serial_collector_cl:94,get_slave_exception_by_error:15,get_slave_exception_class_by_error_cod:15,get_task_uid:92,get_tensor_data:68,get_vec_env_set:2,get_world_s:90,git:[168,169],glu:75,gpu:[127,161],gradient:[172,196,197],graph:[171,173,174,175,176,177,178,179,180,181,183,184,185,186,188,189,190,191,192,193],greedi:200,guid:[167,169,170,194],guidanc:123,guidelin:[117,121,125,129,130],gym:136,hamming_dist:71,hand:182,head:29,her:199,hidden:133,histogram:123,historicalplay:27,hook:[107,164,165],hostpath:161,how:[120,121,123,124,125,127,129,130,133,134,136,140,151,154,199],hpc:151,hpc_rl:[150,151],i:154,ibuff:[108,163],imit:117,impala:[181,199],implement:[155,171,172,173,174,175,176,177,178,179,181,183,184,185,186,187,188,189,190,191,192,193],import_help:85,import_modul:85,info:[130,201],initi:[133,135,200],insert:161,instal:[135,136,138,140,195],instanti:200,integr:154,interact:[7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,111,112,113,153,154],interfac:162,intro:155,introduct:[133,145,198],invers:118,iqn:[37,175],irregular:123,is_differenti:72,is_typ:115,iserialcollector:94,issu:154,isw:61,iter_map:76,k8s_helper:87,kei:[135,136,138,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,188,189,190,191,192,193,199],labelsmoothceloss:74,layout:138,lazi:135,leagu:[24,25,26,27,155],leagueexploit:27,learn:[117,187],learner:[105,106,107,123,156,157,199,201],learner_comm:105,learner_hook:107,learnerhook:[107,157],levenshtein_dist:71,limitedspacecontain:82,line:140,list_split:82,lists_to_dict:82,load:200,loadckpthook:107,loader:[115,116,158,159],lock_help:88,lockcontext:88,log:[123,200,201],log_help:89,loggedmodel:[123,142],logger:163,loggerfactori:89,logreducehook:107,logshowhook:107,loss:74,lstm:75,lstmforwardwrapp:75,lz4_data_compressor:77,lz4_data_decompressor:77,main:194,mainexploit:27,mainplay:27,make:154,manag:[146,147],markov:197,master:[14,17,18,19,20,154],masterchannelinvalid:14,masterchannelnotgiven:14,mastererrorcod:14,mastermastertokeninvalid:14,mastermastertokennotgiven:14,masterresponseexcept:14,masterselftokeninvalid:14,masterselftokennotgiven:14,masterslavetokeninvalid:14,masterslavetokennotgiven:14,mastersuccess:14,mastersystemshuttingdown:14,mastertaskdatainvalid:14,math:115,matter:188,maxandskipenv:4,mct:183,mdp:[196,197],memori:161,merge_hook:107,meta:163,method:[135,138],metric:71,middlewar:161,mirror:135,mixer:38,mlp:75,mode:[127,134,157,162,199],model:[32,49,51,112,124,127,133,160,165,178,192,196,197,199,200],modifi:161,modul:[154,200],monitor:163,mujoco:141,multi:[126,127,187,199],multi_logits_loss:74,multihead:29,multilogitsloss:74,multipl:125,multistep_forward_view:63,n:128,naivecollector:96,naivecommand:101,naivereplaybuff:[108,163],naiveresourcemanag:104,naivespplay:27,nearestupsampl:75,need:120,net:187,network:[10,75,154,178,187,192],nn:200,nn_modul:75,nn_test_help:72,noise_block:75,noiselinearlay:75,noisi:187,non:154,noopresetenv:4,norm:[115,159],normal:75,observ:[135,136,138],obsnormenv:4,obstransposewrapp:4,occur:[140,154],off:199,onc:114,one_hot:75,one_vs_one_leagu:25,onevsoneleagu:25,openai:136,oper:[140,151],optim:[196,197],optimizer_help:73,orchestr:161,origin:[135,136],other:[123,129,135,136,138,151,178,189,191,192,200],ounois:58,overcook:138,overrid:82,overview:[135,138,141,142,143,144,145,146,147,148,149,150,151,153,154,155,156,157,158,159,160,161,162,163,164,165,171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,194,199],packag:140,parallel:[134,157,199],paramet:140,pattern:199,payoff:[26,155],pd:69,pdeil:52,pdeil_irl_model:52,pdeilrewardmodel:52,per:[129,187],perform:[150,151],periodicthruputmonitor:108,permiss:140,pipe:115,pipelin:[125,199,200],player:[27,155],polici:[44,133,162,172,192,196,197,199,200],ppg:[45,184],ppgpolici:45,ppo:[62,185,199],ppo_error:62,practic:122,prerequisit:195,pretty_print:89,principl:127,print:123,priorit:[129,163,187],problem:[196,197],procedur:129,process:[113,115,157,197,199],processg:169,profil:[143,144,145],propagatingthread:92,pseudo:[171,173,175,179,180,183,184,185,188,190,193],pseudocod:[172,178,189,191,192],pwil:53,pwil_irl_model:53,pwilrewardmodel:53,py:[146,147],pytorch:[150,151],pytorch_ddp_dist_help:90,pytorchlstm:75,q1:[139,140],q2:[139,140],q3:[139,140],q4:[139,140],q:[153,154,158,159,172,187,196,197],q_learn:37,q_nstep_td_error:63,q_nstep_td_error_with_rescal:63,qac:33,qmix:[38,46,186],qmixpolici:46,qrdqn:[37,175],qrdqnhead:29,qualiti:163,quantilehead:29,quick:[171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,189,190,191,192,193,200],r2d2:[47,133],r2d2polici:47,r2d3:199,rainbow:[48,187],rainbowdqn:37,rainbowdqnpolici:48,rainbowhead:29,ramwrapp:4,random:[131,135],random_token:8,randomli:130,rbc:199,read_config:0,read_config_yaml:0,read_fil:84,read_from_ceph:84,read_from_fil:84,read_from_mc:84,read_from_path:84,read_from_redi:84,read_from_redisclust:84,reason:120,record:123,red:54,red_irl_model:54,redrewardmodel:54,refer:[171,172,173,174,175,176,177,178,179,180,181,183,184,185,186,187,188,190,192,193],register_learner_hook:107,registri:132,regressionhead:29,regular:192,relat:133,relationship:159,releas:195,relev:140,remove_fil:84,reparameterizationhead:29,repetit:159,replai:[108,121,129,135,163,187],replay_buff:108,request:154,res_block:75,resblock:75,resfcblock:75,resourc:161,resource_manag:104,responseexcept:12,result:188,retrac:172,reward:[51,135,136,138,188,196,197],rewardmodel:199,rewardnormenv:4,rl:[60,118,135,137,138,182,196,197,198],rl_tuil:[63,64,65,66],rl_util:[55,56,57,58,59,61,62],rmsprop:73,rnd:[188,199],rndnetwork:188,rndrewardmodel:188,rnn:[75,133],run:200,runnabl:136,runningmeanstd:4,s:[188,194],sac:[189,199],same_shap:68,sampl:[130,163],sample_serial_collector:99,samplecollector:99,sampleddataattrmonitor:108,save:[135,200],save_config:0,save_config_pi:0,save_config_yaml:0,save_fil:84,save_file_ceph:84,save_file_redi:84,save_file_redisclust:84,saveckpthook:107,scalar:123,scale:199,scaledfloatfram:4,scatter_connect:75,scatterconnect:75,seed:[131,135],segment_tre:91,segmenttre:91,send:154,sequential_pack:75,serial:[134,199],servic:154,set:[140,161,200],set_pkg_se:82,share:199,shared_payoff:26,shmbuffer:3,shmbuffercontain:3,should:154,simplifi:[164,165],singl:154,singletonmetaclass:83,slave:[15,21,22,23,154],slavechannelinvalid:15,slavechannelnotfound:15,slaveconnect:17,slaveconnectionproxi:17,slaveerrorcod:15,slavemastertokeninvalid:15,slavemastertokennotfound:15,slaveresponseexcept:15,slaveselftokeninvalid:15,slaveselftokennotfound:15,slaveslavealreadyconnect:15,slaveslaveconnectionrefus:15,slaveslavedisconnectionrefus:15,slaveslavenotconnect:15,slavesuccess:15,slavesystemshuttingdown:15,slavetaskalreadyexist:15,slavetaskrefus:15,smac:141,smooth:192,soft_argmax:75,softargmax:75,softfocalloss:74,solo_parallel_command:101,solocommand:101,some:130,sometim:159,space:[135,136,138,196,197],speed:144,sqil:[190,199],sqn:191,squeez:82,stabl:195,standard:169,start:200,state:[133,196,197],statist:123,statu:161,step:[119,128,187],storag:161,structencod:28,structur:202,submit:161,subprocess_env_manag:[3,146,147],subprocessenvmanag:[146,147],suitabl:154,support:[114,115,151],syncsubprocessenvmanag:[3,140],system_help:92,target:[178,192],task:[20,154],taskfail:21,taskrefus:21,taskresulttyp:20,taskstat:102,taskstatu:20,td3:192,td:[63,128],td_lambda_error:63,templat:[33,34,35,36,37,38,166],tempor:63,tensor_to_list:68,tensorboard:201,tensorflow:188,thi:154,thread:[11,154],throughput:163,time:[142,200],time_help:93,timestep_col:78,timewrapp:93,timewrappertim:93,to_devic:68,to_dtyp:68,to_list:68,to_ndarrai:68,to_tensor:68,to_tensor_transit:94,to_typ:115,too:159,tool:140,torch:70,train:[127,134,135,157,178,188,192,199,200],trajbuff:94,trajectori:[196,197],transform:[75,114,135],transformerlay:75,translate_dict_func:8,trick:187,try_import_ceph:85,try_import_link:85,try_import_mc:85,try_import_redi:85,try_import_redisclust:85,turn:115,tutori:[137,202],type:123,understand:134,up:[199,200],updat:119,update_shap:4,upgo:64,upgo_loss:64,upgo_return:64,us:[121,125,127,129,133,136,140,151,154],usag:127,useddataremov:108,user:[130,194],util:[31,60,70,76,77,80,82,83,84,85,86,87,88,89,90,91,92,93,96,108,200],vac:34,valid:114,valu:[172,196,197],value_inv_transform:65,value_rescal:65,value_transform:65,variabl:[123,161],vectorevalmonitor:95,verifi:136,version:195,video:135,view:[123,130,161],visual:200,vpn:193,vtrace:66,vtrace_error:66,warn:140,warpfram:4,watchdog:93,we:120,weight_init:75,welcom:194,what:[154,159],when:154,why:154,worker:[94,95,96,97,99,100,101,102,104,105,107,108,161,199],wrap:133,wrapper:[120,124,133,164,165,199],write:[130,159],your:[127,133],zlib_data_compressor:77,zlib_data_decompressor:77,zoo:[135,136,138,202]}})
\ No newline at end of file