1. 21 7月, 2020 1 次提交
    • W
      Optimize number of max processes used for computing and limit number of thread... · 0877c6f7
      wenkai 提交于
      Optimize number of max processes used for computing and limit number of thread running load_data_in_thread()
      
      For max processes used for computing, we need to make sure every summary directory has a process to load data. We also should not use too many processes to avoid system problems (eg. out of memory). So we calc the max processes cnt in _calc_default_max_processes_cnt
      
      For _load_data_in_thread_wrapper, because self._load_data_in_thread() will create process pool when loading files, we can not afford to run multiple self._load_data_in_thread() simultaneously. So we use a lock to make sure that only one self._load_data_in_thread() is running.
      0877c6f7
  2. 20 7月, 2020 4 次提交
  3. 18 7月, 2020 4 次提交
  4. 17 7月, 2020 9 次提交
  5. 16 7月, 2020 8 次提交
  6. 15 7月, 2020 3 次提交
  7. 14 7月, 2020 5 次提交
  8. 13 7月, 2020 2 次提交
  9. 10 7月, 2020 4 次提交