1. 04 1月, 2018 2 次提交
  2. 03 1月, 2018 2 次提交
  3. 02 1月, 2018 3 次提交
  4. 01 1月, 2018 2 次提交
  5. 30 12月, 2017 1 次提交
  6. 29 12月, 2017 3 次提交
  7. 27 12月, 2017 1 次提交
  8. 26 12月, 2017 1 次提交
  9. 22 12月, 2017 2 次提交
  10. 21 12月, 2017 4 次提交
  11. 19 12月, 2017 3 次提交
  12. 18 12月, 2017 5 次提交
  13. 16 12月, 2017 1 次提交
  14. 15 12月, 2017 1 次提交
  15. 14 12月, 2017 9 次提交
    • T
      [FLINK-7928] Move Resource out of ResourceSpec · 76e3156d
      Till Rohrmann 提交于
      76e3156d
    • S
      [FLINK-7928] [runtime] extend the resources in ResourceProfile for precisely... · 5643d156
      shuai.xus 提交于
      [FLINK-7928] [runtime] extend the resources in ResourceProfile for precisely calculating the resource of task manager
      
      Summary:
      ResourceProfile denotes the resource requirements of a task. It should contains:
      1. The resource for the operators: the resources in ResourceSpec (please refer to jira-7878)
      2. The resource for the task to communicate with its upstreams.
      3. The resource for the task to communicate with its downstreams.
      Now the ResourceProfile only contains the first part. Adding the last two parts.
      
      Test Plan: UnitTests
      
      Reviewers: haitao.w
      
      Differential Revision: https://aone.alibaba-inc.com/code/D330364
      
      This closes #4991.
      5643d156
    • T
      [FLINK-7878] Hide GpuResource in ResourceSpec · fba72d07
      Till Rohrmann 提交于
      fba72d07
    • S
      [FLINK-7878] [api] make resource type extendible in ResourceSpec · 5b9ac950
      shuai.xus 提交于
      Summary:
      Now, flink only support user define CPU and MEM,
      but some user need to specify the GPU, FPGA and so on resources.
      So it need to make the resouce type extendible in the ResourceSpec.
      Add a extend field for new resources.
      
      Test Plan: UnitTest
      
      Reviewers: haitao.w
      
      Differential Revision: https://aone.alibaba-inc.com/code/D327427
      
      make Resource abstract and add GPUResource FPGAResource
      
      This closes #4911.
      
      Add a resource spec builder and remove FPGAResource
      5b9ac950
    • T
    • T
      [FLINK-7956] [flip6] Add support for queued scheduling with slot sharing to SlotPool · 0ef7fdde
      Till Rohrmann 提交于
      This commit adds support for queued scheduling with slot sharing to the
      SlotPool. The idea of slot sharing is that multiple tasks can run in the
      same slot. Moreover, queued scheduling means that a slot request must not
      be completed right away but at a later point in time. This allows to
      start new TaskExecutors in case that there are no more slots left.
      
      The main component responsible for the management of shared slots is the
      SlotSharingManager. The SlotSharingManager maintains internally a tree-like
      structure which stores the SlotContext future of the underlying
      AllocatedSlot. Whenever this future is completed potentially pending
      LogicalSlot instantiations are executed and sent to the slot requester.
      
      A shared slot is represented by a MultiTaskSlot which can harbour multiple
      TaskSlots. A TaskSlot can either be a MultiTaskSlot or a SingleTaskSlot.
      
      In order to represent co-location constraints, we first obtain a root
      MultiTaskSlot and then allocate a nested MultiTaskSlot in which the
      co-located tasks are allocated. The corresponding SlotRequestID is assigned
      to the CoLocationConstraint in order to make the TaskSlot retrievable for
      other tasks assigned to the same CoLocationConstraint.
      
      Port SchedulerSlotSharingTest, SchedulerIsolatedTasksTest and
      ScheduleWithCoLocationHintTest to run with SlotPool.
      
      Restructure SlotPool components.
      
      Add SlotSharingManagerTest, SlotPoolSlotSharingTest and
      SlotPoolCoLocationTest.
      
      This closes #5091.
      0ef7fdde
    • T
      [hotfix] Speed up RecoveryITCase · 331ce82c
      Till Rohrmann 提交于
      331ce82c
    • T
      [FLINK-8089] Also check for other pending slot requests in offerSlot · 401d0065
      Till Rohrmann 提交于
      Not only check for a slot request with the right allocation id but also check
      whether we can fulfill other pending slot requests with an unclaimed offered
      slot before adding it to the list of available slots.
      
      This closes #5090.
      401d0065
    • T
      [FLINK-8088] Associate logical slots with the slot request id · bc1c375a
      Till Rohrmann 提交于
      Before logical slots like the SimpleSlot and SharedSlot where associated to the
      actually allocated slot via the AllocationID. This, however, was sub-optimal because
      allocated slots can be re-used to fulfill also other slot requests (logical slots).
      Therefore, we should bind the logical slots to the right id with the right lifecycle
      which is the slot request id.
      
      This closes #5089.
      bc1c375a