1. 28 3月, 2020 1 次提交
    • Q
      1,add UT in pom 2,refactor TaskUpdateQueue (#2326) · 68cb81fd
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      
      * timing online  modify
      
      * when taskResponse is faster than taskAck to db,task state will error
      add async queue and new a thread reslove this problem
      
      * TaskExecutionContext set host
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * add UT in pom.xml
      
      * revert dolphinscheduler-daemon.sh
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * api start exclude org.apache.dolphinscheduler.server.*
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * 1,api start load server filter
      2,SHELL task exitStatusCode modify
      
      * java doc error modify
      
      * java doc error modify
      
      * remove todo
      
      * add UT in pom
      
      * 1,add UT in pom
      2,refactor TaskUpdateQueue
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      68cb81fd
  2. 05 3月, 2020 1 次提交
    • Q
      task prioriry refator (#2094) · 8aaee39a
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      8aaee39a