1. 03 4月, 2020 2 次提交
  2. 01 4月, 2020 5 次提交
  3. 31 3月, 2020 12 次提交
    • R
      fix:mail send fail #2345 (#2346) · f60edc8e
      Rubik-W 提交于
      Co-authored-by: Ndailidong <dailidong66@gmail.com>
      f60edc8e
    • B
      Remove invalid code (#2342) · 4db2ac23
      BoYiZhang 提交于
      Co-authored-by: Nzhanglong <zhanglong@ysstech.com>
      Co-authored-by: Ndailidong <dailidong66@gmail.com>
      4db2ac23
    • Q
      startup conflict reslove · 70d63601
      qiaozhanwei 提交于
      70d63601
    • D
      remove zookeeper as task queue config (#2344) · c9620ab5
      dailidong 提交于
      * update logback
      
      * update log
      
      * refactor worker registry (#2107)
      
      * Refactor worker (#2115)
      
      * refactor worker registry
      
      * refactor master server
      
      * Modify workgroupid parameter name (#2105)
      
      * Delete worker group management page
      
      * Modify workgroupid parameter name
      
      * Refactor worker (#2121)
      
      * refactor worker registry
      
      * refactor master server
      
      * refactor MasterSchedulerService
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126)
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      
      * not exist in openjdk,just delete
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * fix cpu 100% bug
      
      * simplify master、 worker、alert、dao properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * Optimize code , reduce cost time from 60ms to 0.5ms
      
      * merge code form remote
      
      * remove zookeeper as task queue relevant config
      
      * correct config error and remove unuse properties that may affect performance
      
      * correct config error and remove unuse properties that may affect performance
      
      * remove zookeeper as task queue config
      
      * remove zookeeper as task queue config
      Co-authored-by: NTboy <guo.jiwei@immomo.com>
      Co-authored-by: Nbreak60 <790061044@qq.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@outlook.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      c9620ab5
    • D
      [Refactor worker] correct config error and remove unuse properties that may... · fce6af0c
      dailidong 提交于
      [Refactor worker] correct config error and remove unuse properties that may affect performance  (#2343)
      
      * update logback
      
      * update log
      
      * refactor worker registry (#2107)
      
      * Refactor worker (#2115)
      
      * refactor worker registry
      
      * refactor master server
      
      * Modify workgroupid parameter name (#2105)
      
      * Delete worker group management page
      
      * Modify workgroupid parameter name
      
      * Refactor worker (#2121)
      
      * refactor worker registry
      
      * refactor master server
      
      * refactor MasterSchedulerService
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126)
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      
      * not exist in openjdk,just delete
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * fix cpu 100% bug
      
      * simplify master、 worker、alert、dao properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * Optimize code , reduce cost time from 60ms to 0.5ms
      
      * merge code form remote
      
      * remove zookeeper as task queue relevant config
      
      * correct config error and remove unuse properties that may affect performance
      
      * correct config error and remove unuse properties that may affect performance
      
      * remove zookeeper as task queue config
      Co-authored-by: NTboy <guo.jiwei@immomo.com>
      Co-authored-by: Nbreak60 <790061044@qq.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@outlook.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      fce6af0c
    • Q
      test · 7cd1f915
      qiaozhanwei 提交于
      7cd1f915
    • Q
    • Q
      test · 152c8141
      qiaozhanwei 提交于
      152c8141
    • G
      Adapting partial code(file name start with O) to the sonar cloud rule (#2259) · 718e4b15
      gabry.wu 提交于
      * Adapting partial code(file name start with O) to the sonar cloud rule
      
      * resolve conflict with dev branch
      Co-authored-by: Ndailidong <dailidong66@gmail.com>
      718e4b15
    • B
      Supplemental licenses and repair resources cannot be renamed (#2340) · 2b174353
      break60 提交于
      * Change DOM label
      
      * Change name to lowercase
      
      * Limit customization file content to no more than 3000 lines
      
      * dd branch flow node verification
      
      * datax
      
      * datax add custom
      
      * Change normalize.scss import method and animation.scss license modification
      
      * Resource tree code merge
      
      * Modify ans-ui version and timing management style
      
      * Supplemental licenses and repair resources cannot be renamed
      2b174353
    • B
      Modify ans-ui version and timing management style (#2339) · 2114c8d9
      break60 提交于
      * Change DOM label
      
      * Change name to lowercase
      
      * Limit customization file content to no more than 3000 lines
      
      * dd branch flow node verification
      
      * datax
      
      * datax add custom
      
      * Change normalize.scss import method and animation.scss license modification
      
      * Resource tree code merge
      
      * Modify ans-ui version and timing management style
      2114c8d9
    • D
      Delete ReleaseNotes.md (#2338) · b5ff3ad3
      dailidong 提交于
      b5ff3ad3
  4. 30 3月, 2020 6 次提交
    • D
      [Refactor worker] correct config error and remove unuse properties that may... · 07cc10c3
      dailidong 提交于
      [Refactor worker] correct config error and remove unuse properties that may affect performance (#2337)
      
      * update logback
      
      * update log
      
      * refactor worker registry (#2107)
      
      * Refactor worker (#2115)
      
      * refactor worker registry
      
      * refactor master server
      
      * Modify workgroupid parameter name (#2105)
      
      * Delete worker group management page
      
      * Modify workgroupid parameter name
      
      * Refactor worker (#2121)
      
      * refactor worker registry
      
      * refactor master server
      
      * refactor MasterSchedulerService
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126)
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      
      * not exist in openjdk,just delete
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * fix cpu 100% bug
      
      * simplify master、 worker、alert、dao properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * Optimize code , reduce cost time from 60ms to 0.5ms
      
      * merge code form remote
      
      * remove zookeeper as task queue relevant config
      
      * correct config error and remove unuse properties that may affect performance
      
      * correct config error and remove unuse properties that may affect performance
      Co-authored-by: NTboy <guo.jiwei@immomo.com>
      Co-authored-by: Nbreak60 <790061044@qq.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@outlook.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      07cc10c3
    • R
      fix #2334 (#2335) · 4440b35c
      Rubik-W 提交于
      Co-authored-by: Ndailidong <dailidong66@gmail.com>
      4440b35c
    • S
      some annotation optimizations (#2333) · f7e89e45
      songgg 提交于
      Co-authored-by: Nsongqh <songquanhe@foxmail.com>
      f7e89e45
    • Q
      test · c2cf8fb7
      qiaozhanwei 提交于
      c2cf8fb7
    • D
      remove zookeeper as task queue relevant config (#2330) · 195dfb50
      dailidong 提交于
      * update logback
      
      * update log
      
      * refactor worker registry (#2107)
      
      * Refactor worker (#2115)
      
      * refactor worker registry
      
      * refactor master server
      
      * Modify workgroupid parameter name (#2105)
      
      * Delete worker group management page
      
      * Modify workgroupid parameter name
      
      * Refactor worker (#2121)
      
      * refactor worker registry
      
      * refactor master server
      
      * refactor MasterSchedulerService
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126)
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      
      * not exist in openjdk,just delete
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * fix cpu 100% bug
      
      * simplify master、 worker、alert、dao properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * Optimize code , reduce cost time from 60ms to 0.5ms
      
      * merge code form remote
      
      * remove zookeeper as task queue relevant config
      Co-authored-by: NTboy <guo.jiwei@immomo.com>
      Co-authored-by: Nbreak60 <790061044@qq.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@outlook.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      195dfb50
    • T
      Refactor worker (#2331) · 3bafa97f
      Tboy 提交于
      * let quartz use the same datasource
      
      * move master/worker config from dao.properties to each config
      add master/worker registry test
      
      * move mybatis config from application.properties to SpringConnectionFactory
      
      * move mybatis-plus config from application.properties to SpringConnectionFactory
      
      * refactor TaskCallbackService
      
      * add ZookeeperNodeManagerTest
      
      * add NettyExecutorManagerTest
      
      * refactor TaskKillProcessor
      
      * add RandomSelectorTest, RoundRobinSelectorTest, TaskCallbackServiceTest
      
      * add RoundRobinHostManagerTest, ExecutorDispatcherTest
      
      * refactor task response service
      
      * add TaskResponseServiceTest
      
      * modify close method for MasterSchedulerService
      3bafa97f
  5. 28 3月, 2020 10 次提交
    • L
      Connection mode of adding Sid to Oracle (#2254) · 526e5c91
      liwenhe1993 提交于
      * Connection mode of adding Sid to Oracle
      
      * Remove code
      
      * Add asf
      
      * Add unit test
      
      * Add unit test
      
      * Add unit test
      
      * solve the conflict
      526e5c91
    • Q
      1,add UT in pom 2,refactor TaskUpdateQueue (#2326) · 68cb81fd
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      
      * timing online  modify
      
      * when taskResponse is faster than taskAck to db,task state will error
      add async queue and new a thread reslove this problem
      
      * TaskExecutionContext set host
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * add UT in pom.xml
      
      * revert dolphinscheduler-daemon.sh
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * api start exclude org.apache.dolphinscheduler.server.*
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * 1,api start load server filter
      2,SHELL task exitStatusCode modify
      
      * java doc error modify
      
      * java doc error modify
      
      * remove todo
      
      * add UT in pom
      
      * 1,add UT in pom
      2,refactor TaskUpdateQueue
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      68cb81fd
    • L
      Remove .helmignore file (#2328) · 6cf7e6c1
      liwenhe1993 提交于
      6cf7e6c1
    • L
      Support kubernetes deployment (#2153) · f6ca5480
      liwenhe1993 提交于
      * Support kubernetes deployment
      
      * Support kubernetes deployment
      f6ca5480
    • T
      Fix SqlTask kerberos load scope unreasonable. #2178 (#2321) · d4735334
      t1mon 提交于
      * Optimize PropertyUtils instantiation.
      
      * Fix info error.
      
      * Fix SqlTask kerberos load scope unreasonable. #2178
      d4735334
    • R
      fix:Optimize content returned by interface (#2294) · a851168a
      Rubik-W 提交于
      a851168a
    • L
      new feature for #404 add resource tree function (#2323) · 38c965dd
      lgcareer 提交于
      * add create resource directory
      
      * add create resource directory
      
      * update the resource test
      
      * add upgrade sql in version 1.2.2
      
      * Adding request parameter id to update queryResourceListPaging
      
      * set isDirectory value is false default
      
      * add full name to update updateResource
      
      * remove request parameter isDirectory to update createResource method
      
      * update queryResourceListPaging with change get to post
      
      * update updateResource method with remove fullName
      
      * File management list modification (#1976)
      
      * add resource component
      
      * add resource tree visitor
      
      * return json string
      
      * update queryResourceList
      
      * upload file need fullName
      
      * add method rootNode
      
      * Shell task resources and authorization resources (#1989)
      
      * File management list modification
      
      * Shell task resources and authorization resources
      
      * download resource when execute task
      
      * download resource when execute task
      
      * update authorization type
      
      * download resource when execute task
      
      * Spark task resource changes (#1990)
      
      * File management list modification
      
      * Shell task resources and authorization resources
      
      * Spark task resource changes
      
      * download resource when execute task
      
      * update udf function service
      
      * add resource type in ResourceComponent
      
      * UDF resource tree and change DAG style (#2019)
      
      * File management list modification
      
      * Shell task resources and authorization resources
      
      * Spark task resource changes
      
      * UDF resource tree and change DAG style
      
      * add deleteIds method in ResourceMapper and ResourceMapperTest
      
      * Add comments on class and method
      
      * add queryResourceByName method in controller
      
      * update verify-name with change name to full name
      
      * update queryResource with add parameter pid
      
      * update queryResource with add parameter pid
      
      * add resource ids in process definition and delete resource need judge whether it is used by any process definition
      
      * Breadcrumb development (#2033)
      
      * File management list modification
      
      * Shell task resources and authorization resources
      
      * Spark task resource changes
      
      * UDF resource tree and change DAG style
      
      * Breadcrumb development
      
      * Breadcrumb development
      
      * Resource tree bug fix (#2040)
      
      * File management list modification
      
      * Shell task resources and authorization resources
      
      * Spark task resource changes
      
      * UDF resource tree and change DAG style
      
      * Breadcrumb development
      
      * Breadcrumb development
      
      * Resource tree bug fix
      
      * update resource service test
      
      * Fix github action rerun failed
      
      * add status of PARENT_RESOURCE_NOT_EXIST
      
      * Fix github action rerun failed (#2067)
      
      * update resource service test
      
      * Fix github action rerun failed
      
      * add status of PARENT_RESOURCE_NOT_EXIST
      
      * Change crumb position
      
      * Change crumb position (#2068)
      
      * build resource process definition map
      
      * UDF changed to multiple choice
      
      * UDF changed to multiple choice (#2077)
      
      * Change crumb position
      
      * UDF changed to multiple choice
      
      * build resource process definition map (#2076)
      
      * update resource service test
      
      * Fix github action rerun failed
      
      * add status of PARENT_RESOURCE_NOT_EXIST
      
      * build resource process definition map
      
      * update resource name also need update all the children full name
      
      * need add queryResource
      
      * update resource name also need update all the children full name (#2096)
      
      * update resource service test
      
      * Fix github action rerun failed
      
      * add status of PARENT_RESOURCE_NOT_EXIST
      
      * build resource process definition map
      
      * update resource name also need update all the children full name
      
      * need add queryResource
      
      * Limit customization file content to no more than 3000 lines
      
      * Limit customization file content to no more than 3000 lines(#2128)
      
      * Limit customization file content to no more than 3000 lines(#2128) (#2140)
      
      * Change crumb position
      
      * UDF changed to multiple choice
      
      * Limit customization file content to no more than 3000 lines
      
      * Limit customization file content to no more than 3000 lines(#2128)
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * add queryResourceJarList (#2192)
      
      * update resource service test
      
      * Fix github action rerun failed
      
      * add status of PARENT_RESOURCE_NOT_EXIST
      
      * build resource process definition map
      
      * update resource name also need update all the children full name
      
      * need add queryResource
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * Modify the main jar package
      
      * Modify the main jar package (#2200)
      
      * Change crumb position
      
      * UDF changed to multiple choice
      
      * Limit customization file content to no more than 3000 lines
      
      * Limit customization file content to no more than 3000 lines(#2128)
      
      * Modify the main jar package
      
      * add resource filter in order to get filtered resource
      
      * add comments of resource filter
      
      * update list children by resource
      
      * choose main jar with resource tree (#2220)
      
      * update resource service test
      
      * Fix github action rerun failed
      
      * add status of PARENT_RESOURCE_NOT_EXIST
      
      * build resource process definition map
      
      * update resource name also need update all the children full name
      
      * need add queryResource
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * add resource filter in order to get filtered resource
      
      * add comments of resource filter
      
      * update list children by resource
      
      * Return null if query resource list is empty
      
      * update queryResource method change parameter pid to id
      
      * getResouDelete checksum and modify parameter namerceId
      
      * revert .env
      
      * remove parameter pid
      
      * Delete request interface
      
      * go back to the last page
      
      * jar interface call
      
      * Fix issue #2234 and #2228
      
      * change resource name with full name
      
      * Fix issue #2234 and #2228 (#2246)
      
      * update resource service test
      
      * Fix github action rerun failed
      
      * add status of PARENT_RESOURCE_NOT_EXIST
      
      * build resource process definition map
      
      * update resource name also need update all the children full name
      
      * need add queryResource
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * add queryResourceJarList
      
      * add resource filter in order to get filtered resource
      
      * add comments of resource filter
      
      * update list children by resource
      
      * Return null if query resource list is empty
      
      * update queryResource method change parameter pid to id
      
      * revert .env
      
      * remove parameter pid
      
      * Fix issue #2234 and #2228
      
      * change resource name with full name
      
      * Fix list query value error
      
      * remove unauth-file with authorize-resource-tree
      
      * Repair data cannot be echoed
      
      * Repair data cannot be echoed
      
      * execute mr and spark task need query resource name before
      
      * Authorized resource interface replacement
      
      * Authorized resource interface replacement
      
      * Filter UDF resources
      
      * Change parameters
      
      * need query all authorized directory children when create task
      
      * Change normalize.scss import method and animation.scss license modification
      
      * Delete file list update processing
      
      * It's fixed that resource not deleted in hdfs when delete it.
      
      * add tooltips
      
      * add tooltips (#2310)
      
      * Echo workflow name and modify udf management name
      
      * [new feature]add resource tree function
      
      * revert front code in order to be same as dev branch
      
      * revert front code in order to be same as dev branch
      
      * revert common.properties and application.properties
      
      * add super method
      
      * update flink parameter test
      
      * update flink parameter and unit test
      
      * update resource service test
      
      * If resource list is empty,need init it
      
      * update flink parameter test
      Co-authored-by: Nbreak60 <790061044@qq.com>
      Co-authored-by: Nxingchun-chen <55787491+xingchun-chen@users.noreply.github.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@outlook.com>
      38c965dd
    • G
    • L
      taskProps.getScheduleTime() may be null, but there is no check if it … (#2256) · c706b21c
      liwenhe1993 提交于
      * taskProps.getScheduleTime() may be null, but there is no check if it is null or not
      
      * Add unit test
      c706b21c
    • B
      Resource tree code merge (#2322) · c52c92e0
      break60 提交于
      * Change DOM label
      
      * Change name to lowercase
      
      * Limit customization file content to no more than 3000 lines
      
      * dd branch flow node verification
      
      * datax
      
      * datax add custom
      
      * Change normalize.scss import method and animation.scss license modification
      
      * Resource tree code merge
      c52c92e0
  6. 27 3月, 2020 4 次提交
    • T
      add TaskResponseServiceTest (#2325) · 23ba0351
      Tboy 提交于
      * let quartz use the same datasource
      
      * move master/worker config from dao.properties to each config
      add master/worker registry test
      
      * move mybatis config from application.properties to SpringConnectionFactory
      
      * move mybatis-plus config from application.properties to SpringConnectionFactory
      
      * refactor TaskCallbackService
      
      * add ZookeeperNodeManagerTest
      
      * add NettyExecutorManagerTest
      
      * refactor TaskKillProcessor
      
      * add RandomSelectorTest, RoundRobinSelectorTest, TaskCallbackServiceTest
      
      * add RoundRobinHostManagerTest, ExecutorDispatcherTest
      
      * refactor task response service
      
      * add TaskResponseServiceTest
      23ba0351
    • L
      af8efe51
    • D
      [Refactor worker] Optimize code , reduce cost time from 60ms to 0.5ms (#2318) · 7e9f45e5
      dailidong 提交于
      * update logback
      
      * update log
      
      * refactor worker registry (#2107)
      
      * Refactor worker (#2115)
      
      * refactor worker registry
      
      * refactor master server
      
      * Modify workgroupid parameter name (#2105)
      
      * Delete worker group management page
      
      * Modify workgroupid parameter name
      
      * Refactor worker (#2121)
      
      * refactor worker registry
      
      * refactor master server
      
      * refactor MasterSchedulerService
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath (#2126)
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      
      * not exist in openjdk,just delete
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * fix cpu 100% bug
      
      * simplify master、 worker、alert、dao properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * add master and worker properties
      
      * Optimize code , reduce cost time from 60ms to 0.5ms
      
      * merge code form remote
      Co-authored-by: NTboy <guo.jiwei@immomo.com>
      Co-authored-by: Nbreak60 <790061044@qq.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@outlook.com>
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      7e9f45e5
    • T
      Refactor worker (#2319) · 5730bfe2
      Tboy 提交于
      * let quartz use the same datasource
      
      * move master/worker config from dao.properties to each config
      add master/worker registry test
      
      * move mybatis config from application.properties to SpringConnectionFactory
      
      * move mybatis-plus config from application.properties to SpringConnectionFactory
      
      * refactor TaskCallbackService
      
      * add ZookeeperNodeManagerTest
      
      * add NettyExecutorManagerTest
      
      * refactor TaskKillProcessor
      
      * add RandomSelectorTest, RoundRobinSelectorTest, TaskCallbackServiceTest
      
      * add RoundRobinHostManagerTest, ExecutorDispatcherTest
      
      * refactor task response service
      5730bfe2
  7. 26 3月, 2020 1 次提交