1. 09 6月, 2020 1 次提交
    • S
      1. specified jackson Date format. · 6e907f15
      simon824 提交于
      2. remove getMapper method,replace with toList()
      3. rewrite toList method,support constructCollectionType.
      4. parseObject(resp, Map.class) replace to toMap() method
      5. rename JacksonSerialize to JsonSerializer
      
      rewrite createArrayNode,createObjectNode method will Affect too many lines ,i will fix it in the next pr.
      6e907f15
  2. 06 6月, 2020 1 次提交
  3. 04 6月, 2020 1 次提交
    • S
      ut fix · 4a101575
      simon 提交于
      4a101575
  4. 14 5月, 2020 2 次提交
    • G
      add RetryerUtils to retry async & sync function gracefully (#2697) · c28a697e
      gabry.wu 提交于
      * add RetryerUtils tool class for async & sync retry invoking
      
      * add RetryerUtils tool class for async & sync retry invoking
      
      * add guava-retrying-2.0.0.jar to known-dependencies.txt
      
      * fix javadoc
      
      * fix code smell
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@outlook.com>
      c28a697e
    • X
      support ali nail(ding talk) , issue:2458 (#2594) · de3a81ca
      xiaozhaoying 提交于
      * Create TextMessage.java
      
      * Create DingTalkUtils.java
      
      * Update alert.properties
      
      * Update Constants.java
      
      * Update Constants.java
      
      * Create DingTalkMsgFormatter.java
      
      * Update alert.properties
      
      * Create DingTalkMsgFormatterTest.java
      
      * Create DingTalkUtilsTest.java
      
      * Update DingTalkUtils.java
      
      * Create DingTalkManager.java
      
      * Update EmailAlertPlugin.java
      
      * feature: test send msg with proxy
      
      * fix:delete comment and add exception info
      
      * Update DingTalkUtilsTest.java
      
      * Update DingTalkUtils.java
      
      * Update DingTalkManager.java
      
      * Update EmailAlertPlugin.java
      
      * Update DingTalkUtilsTest.java
      
      * Update DingTalkMsgFormatter.java
      
      * Update DingTalkUtils.java
      
      * Update DingTalkMsgFormatterTest.java
      
      * Update DingTalkUtilsTest.java
      
      * Update TextMessage.java
      
      * Update DingTalkManager.java
      
      * Delete TextMessage.java
      
      * fix: add test case
      
      * fix:add http client test case
      
      * fix:delete ignore test case
      
      * Update pom.xml
      Co-authored-by: Ndailidong <dailidong66@gmail.com>
      de3a81ca
  5. 02 5月, 2020 1 次提交
    • K
      Add a script to check the license (#2552) · 6e08b292
      kezhenxu94 提交于
      * Add a script to check the license
      
      ### Motivation
      
      Check licenses in the distribution package
      
      ### Modification
      
      1. Add a script to check licenses, and list known licenses.
      1. Remove unused dep license, lombok.
      1. Remove unnecessary ignored patterns in .gitignore.
      1. Add missing config items to apache-rat plugin, which just checked a small part of files before.
      1. Add check to GitHub Actions process
      
      ### Result
      
      1. Newly-added dependencies should be checked and confirmed.
      1. Closes #1578
      
      * Separate rat and dependency check
      
      * Tee dependencies to stdout
      
      * Add more debug messages
      
      * Check light-weight task first
      6e08b292
  6. 30 4月, 2020 2 次提交
  7. 28 4月, 2020 1 次提交
    • Q
      no valid worker group,master can kill task directly (#2541) · a12103b0
      qiaozhanwei 提交于
      * dispatch task fail will set task status failed
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,no worker condition , master will while ture wait for worker startup
      2,worker response task status sync wait for result
      
      * 1,task status statistics and process status statistics bug fix (#2357)
      2,worker group bug fix
      
      * 1,task status statistics and process status statistics bug fix (#2357)
      2,worker group bug fix
      
      * 1,task status statistics and process status statistics bug fix (#2357)
      2,worker group bug fix
      
      * 1,task status statistics and process status statistics bug fix (#2357)
      2,worker group bug fix
      
      * send mail error, #2466 bug fix
      
      * send mail error, #2466 bug fix
      
      * send mail error, #2466 bug fix
      
      * send mail error, #2466 bug fix
      
      * #2486 bug fix
      
      * host and workergroup compatible
      
      * EnterpriseWeChatUtils modify
      
      * EnterpriseWeChatUtils modify
      
      * EnterpriseWeChatUtils modify
      
      * #2499 bug fix
      
      * add comment
      
      * revert comment
      
      * revert comment
      
      * #2499 buf fix
      
      * #2499 bug fix
      
      * #2499 bug fix
      
      * #2499 bug fix
      
      * #2499 bug fix
      
      * #2499 bug fix
      
      * #2499 bug fix
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      
      * no valid worker group,master can kill task directly
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      a12103b0
  8. 24 4月, 2020 1 次提交
  9. 23 4月, 2020 1 次提交
  10. 21 4月, 2020 1 次提交
    • D
      simplify and optimize config (#2469) · eec92ed1
      dailidong 提交于
      * [Refactor worker] simplify and optimize config (#2386)
      
      * simplify config
      
      * simplify config
      
      * simplify and optimize config
      
      * Update HadoopUtils.java
      
      optimize HadoopUtils
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HttpUtils.java
      
      * Update pom.xml
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      eec92ed1
  11. 20 4月, 2020 4 次提交
  12. 18 4月, 2020 1 次提交
  13. 12 4月, 2020 1 次提交
  14. 10 4月, 2020 6 次提交
  15. 09 4月, 2020 6 次提交
  16. 07 4月, 2020 1 次提交
  17. 03 4月, 2020 2 次提交
  18. 28 3月, 2020 2 次提交
    • L
      Connection mode of adding Sid to Oracle (#2254) · 526e5c91
      liwenhe1993 提交于
      * Connection mode of adding Sid to Oracle
      
      * Remove code
      
      * Add asf
      
      * Add unit test
      
      * Add unit test
      
      * Add unit test
      
      * solve the conflict
      526e5c91
    • Q
      1,add UT in pom 2,refactor TaskUpdateQueue (#2326) · 68cb81fd
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      
      * timing online  modify
      
      * when taskResponse is faster than taskAck to db,task state will error
      add async queue and new a thread reslove this problem
      
      * TaskExecutionContext set host
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * add UT in pom.xml
      
      * revert dolphinscheduler-daemon.sh
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * api start exclude org.apache.dolphinscheduler.server.*
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * 1,api start load server filter
      2,SHELL task exitStatusCode modify
      
      * java doc error modify
      
      * java doc error modify
      
      * remove todo
      
      * add UT in pom
      
      * 1,add UT in pom
      2,refactor TaskUpdateQueue
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      68cb81fd
  19. 26 3月, 2020 1 次提交
    • T
      Refactor BaseDataSource and unified handling of JDBC resource releases. (#2184) · efde8fd4
      t1mon 提交于
      * Refactor BaseDataSource.isConnectable().
      
      * Add BaseDataSource test.
      
      * Unified handling of JDBC resource releases.
      
      * Fix sonar check error.
      
      * Remove useless logger.
      
      * Refactor BaseDataSource.getJdbcUrl().
      
      * Modify ConnectionUtils.releaseResource().
      
      * Add javadoc
      
      * Remove useless method.
      
      * Add BaseDataSourceTest UT
      efde8fd4
  20. 24 3月, 2020 1 次提交
    • Q
      TaskManager refactor (#2302) · f112415b
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      
      * timing online  modify
      
      * when taskResponse is faster than taskAck to db,task state will error
      add async queue and new a thread reslove this problem
      
      * TaskExecutionContext set host
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * add UT in pom.xml
      
      * revert dolphinscheduler-daemon.sh
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      f112415b
  21. 23 3月, 2020 1 次提交
    • Q
      UT Coverage rate test (#2276) · 052f9d10
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      052f9d10
  22. 21 3月, 2020 1 次提交
  23. 20 3月, 2020 1 次提交