1. 23 4月, 2020 1 次提交
  2. 21 4月, 2020 1 次提交
    • D
      simplify and optimize config (#2469) · eec92ed1
      dailidong 提交于
      * [Refactor worker] simplify and optimize config (#2386)
      
      * simplify config
      
      * simplify config
      
      * simplify and optimize config
      
      * Update HadoopUtils.java
      
      optimize HadoopUtils
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HttpUtils.java
      
      * Update pom.xml
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      
      * Update HadoopUtilsTest.java
      eec92ed1
  3. 20 4月, 2020 3 次提交
  4. 18 4月, 2020 1 次提交
  5. 12 4月, 2020 1 次提交
  6. 10 4月, 2020 6 次提交
  7. 09 4月, 2020 6 次提交
  8. 07 4月, 2020 1 次提交
  9. 03 4月, 2020 2 次提交
  10. 28 3月, 2020 2 次提交
    • L
      Connection mode of adding Sid to Oracle (#2254) · 526e5c91
      liwenhe1993 提交于
      * Connection mode of adding Sid to Oracle
      
      * Remove code
      
      * Add asf
      
      * Add unit test
      
      * Add unit test
      
      * Add unit test
      
      * solve the conflict
      526e5c91
    • Q
      1,add UT in pom 2,refactor TaskUpdateQueue (#2326) · 68cb81fd
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      
      * timing online  modify
      
      * when taskResponse is faster than taskAck to db,task state will error
      add async queue and new a thread reslove this problem
      
      * TaskExecutionContext set host
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * add UT in pom.xml
      
      * revert dolphinscheduler-daemon.sh
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * api start exclude org.apache.dolphinscheduler.server.*
      
      * ZookeeperRegister use common.properties zookeeperRoot path
      
      * 1,api start load server filter
      2,SHELL task exitStatusCode modify
      
      * java doc error modify
      
      * java doc error modify
      
      * remove todo
      
      * add UT in pom
      
      * 1,add UT in pom
      2,refactor TaskUpdateQueue
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      68cb81fd
  11. 26 3月, 2020 1 次提交
    • T
      Refactor BaseDataSource and unified handling of JDBC resource releases. (#2184) · efde8fd4
      t1mon 提交于
      * Refactor BaseDataSource.isConnectable().
      
      * Add BaseDataSource test.
      
      * Unified handling of JDBC resource releases.
      
      * Fix sonar check error.
      
      * Remove useless logger.
      
      * Refactor BaseDataSource.getJdbcUrl().
      
      * Modify ConnectionUtils.releaseResource().
      
      * Add javadoc
      
      * Remove useless method.
      
      * Add BaseDataSourceTest UT
      efde8fd4
  12. 24 3月, 2020 1 次提交
    • Q
      TaskManager refactor (#2302) · f112415b
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      
      * timing online  modify
      
      * when taskResponse is faster than taskAck to db,task state will error
      add async queue and new a thread reslove this problem
      
      * TaskExecutionContext set host
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * 1,TaskManager refactor
      2, api start load server dolphinschedule-daemon.sh modify
      
      * add UT in pom.xml
      
      * revert dolphinscheduler-daemon.sh
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      f112415b
  13. 23 3月, 2020 1 次提交
    • Q
      UT Coverage rate test (#2276) · 052f9d10
      qiaozhanwei 提交于
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * 1, master persistent task
      2. extract  master and worker communication model
      
      * add license
      
      * modify javadoc error
      
      * TaskExecutionContext create modify
      
      * buildAckCommand taskInstanceId not set modify
      
      * java doc error modify
      
      * add comment
      
      * ExecutorManager interface add generic type
      
      * add TaskInstanceCacheManager receive Worker report result
      
      * TaskInstance setExecutePath
      
      * add TaskInstanceCacheManager to receive Worker Task result report
      
      * TaskInstanceCacheManager add remove method
      
      * add license
      
      * add dispatcht task method
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * AbstractCommandExecutor remove db access
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * taskInstanceCache is null ,need load from db
      
      * 1,worker TaskPros use TaskExecutionContext replase
      2,Master kill Task , KillTaskProcessor modify
      
      * worker remove db
      
      * ShellTask modify
      
      * master persistence processId and appIds
      
      * master persistence processId and appIds
      
      * master add kill task logic
      
      * master add kill task logic
      
      * master add kill task logic
      
      * javadoc error modify
      
      * remove chinese log
      
      * executeDirectly method add Override
      
      * remote module modify
      
      * TaskKillResponseProcessor command type modify
      
      * create buildKillCommand
      
      * host add host:port format
      
      * host add host:port format
      
      * TaskAckProcessor modify
      
      * TaskAckProcessor modify
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * task prioriry refator
      
      * remove ITaskQueue
      
      * TaskPriority refactor
      
      * remove logs
      
      * WorkerServer refactor
      
      * MasterSchedulerService modify
      
      * WorkerConfig listen port modify
      
      * modify master and worker listen port
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * cancelTaskInstance set TaskExecutionContext host,logPath,executePath
      
      * Encapsulate the parameters required by sqltask
      
      * 1,Encapsulate the parameters required by sqltask
      2,SQLTask optimization
      
      * AbstractTask modify
      
      * ProcedureTask optimization
      
      * MasterSchedulerService modify
      
      * TaskUpdateQueueConsumer modify
      
      * test
      
      * DataxTask process run debug
      
      * DataxTask process run debug
      
      * add protobuf dependency,MR、Spark task etc need this
      
      * TaskUpdateQueueConsumer modify
      
      * TaskExecutionContextBuilder set TaskInstance workgroup
      
      * WorkerGroupService queryAllGroup modify
      query available work group
      
      * 1,get workergroup from zk modify
      2,SpringConnectionFactory repeat load modify
      
      * master and worker register ip  use OSUtils.getHost()
      
      * ProcessInstance host set ip:port format
      
      * worker fault tolerance modify
      
      * Constants and .env modify
      
      * master fault tolerant bug modify
      
      * UT add pom.xml
      Co-authored-by: Nqiaozhanwei <qiaozhanwei@analysys.com.cn>
      052f9d10
  14. 21 3月, 2020 1 次提交
  15. 20 3月, 2020 1 次提交
  16. 18 3月, 2020 1 次提交
    • T
      Refactor ConnectionFactory to static inner holder Singleton (#2204) · 3c5227ac
      tswstarplanet 提交于
      * refactor ConnectionFactory to static inner holder Singleton
      
      * remove redundant import
      
      * make getSqlSessionFactory() method private
      
      * fix sonar issue
      
      * remove @Ignore of MailUtilsTest
      
      * add MailUtilsTest to pom.xml to test
      
      * fix MailUtilsTest path error in pom.xml
      
      * modify test method name
      
      * add assert and logger to unit test
      
      * add log
      
      * add log
      
      * add AlertDaoTest
      
      * move AlertDaoTest to new module
      
      * modify test in pom.xml
      
      * remove unnecessary log
      3c5227ac
  17. 13 3月, 2020 1 次提交
    • G
      fix rpmbuild and DS Ambari plugin bug (#2144) · a0088c11
      gaojun2048 提交于
      * Update quick-start.md
      
      * 更新demo的地址
      
      * add rpm plugin
      
      * delete the git ignore files
      
      * 测试git ignore
      
      * 测试ignore
      
      * optimize the .gitignore file
      
      * add rpm package, delete unuse copy jar action in assembly
      
      * delete docs dir
      
      * add rpm plugin support
      
      * add rpm plugin support
      
      * add rpm plugin support
      
      * dolphinscheduler-common have not bin dir
      
      * dolphinscheduler-common have not bin dir
      
      * delete unuse config about assembly
      
      * add defineSatement
      
      * add rpm plugin support
      
      * add rpm plugin support
      
      * add rpm plugin support
      
      * add rpm support
      
      * update install dirname , make front and backend together
      
      * update rpm name
      
      * update rpm name
      
      * update rpm config
      
      * add jars excludes
      
      * add jars excludes
      
      * add rpm plugion
      
      * add rpm plugion
      
      * add rpm plugion
      
      * add auto create /opt/soft
      
      * The install dir can not be fixed to apache-dolphinscheduler-incubating-1.2.1 , its version is 1.2.2
      
      * install from rpm will create a link
      
      * the ui install thrown rpm only support jetty not nginx
      
      * the ui install thrown rpm only support jetty not nginx
      
      * sql目录里加上soft_version文件
      
      * env dir need in conf dir
      
      * remove no use module
      
      * add module
      
      * updaate
      
      * rpmbuild add dolphinscheduler-service module
      a0088c11
  18. 12 3月, 2020 1 次提交
    • T
      Fix javadoc and DataxTaskTest UT error (#2147) · 16eeaf50
      t1mon 提交于
      * Fix javadoc and DataxTaskTest UT error
      
      * Fix UT error
      * LoggerServiceTest UT error
      * WorkerGroupServiceTest UT error
      Modify Host.of()
      * Add address NPE check
      
      * Trigger actions rerun
      
      * Try to solve maven VM crash
      
      * Try to solve maven VM crash 1
      
      * Try to solve maven VM crash 2
      
      * Try to solve maven VM crash 3
      16eeaf50
  19. 10 3月, 2020 1 次提交
  20. 05 3月, 2020 3 次提交
  21. 28 2月, 2020 1 次提交
    • Y
      fix taskinstance.isSubprocess misjudgment (#2007) · 84409b57
      Yelli 提交于
      * add processInstanceService UT
      
      * fix taskInstance.isSubProcess
      add processInstanceService UT
      
      * add taskInstance.isSubProcess UT
      
      * modify taskInstance.isSubProcess UT
      
      * add license
      
      * remove author&date
      84409b57
  22. 26 2月, 2020 1 次提交
  23. 24 2月, 2020 1 次提交
    • _和's avatar
      #203 add sqoop task (#1974) · 3d6eee5d
      _和 提交于
      * add sqoop task
      
      * add sqoop task
      
      * add sqoop task test
      
      * add sqoop task test
      
      * add sqoop task test
      
      * modify add sqoop task test
      
      * modify sqoop task test
      
      * modify sqoop task test
      
      * modify sqoop task test
      
      * modify sqoop task test 2
      
      * modify sqoop task test 3
      
      * modify sqoop task test 3
      
      * modify sqoop task test 3
      
      * modify sqoop task test 4
      3d6eee5d
  24. 20 2月, 2020 1 次提交
    • Y
      #1310 add executor user to the process instance & task instance pages (#1973) · 619fb30c
      Yelli 提交于
      * add executor name in processDefinitionInstance & taskInstance
      
      * modify processInstanceTest
      
      * modify processInstanceTest
      
      * #1310 add executor user to the process instance & task instance pages
      
      * add processInstanceUT & taskInstanceUT
      
      * add processInstanceUT & taskInstanceUT
      
      * modify processInstanceTest & taskInstanceTest
      
      * Remove duplicate code
      
      * add userServiceUT
      619fb30c