- 04 6月, 2022 2 次提交
-
-
由 Wenjun Ruan 提交于
* Add dolphinscheduler-scheduler module
-
由 Wenjun Ruan 提交于
* Remove quartz at WorkerServer * move k8s and permission from dolphinscheduler-service to dolphinscheduler-api
-
- 31 5月, 2022 2 次提交
-
-
由 kezhenxu94 提交于
-
由 JinYong Li 提交于
* fix 9584 * master recall * fix ut * update logger * update delay queue * fix ut * remove sleep Co-authored-by: N进勇 <lijinyong@cai-inc.com> Co-authored-by: NJinyLeeChina <jiny.li@foxmail.com>
-
- 26 5月, 2022 1 次提交
-
-
由 lugela 提交于
* [Fix-10181] Fix the logic of judging that the tenant does not exist Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac * [Fix-10181] Fix the logic of judging that the tenant does not exist Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac * [Fix-10181] Fix the logic of judging that the tenant does not exist Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac * [Fix-10181] Fix the logic of judging that the tenant does not exist The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged. At present, considering that it is a distributed user, it should not be allowed to create users in linux Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac * [Fix-10181] Fix the logic of judging that the tenant does not exist Add test method The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged. At present, considering that it is a distributed user, it should not be allowed to create users in linux Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac * [Fix-10181] Fix the logic of judging that the tenant does not exist Add parameter description to configuration.md Add test method The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged. At present, considering that it is a distributed user, it should not be allowed to create users in linux Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac * [Fix-10181] Fix the logic of judging that the tenant does not exist Add parameter description to configuration.md Add test method The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged. At present, considering that it is a distributed user, it should not be allowed to create users in linux Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac * [Fix-10181] Fix the logic of judging that the tenant does not exist Add parameter description to configuration.md Add test method The configuration item adds 'tenant-distributed-user' in worker application.yaml to make it suitable for distributed users. If it is false, the original logic remains unchanged. At present, considering that it is a distributed user, it should not be allowed to create users in linux Use the linux command as id to get the user information that exists in /etc/passwd file and the cached sssd user. for example: id test 1. exist in /etc/passwd file or ldap : uid=1030(test) gid=1030(test) groups=1030(test) 2. no exist in /etc/passwd file and ldap: id: test: no such user Temporarily unable to test the system for windows and mac Co-authored-by: Nouyangl <ouyangl@tebon.com.cn>
-
- 25 5月, 2022 1 次提交
-
-
由 旺阳 提交于
-
- 24 5月, 2022 1 次提交
-
-
由 旺阳 提交于
-
- 06 5月, 2022 1 次提交
-
-
由 Paul Zhang 提交于
-
- 03 5月, 2022 1 次提交
-
-
由 LongJGun 提交于
-
- 25 4月, 2022 1 次提交
-
-
由 Jiajie Zhong 提交于
* [common] Make dolphinscheduler_env.sh work * Change dist tarball `dolphinscheduler_env.sh` location from `bin/` to `conf/`, which users could finish their change configuration operation in one single directory. and we only need to add `$DOLPHINSCHEDULER_HOME/conf` when we start our sever instead of adding both `$DOLPHINSCHEDULER_HOME/conf` and `$DOLPHINSCHEDULER_HOME/bin` * Change the `start.sh`'s path of `dolphinscheduler_env.sh` * Change the setting order of `dolphinscheduler_env.sh` * `bin/env/dolphinscheduler_env.sh` will overwrite the `<server>/conf/dolphinscheduler_env.sh` when start the server using `bin/dolphinsceduler_daemon.sh` or `bin/install.sh` * Change the related docs
-
- 24 4月, 2022 1 次提交
-
-
由 caishunfeng 提交于
-
- 22 4月, 2022 1 次提交
-
-
由 WangJPLeo 提交于
[Improvement-9609][Worker]The resource download method is selected according to the configurati… (#9636) * The resource download method is selected according to the configuration and the service startup verification is added. * common check CI fix * Startup check changed to running check * code smell * Coordinate resources to increase test coverage. * Split resource download method. * Unit Test Coverage Co-authored-by: NWangJPLeo <wangjipeng@whaleops.com>
-
- 20 4月, 2022 2 次提交
-
-
由 caishunfeng 提交于
* cancel application when kill task * add warn log * add cancel application
-
由 WangJPLeo 提交于
* Storage Management StorageOperate No Instance * Add StorageOperateManager unit test * Add license header * Fix issues in SonarCloud code analysis Co-authored-by: NWangJPLeo <wangjipeng@whaleops.com>
-
- 19 4月, 2022 1 次提交
-
-
由 caishunfeng 提交于
-
- 14 4月, 2022 1 次提交
-
-
由 caishunfeng 提交于
-
- 30 3月, 2022 2 次提交
-
-
由 caishunfeng 提交于
* rebase dev * change task state to dispatch if dispatch success * update task host when dispatch * add dispatch task event * test * check tenant after enable auto create * handle dispatch state Co-authored-by: Ncaishunfeng <534328519@qq.com>
-
由 worry 提交于
- add banner.txt - modify application.yaml This closes #9266
-
- 28 3月, 2022 1 次提交
-
-
由 caishunfeng 提交于
Co-authored-by: Ncaishunfeng <534328519@qq.com>
-
- 25 3月, 2022 1 次提交
-
-
由 nobolity 提交于
* feat(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.extend the type of storage 3.add the s3utils to manager resource 4.automatic inject the storage in addition to your config * fix(resource manager): update the dependency * fix(resource manager): extend s3 to the storage of ds fix the constant of hadooputils * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): merge the unitTest: 1.TenantServiceImpl 2.ResourceServiceImpl 3.UserServiceImpl * fix(resource manager): extend s3 to the storage of ds merge the resourceServiceTest * fix(resource manager): test cancel the test method createTenant verifyTenant * fix(resource manager): merge the code follow the check-result of sonar * fix(resource manager): extend s3 to the storage of ds fit the spell question * fix(resource manager): extend s3 to the storage of ds revert the common.properties * fix(resource manager): extend s3 to the storage of ds update the storageConfig with None * fix(resource manager): extend s3 to the storage of ds fix the judge of resourceType * fix(resource manager): extend s3 to the storage of ds undo the compile-mysql * fix(resource manager): extend s3 to the storage of ds delete hadoop aws * fix(resource manager): extend s3 to the storage of ds update the know-dependencies to delete aws 1.7.4 update the e2e file-manager common.properties * fix(resource manager): extend s3 to the storage of ds update the aws-region * fix(resource manager): extend s3 to the storage of ds fix the storageconfig init * fix(resource manager): update e2e docker-compose update e2e docker-compose * fix(resource manager): extend s3 to the storage of ds revent the e2e common.proprites print the resource type in propertyUtil * fix(resource manager): extend s3 to the storage of ds 1.println the properties * fix(resource manager): println the s3 info * fix(resource manager): extend s3 to the storage of ds delete the info and upgrade the s3 info to e2e * fix(resource manager): extend s3 to the storage of ds add the bucket init * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): extend s3 to the storage of ds upgrade the s3 endpoint * fix(resource manager): withPathStyleAccessEnabled(true) * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * fix(resource manager): upgrade the s3client builder * fix(resource manager): correct the s3 point to s3client * fix(resource manager): update the constant BUCKET_NAME * fix(resource manager): e2e s3 endpoint -> s3:9000 * fix(resource manager): extend s3 to the storage of ds 1.fix some spell question 2.delete the import * * style(resource manager): add info to createBucket * style(resource manager): debug the log * ci(resource manager): test test s3 * ci(ci): add INSERT INTO dolphinscheduler.t_ds_tenant (id, tenant_code, description, queue_id, create_time, update_time) VALUES(1, 'root', NULL, 1, NULL, NULL); to h2.sql * fix(resource manager): update the h2 sql * fix(resource manager): solve to delete the tenant * style(resource manager): merge the style end delete the unuse s3 config * fix(resource manager): extend s3 to the storage of ds UPDATE the rename resources when s3 * fix(resource manager): extend s3 to the storage of ds 1.fix the code style of QuartzImpl * fix(resource manager): extend s3 to the storage of ds 1.impoort restore_type to CommonUtils * fix(resource manager): update the work thread * fix(resource manager): update the baseTaskProcessor * fix(resource manager): upgrade dolphinscheduler-standalone-server.xml * fix(resource manager): add user Info to dolphinscheduler_h2.sql * fix(resource manager): merge the resourceType to NONE * style(upgrade the log level to info): * fix(resource manager): sysnc the h2.sql * fix(resource manager): update the merge the user tenant * fix(resource manager): merge the resourcesServiceImpl * fix(resource manager): when the storage is s3 ,that the directory can't be renamed * fix(resource manager): in s3 ,the directory cannot be renamed * fix(resource manager): delete the deleteRenameDirectory in E2E * fix(resource manager): check the style and recoverd the test * fix(resource manager): delete the log.print(LoginUser)
-
- 17 3月, 2022 1 次提交
-
-
由 gaojun2048 提交于
* only config dir need 700 * delete -R * all config dir change * yaml file in config dir change * config dir permission change
-
- 15 3月, 2022 1 次提交
-
-
由 Kerwin 提交于
[Feature-8579][Task] Task back-end plugin optimization, new plugins only need to modify the plugin's own module (#8584) * Task plug-in optimization, task-related classes are migrated to the task plugin module * remove tasktype enum class. * fix code style. * fix code style * fix code style * fix ProcessServiceTest.testUpdateResourceInfo test class * fix code style * fix test task plugin manager check parameters null * fix test ut * update aws license * change TaskTimeoutStrategy class
-
- 14 3月, 2022 4 次提交
-
-
由 wangyang 提交于
-
由 guoshupei 提交于
-
由 gaojun2048 提交于
-
由 gaojun2048 提交于
* fix log * get DOLPHINSCHEDULER_HOME * add DOLPHINSCHEDULER_WORKER_HOME to env
-
- 01 3月, 2022 1 次提交
-
-
由 ronyang1985 提交于
Co-authored-by: NWenjun Ruan <wenjun@apache.org> Co-authored-by: Ncaishunfeng <caishunfeng2021@gmail.com>
-
- 24 2月, 2022 2 次提交
-
-
由 caishunfeng 提交于
* date convert of timezone * remove @JsonFormat * add unit test * fix time preview in scheduler * optimization & add env config Co-authored-by: Ncaishunfeng <534328519@qq.com>
-
由 kezhenxu94 提交于
-
- 23 2月, 2022 1 次提交
-
-
由 caishunfeng 提交于
* kill all running task before worker stop * kill local process * remove kill yarn job * adjust the orders of close Co-authored-by: Ncaishunfeng <534328519@qq.com>
-
- 11 2月, 2022 1 次提交
-
-
由 yimaixinchen 提交于
-
- 07 2月, 2022 1 次提交
-
-
由 yimaixinchen 提交于
-
- 27 1月, 2022 1 次提交
-
-
由 _和 提交于
* add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA * fix Constants bug * remove the unused class * add unit test * fix code style error * add unit test * refactor data quality common entity * fix code style error * add unit test * close e2e test * fix code smell bug * modify dataquality enum value to 14 in TaskType * add data qualtiy task * update * add getDatasourceOptions interface * fix checkstyle * close e2e test * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * add unit test and alter dataquality task result * fix checkstyle * fix process service test error * add unit test and fix code smells * fix checkstyle error * fix unit test error * fix checkstyle error * change execute sql type name * revert ui pom.xml * fix data quality task error * fix checkstyle error * fix dq task src_connector_type ui select bug * fix spark rw postgresql bug * change mysql driver scope * fix form-create json bug * fix code smell * fix DolphinException Bug * fix ui validate rule and Alert title * fix target connection param bug * fix threshold validate change * add rule input entry index * change statistic_comparison_check logic * remove check type change * add DateExpressionReplaceUtil * fix null point expetion * fix null point expetion * fix test error * add more sql driver * fix test error and remove DateExprReplaceUtil * add get datasource tables and columns * add get datasource tables and columns * remove hive-jdbc in pom.xml * fix code smells * update sql * change the pom.xml * optimize multi_table_accuracy ui * fix v-show error * fix code smells * update sql * [Feature][DataQuality] Add data quality task ui (#5054) * add data quality task ui * update skywalking-eyes SHA * fix style * fix eslint error * fix eslint error * test e2e * fix dq task src_connector_type ui select bug * fix threshold validate change * remove check type change * add get datasource tables and columns * optimize multi_table_accuracy ui * fix v-show error * fix code smells Co-authored-by: Nsunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality module (#4830) * add data quality module * add license * add package configuration in dist pom * fix license and jar import bug * replace apache/skywalking-eyes@9bd5feb SHA * refacotr jbdc-connector and writer * modify parameter name in HiveConnector * fix checkstyle error * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix checkstyle error in dolphinschesuler-dist * fix duplicate code bug * fix code style bug * fix code smells * update * close e2e test * fix spark rw postgresql bug * change mysql driver scope * add more sql driver * remove hive-jdbc in pom.xml * change the pom.xml Co-authored-by: Nsunchaohe <sunzhaohe@linklogis.com> * [Feature][DataQuality] Add data quality task backend (#4883) * add dq relevant enums and parameter * replace apache/skywalking-eyes@9bd5feb SHA Co-authored-by: Nsunchaohe <sunzhaohe@linklogis.com> * refactor data_quality_module * add header license * data quality module refactor * fix unit test error * fix checkstyle error * fix unit test error * fix checkstyle error * fix unit test error * fix code smell * fix check style * fix unit test error * task statistics value add unique code * fix unit test error * fix checkstyle error * fix checkstyle * fix security hotspot * fix unit test error * fix security hotspot * fix check * add data quality task error handling * fix unit test error * add unit test * add unit test * optimize data quality result alert * fix unit test * fix sql script error * fix bug * update sql script * fix checkstyle * add license * fix checkstyle * fix checkstyle * fix unit test * add jacoco dependencies * fix unit test * fix unit test * add jacoco dependencies * add unit test * add unit test * add license * fix checkstyle * fix pom * fix checkstyle * fix checkstyle * merge dev * fix ui error * fix pom error * fix pom error * fix test error * fix test error * mssql-jdbc exclude azure-keyvault * fix test error * merge dev and add unit test * add notes * rollback the CollectionUtils * fix * update sql * fix * fix * fix query rule page error * change dq.jar path * fix sql error * fix ui error * fix(dq): jar path&task enum description * add notes on DataQualityApplication * fix dq result jump error * fix(ui): page condition * feat(ui): add show error output path * change version * remove all chinese word in sql * merge Co-authored-by: Nsunchaohe <sunzhaohe@linklogis.com>
-
- 26 1月, 2022 1 次提交
-
-
由 wind 提交于
Co-authored-by: Ncaishunfeng <534328519@qq.com>
-
- 25 1月, 2022 1 次提交
-
-
由 Wenjun Ruan 提交于
* Add Netty processor in Spring container
-
- 14 1月, 2022 1 次提交
-
-
由 yimaixinchen 提交于
* fix ResponseCache name error
-
- 07 1月, 2022 1 次提交
-
-
由 wind 提交于
* task logger * update * log format * remove master config task-logger * udpate log level Co-authored-by: Ncaishunfeng <534328519@qq.com>
-
- 06 1月, 2022 1 次提交
-
-
由 springmonster 提交于
[Bug-7832, Improvement] Add unit test for worker module, fix apache#7832. Optimize HttpUtils and HttpUtilsTest 1. Checking input parameters of getResponseContentString 2. Add unit test (#7798)
-
- 30 12月, 2021 1 次提交
-
-
由 aaronlinv 提交于
-
- 29 12月, 2021 1 次提交
-
-
由 wind 提交于
* [DS-7686][Server]fix restart server after kill force * update registry logic Co-authored-by: Ncaishunfeng <534328519@qq.com>
-