Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
apache
DolphinScheduler
提交
3dbfc146
DolphinScheduler
项目概览
apache
/
DolphinScheduler
上一次同步 1 年多
通知
707
Star
9572
Fork
3514
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
DolphinScheduler
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
3dbfc146
编写于
8月 22, 2022
作者:
W
WangJPLeo
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
Adjust the polling method of failed tasks.
上级
af8288d7
变更
1
隐藏空白更改
内联
并排
Showing
1 changed file
with
18 addition
and
16 deletion
+18
-16
dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/consumer/TaskDispatchFailedQueueConsumer.java
...rver/master/consumer/TaskDispatchFailedQueueConsumer.java
+18
-16
未找到文件。
dolphinscheduler-master/src/main/java/org/apache/dolphinscheduler/server/master/consumer/TaskDispatchFailedQueueConsumer.java
浏览文件 @
3dbfc146
...
...
@@ -23,7 +23,6 @@ import org.apache.dolphinscheduler.common.thread.Stopper;
import
org.apache.dolphinscheduler.common.thread.ThreadUtils
;
import
org.apache.dolphinscheduler.server.master.config.MasterConfig
;
import
org.apache.dolphinscheduler.server.master.metrics.TaskMetrics
;
import
org.apache.dolphinscheduler.service.exceptions.TaskPriorityQueueException
;
import
org.apache.dolphinscheduler.service.queue.TaskPriority
;
import
org.apache.dolphinscheduler.service.queue.TaskPriorityQueue
;
...
...
@@ -94,22 +93,16 @@ public class TaskDispatchFailedQueueConsumer extends BaseDaemonThread {
public
void
run
()
{
while
(
Stopper
.
isRunning
())
{
try
{
failedRetry
();
if
(
taskDispatchFailedQueueImpl
.
size
()
>
0
)
{
dispatchFailedBackToTaskPriorityQueue
(
masterConfig
.
getDispatchTaskNumber
());
}
}
catch
(
Exception
e
)
{
TaskMetrics
.
incTaskDispatchError
();
logger
.
error
(
"failed task retry error"
,
e
);
}
finally
{
ThreadUtils
.
sleep
(
Constants
.
SLEEP_TIME_MILLIS
);
}
}
}
public
void
failedRetry
()
throws
TaskPriorityQueueException
{
if
(
taskDispatchFailedQueueImpl
.
size
()
>
0
)
{
retryConsumerThreadPoolExecutor
.
submit
(()
->
dispatchFailedBackToTaskPriorityQueue
(
masterConfig
.
getDispatchTaskNumber
()));
}
}
/**
* put the failed dispatch task into the dispatch queue again
*/
...
...
@@ -120,21 +113,30 @@ public class TaskDispatchFailedQueueConsumer extends BaseDaemonThread {
if
(
Objects
.
isNull
(
dispatchFailedTaskPriority
))
{
continue
;
}
if
(
canRetry
(
dispatchFailedTaskPriority
))
{
dispatchFailedTaskPriority
.
setDispatchFailedRetryTimes
(
dispatchFailedTaskPriority
.
getDispatchFailedRetryTimes
()
+
1
);
taskPriorityQueueImpl
.
put
(
dispatchFailedTaskPriority
);
}
else
{
taskDispatchFailedQueueImpl
.
put
(
dispatchFailedTaskPriority
);
}
retryConsumerThreadPoolExecutor
.
submit
(()
->
dispatchFailedTask
(
dispatchFailedTaskPriority
));
}
catch
(
InterruptedException
exception
)
{
logger
.
error
(
"dispatch failed queue poll error"
,
exception
);
Thread
.
currentThread
().
interrupt
();
}
catch
(
Exception
e
)
{
logger
.
error
(
"dispatch failed back to task priority queue error"
,
e
);
}
finally
{
ThreadUtils
.
sleep
(
Constants
.
SLEEP_TIME_MILLIS
);
}
}
}
/**
* determine whether to retry and put into the dispatch queue when the conditions are met.
*/
private
void
dispatchFailedTask
(
TaskPriority
dispatchFailedTaskPriority
)
{
if
(
canRetry
(
dispatchFailedTaskPriority
))
{
dispatchFailedTaskPriority
.
setDispatchFailedRetryTimes
(
dispatchFailedTaskPriority
.
getDispatchFailedRetryTimes
()
+
1
);
taskPriorityQueueImpl
.
put
(
dispatchFailedTaskPriority
);
}
else
{
taskDispatchFailedQueueImpl
.
put
(
dispatchFailedTaskPriority
);
}
}
/**
* the time interval is adjusted according to the number of retries
*/
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录