Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
Forever310
druid
提交
30d98f56
D
druid
项目概览
Forever310
/
druid
与 Fork 源项目一致
从无法访问的项目Fork
通知
3
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
D
druid
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
30d98f56
编写于
7月 24, 2013
作者:
G
Gian Merlino
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
RealtimeIndexTask: Allow configurable rejection policies
上级
5c96d500
变更
3
隐藏空白更改
内联
并排
Showing
3 changed file
with
21 addition
and
2 deletion
+21
-2
indexing-service/src/main/java/com/metamx/druid/indexing/common/task/RealtimeIndexTask.java
.../metamx/druid/indexing/common/task/RealtimeIndexTask.java
+18
-1
indexing-service/src/test/java/com/metamx/druid/indexing/common/task/TaskSerdeTest.java
.../com/metamx/druid/indexing/common/task/TaskSerdeTest.java
+2
-1
indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TestRealtimeTask.java
...m/metamx/druid/indexing/coordinator/TestRealtimeTask.java
+1
-0
未找到文件。
indexing-service/src/main/java/com/metamx/druid/indexing/common/task/RealtimeIndexTask.java
浏览文件 @
30d98f56
...
...
@@ -52,8 +52,10 @@ import com.metamx.druid.realtime.Schema;
import
com.metamx.druid.realtime.SegmentPublisher
;
import
com.metamx.druid.realtime.firehose.Firehose
;
import
com.metamx.druid.realtime.firehose.FirehoseFactory
;
import
com.metamx.druid.realtime.plumber.NoopRejectionPolicyFactory
;
import
com.metamx.druid.realtime.plumber.Plumber
;
import
com.metamx.druid.realtime.plumber.RealtimePlumberSchool
;
import
com.metamx.druid.realtime.plumber.RejectionPolicyFactory
;
import
com.metamx.druid.realtime.plumber.Sink
;
import
com.metamx.druid.realtime.plumber.VersioningPolicy
;
import
com.metamx.emitter.EmittingLogger
;
...
...
@@ -91,6 +93,9 @@ public class RealtimeIndexTask extends AbstractTask
@JsonIgnore
private
final
IndexGranularity
segmentGranularity
;
@JsonIgnore
private
final
RejectionPolicyFactory
rejectionPolicyFactory
;
@JsonIgnore
private
volatile
Plumber
plumber
=
null
;
...
...
@@ -105,7 +110,8 @@ public class RealtimeIndexTask extends AbstractTask
@JsonProperty
(
"firehose"
)
FirehoseFactory
firehoseFactory
,
@JsonProperty
(
"fireDepartmentConfig"
)
FireDepartmentConfig
fireDepartmentConfig
,
@JsonProperty
(
"windowPeriod"
)
Period
windowPeriod
,
@JsonProperty
(
"segmentGranularity"
)
IndexGranularity
segmentGranularity
@JsonProperty
(
"segmentGranularity"
)
IndexGranularity
segmentGranularity
,
@JsonProperty
(
"rejectionPolicy"
)
RejectionPolicyFactory
rejectionPolicyFactory
)
{
super
(
...
...
@@ -128,6 +134,7 @@ public class RealtimeIndexTask extends AbstractTask
this
.
fireDepartmentConfig
=
fireDepartmentConfig
;
this
.
windowPeriod
=
windowPeriod
;
this
.
segmentGranularity
=
segmentGranularity
;
this
.
rejectionPolicyFactory
=
rejectionPolicyFactory
;
}
@Override
...
...
@@ -269,6 +276,10 @@ public class RealtimeIndexTask extends AbstractTask
realtimePlumberSchool
.
setServerView
(
toolbox
.
getNewSegmentServerView
());
realtimePlumberSchool
.
setServiceEmitter
(
toolbox
.
getEmitter
());
if
(
this
.
rejectionPolicyFactory
!=
null
)
{
realtimePlumberSchool
.
setRejectionPolicyFactory
(
new
NoopRejectionPolicyFactory
());
}
final
FireDepartment
fireDepartment
=
new
FireDepartment
(
schema
,
fireDepartmentConfig
,
null
,
null
);
final
RealtimeMetricsMonitor
metricsMonitor
=
new
RealtimeMetricsMonitor
(
ImmutableList
.
of
(
fireDepartment
));
this
.
queryRunnerFactoryConglomerate
=
toolbox
.
getQueryRunnerFactoryConglomerate
();
...
...
@@ -375,6 +386,12 @@ public class RealtimeIndexTask extends AbstractTask
return
segmentGranularity
;
}
@JsonProperty
(
"rejectionPolicy"
)
public
RejectionPolicyFactory
getRejectionPolicyFactory
()
{
return
rejectionPolicyFactory
;
}
public
static
class
TaskActionSegmentPublisher
implements
SegmentPublisher
{
final
Task
task
;
...
...
indexing-service/src/test/java/com/metamx/druid/indexing/common/task/TaskSerdeTest.java
浏览文件 @
30d98f56
...
...
@@ -207,7 +207,8 @@ public class TaskSerdeTest
null
,
null
,
new
Period
(
"PT10M"
),
IndexGranularity
.
HOUR
IndexGranularity
.
HOUR
,
null
);
final
ObjectMapper
jsonMapper
=
new
DefaultObjectMapper
();
...
...
indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TestRealtimeTask.java
浏览文件 @
30d98f56
...
...
@@ -52,6 +52,7 @@ public class TestRealtimeTask extends RealtimeIndexTask
null
,
null
,
null
,
null
,
null
);
this
.
status
=
status
;
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录