Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
Forever310
druid
提交
0c360c05
D
druid
项目概览
Forever310
/
druid
与 Fork 源项目一致
从无法访问的项目Fork
通知
3
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
D
druid
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
0c360c05
编写于
8月 12, 2013
作者:
F
fjy
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
better handling of exceptions during startup
上级
2f728f34
变更
1
隐藏空白更改
内联
并排
Showing
1 changed file
with
59 addition
and
27 deletion
+59
-27
server/src/main/java/com/metamx/druid/coordination/ZkCoordinator.java
...ain/java/com/metamx/druid/coordination/ZkCoordinator.java
+59
-27
未找到文件。
server/src/main/java/com/metamx/druid/coordination/ZkCoordinator.java
浏览文件 @
0c360c05
...
...
@@ -20,9 +20,12 @@
package
com.metamx.druid.coordination
;
import
com.fasterxml.jackson.databind.ObjectMapper
;
import
com.google.common.base.Function
;
import
com.google.common.base.Predicates
;
import
com.google.common.base.Throwables
;
import
com.google.common.collect.Lists
;
import
com.google.common.util.concurrent.ThreadFactoryBuilder
;
import
com.metamx.common.guava.FunctionalIterable
;
import
com.metamx.common.lifecycle.LifecycleStart
;
import
com.metamx.common.lifecycle.LifecycleStop
;
import
com.metamx.druid.client.DataSegment
;
...
...
@@ -36,6 +39,7 @@ import org.apache.curator.framework.recipes.cache.PathChildrenCacheEvent;
import
org.apache.curator.framework.recipes.cache.PathChildrenCacheListener
;
import
org.apache.curator.utils.ZKPaths
;
import
javax.annotation.Nullable
;
import
java.io.File
;
import
java.io.IOException
;
import
java.util.List
;
...
...
@@ -107,7 +111,13 @@ public class ZkCoordinator implements DataSegmentChangeHandler
curator
.
newNamespaceAwareEnsurePath
(
liveSegmentsLocation
).
ensure
(
curator
.
getZookeeperClient
());
if
(
config
.
isLoadFromSegmentCacheEnabled
())
{
loadCache
();
try
{
loadCache
();
}
catch
(
Exception
e
)
{
log
.
makeAlert
(
e
,
"Exception loading from cache"
)
.
emit
();
}
}
loadQueueCache
.
getListenable
().
addListener
(
...
...
@@ -254,7 +264,6 @@ public class ZkCoordinator implements DataSegmentChangeHandler
announcer
.
announceSegment
(
segment
);
}
catch
(
IOException
e
)
{
removeSegment
(
segment
);
throw
new
SegmentLoadingException
(
e
,
"Failed to announce segment[%s]"
,
segment
.
getIdentifier
());
}
...
...
@@ -269,38 +278,61 @@ public class ZkCoordinator implements DataSegmentChangeHandler
public
void
addSegments
(
Iterable
<
DataSegment
>
segments
)
{
try
{
for
(
DataSegment
segment
:
segments
)
{
log
.
info
(
"Loading segment %s"
,
segment
.
getIdentifier
());
try
{
serverManager
.
loadSegment
(
segment
);
}
catch
(
Exception
e
)
{
removeSegment
(
segment
);
throw
new
SegmentLoadingException
(
e
,
"Exception loading segment[%s]"
,
segment
.
getIdentifier
());
}
final
List
<
String
>
segmentFailures
=
Lists
.
newArrayList
();
Iterable
<
DataSegment
>
validSegments
=
FunctionalIterable
.
create
(
segments
)
.
transform
(
new
Function
<
DataSegment
,
DataSegment
>()
{
@Nullable
@Override
public
DataSegment
apply
(
@Nullable
DataSegment
segment
)
{
if
(
segment
==
null
)
{
return
null
;
}
log
.
info
(
"Loading segment %s"
,
segment
.
getIdentifier
());
try
{
serverManager
.
loadSegment
(
segment
);
}
catch
(
Exception
e
)
{
log
.
error
(
e
,
"Exception loading segment[%s]"
,
segment
.
getIdentifier
());
removeSegment
(
segment
);
segmentFailures
.
add
(
segment
.
getIdentifier
());
return
null
;
}
File
segmentInfoCacheFile
=
new
File
(
config
.
getSegmentInfoCacheDirectory
(),
segment
.
getIdentifier
());
if
(!
segmentInfoCacheFile
.
exists
())
{
try
{
jsonMapper
.
writeValue
(
segmentInfoCacheFile
,
segment
);
}
catch
(
IOException
e
)
{
log
.
error
(
e
,
"Failed to write to disk segment info cache file[%s]"
,
segmentInfoCacheFile
);
removeSegment
(
segment
);
segmentFailures
.
add
(
segment
.
getIdentifier
());
return
null
;
}
}
File
segmentInfoCacheFile
=
new
File
(
config
.
getSegmentInfoCacheDirectory
(),
segment
.
getIdentifier
());
if
(!
segmentInfoCacheFile
.
exists
())
{
try
{
jsonMapper
.
writeValue
(
segmentInfoCacheFile
,
segment
);
}
catch
(
IOException
e
)
{
removeSegment
(
segment
);
throw
new
SegmentLoadingException
(
e
,
"Failed to write to disk segment info cache file[%s]"
,
segmentInfoCacheFile
);
}
}
}
return
segment
;
}
}
)
.
filter
(
Predicates
.<
DataSegment
>
notNull
());
try
{
announcer
.
announceSegments
(
s
egments
);
announcer
.
announceSegments
(
validS
egments
);
}
catch
(
IOException
e
)
{
removeSegments
(
segments
);
throw
new
SegmentLoadingException
(
e
,
"Failed to announce segments[%s]"
,
segments
);
}
if
(!
segmentFailures
.
isEmpty
())
{
throw
new
SegmentLoadingException
(
"Error loading segments: %s"
,
segmentFailures
);
}
}
catch
(
SegmentLoadingException
e
)
{
log
.
makeAlert
(
e
,
"Failed to load segments for dataSource"
)
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录