Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
Forever310
druid
提交
2f728f34
D
druid
项目概览
Forever310
/
druid
与 Fork 源项目一致
从无法访问的项目Fork
通知
3
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
D
druid
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
2f728f34
编写于
8月 12, 2013
作者:
F
fjy
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
fix zk coord to not fail during startup exceptions
上级
68a3f1ab
变更
6
隐藏空白更改
内联
并排
Showing
6 changed file
with
75 addition
and
128 deletion
+75
-128
examples/config/broker/runtime.properties
examples/config/broker/runtime.properties
+6
-34
examples/config/compute/runtime.properties
examples/config/compute/runtime.properties
+16
-27
examples/config/master/runtime.properties
examples/config/master/runtime.properties
+15
-27
examples/config/realtime/runtime.properties
examples/config/realtime/runtime.properties
+20
-24
examples/config/runtime.properties
examples/config/runtime.properties
+0
-13
server/src/main/java/com/metamx/druid/coordination/ZkCoordinator.java
...ain/java/com/metamx/druid/coordination/ZkCoordinator.java
+18
-3
未找到文件。
examples/config/broker/runtime.properties
浏览文件 @
2f728f34
druid.host
=
127.0.0.1
druid.port
=
8083
druid.host
=
127.0.0.1:8080
druid.port
=
8080
druid.service
=
broker
com.metamx.emitter.logging
=
true
druid.processing.formatString
=
processing_%s
druid.processing.numThreads
=
1
druid.processing.buffer.sizeBytes
=
10000000
#emitting, opaque marker
druid.service
=
example
druid.request.logging.dir
=
/tmp/example/log
druid.realtime.specFile
=
realtime.spec
# logging
com.metamx.emitter.logging
=
true
com.metamx.emitter.logging.level
=
info
# below are dummy values when operating a realtime only node
com.metamx.aws.accessKey
=
dummy_access_key
com.metamx.aws.secretKey
=
dummy_secret_key
druid.pusher.s3.bucket
=
dummy_s3_bucket
# zk
druid.zk.service.host
=
localhost
druid.server.maxSize
=
300000000000
druid.zk.paths.base
=
/druid
druid.database.segmentTable
=
prod_segments
druid.database.user
=
druid
druid.database.password
=
diurd
druid.database.connectURI
=
jdbc:mysql://localhost:3306/druid
druid.zk.paths.discoveryPath
=
/druid/discoveryPath
druid.database.ruleTable
=
rules
druid.database.configTable
=
config
# Path on local FS for storage of segments; dir will be created if needed
druid.paths.indexCache
=
/tmp/druid/indexCache
# Path on local FS for storage of segment metadata; dir will be created if needed
druid.paths.segmentInfoCache
=
/tmp/druid/segmentInfoCache
druid.pusher.local.storageDirectory
=
/tmp/druid/localStorage
druid.pusher.local
=
true
# thread pool size for servicing queries
druid.client.http.connections
=
30
druid.host
=
127.0.0.1:8083
druid.client.http.connections
=
10
\ No newline at end of file
examples/config/compute/runtime.properties
浏览文件 @
2f728f34
druid.host
=
127.0.0.1
druid.port
=
8082
druid.host
=
127.0.0.1:8081
druid.port
=
8081
druid.service
=
compute
com.metamx.emitter.logging
=
true
druid.processing.formatString
=
processing_%s
druid.processing.numThreads
=
1
druid.processing.buffer.sizeBytes
=
10000000
#emitting, opaque marker
druid.service
=
example
druid.request.logging.dir
=
/tmp/example/log
druid.realtime.specFile
=
realtime.spec
# logging
com.metamx.emitter.logging
=
true
com.metamx.emitter.logging.level
=
info
# below are dummy values when operating a realtime only node
com.metamx.aws.accessKey
=
dummy_access_key
com.metamx.aws.secretKey
=
dummy_secret_key
druid.pusher.s3.bucket
=
dummy_s3_bucket
# zk
druid.zk.service.host
=
localhost
druid.server.maxSize
=
300000000000
druid.zk.paths.base
=
/druid
druid.database.segmentTable
=
prod_segments
druid.database.user
=
druid
druid.database.password
=
diurd
druid.database.connectURI
=
jdbc:mysql://localhost:3306/druid
druid.zk.paths.discoveryPath
=
/druid/discoveryPath
druid.database.ruleTable
=
rules
druid.database.configTable
=
config
# processing
druid.processing.buffer.sizeBytes
=
10000000
# aws (dummy user)
com.metamx.aws.accessKey
=
AKIAIMKECRUYKDQGR6YQ
com.metamx.aws.secretKey
=
QyyfVZ7llSiRg6Qcrql1eEUG7buFpAK6T6engr1b
# Path on local FS for storage of segments; dir will be created if needed
druid.paths.indexCache
=
/tmp/druid/indexCache
# Path on local FS for storage of segment metadata; dir will be created if needed
druid.paths.segmentInfoCache
=
/tmp/druid/segmentInfoCache
druid.pusher.local.storageDirectory
=
/tmp/druid/localStorage
druid.pusher.local
=
true
# server
druid.server.maxSize
=
100000000
\ No newline at end of file
examples/config/master/runtime.properties
浏览文件 @
2f728f34
druid.host
=
127.0.0.1
druid.port
=
8081
druid.host
=
127.0.0.1:8082
druid.port
=
8082
druid.service
=
master
com.metamx.emitter.logging
=
true
druid.processing.formatString
=
processing_%s
druid.processing.numThreads
=
1
druid.processing.buffer.sizeBytes
=
10000000
#emitting, opaque marker
druid.service
=
example
druid.request.logging.dir
=
/tmp/example/log
druid.realtime.specFile
=
realtime.spec
# logging
com.metamx.emitter.logging
=
true
com.metamx.emitter.logging.level
=
info
# below are dummy values when operating a realtime only node
com.metamx.aws.accessKey
=
dummy_access_key
com.metamx.aws.secretKey
=
dummy_secret_key
druid.pusher.s3.bucket
=
dummy_s3_bucket
# zk
druid.zk.service.host
=
localhost
druid.server.maxSize
=
300000000000
druid.zk.paths.base
=
/druid
druid.database.segmentTable
=
prod_segments
druid.zk.paths.discoveryPath
=
/druid/discoveryPath
# aws (dummy user)
com.metamx.aws.accessKey
=
AKIAIMKECRUYKDQGR6YQ
com.metamx.aws.secretKey
=
QyyfVZ7llSiRg6Qcrql1eEUG7buFpAK6T6engr1b
# db
druid.database.segmentTable
=
segments
druid.database.user
=
druid
druid.database.password
=
diurd
druid.database.connectURI
=
jdbc:mysql://localhost:3306/druid
druid.zk.paths.discoveryPath
=
/druid/discoveryPath
druid.database.ruleTable
=
rules
druid.database.configTable
=
config
# Path on local FS for storage of segments; dir will be created if needed
druid.paths.indexCache
=
/tmp/druid/indexCache
# Path on local FS for storage of segment metadata; dir will be created if needed
druid.paths.segmentInfoCache
=
/tmp/druid/segmentInfoCache
druid.pusher.local.storageDirectory
=
/tmp/druid/localStorage
druid.pusher.local
=
true
# master runtime configs
druid.master.startDelay
=
PT60S
\ No newline at end of file
examples/config/realtime/runtime.properties
浏览文件 @
2f728f34
druid.host
=
127.0.0.1
druid.port
=
8080
druid.host
=
127.0.0.1:8083
druid.port
=
8083
druid.service
=
realtime
# logging
com.metamx.emitter.logging
=
true
com.metamx.emitter.logging.level
=
info
druid.processing.formatString
=
processing_%s
druid.processing.numThreads
=
1
druid.processing.buffer.sizeBytes
=
10000000
# zk
druid.zk.service.host
=
localhost
druid.zk.paths.base
=
/druid
druid.zk.paths.discoveryPath
=
/druid/discoveryPath
#
emitting, opaque marker
druid.
service
=
example
#
processing
druid.
processing.buffer.sizeBytes
=
10000000
druid.request.logging.dir
=
/tmp/example/log
# schema
druid.realtime.specFile
=
realtime.spec
com.metamx.emitter.logging
=
true
com.metamx.emitter.logging.level
=
info
# below are dummy values when operating a realtime only node
com.metamx.aws.accessKey
=
dummy_access_key
com.metamx.aws.secretKey
=
dummy_secret_key
druid.pusher.s3.bucket
=
dummy_s3_bucket
# aws (dummy user)
com.metamx.aws.accessKey
=
AKIAIMKECRUYKDQGR6YQ
com.metamx.aws.secretKey
=
QyyfVZ7llSiRg6Qcrql1eEUG7buFpAK6T6engr1b
druid.zk.service.host
=
localhost
druid.server.maxSize
=
300000000000
druid.zk.paths.base
=
/druid
druid.database.segmentTable
=
prod_segments
# db
druid.database.segmentTable
=
segments
druid.database.user
=
druid
druid.database.password
=
diurd
druid.database.connectURI
=
jdbc:mysql://localhost:3306/druid
druid.zk.paths.discoveryPath
=
/druid/discoveryPath
druid.database.ruleTable
=
rules
druid.database.configTable
=
config
# Path on local FS for storage of segments; dir will be created if needed
druid.paths.indexCache
=
/tmp/druid/indexCache
# Path on local FS for storage of segment metadata; dir will be created if needed
druid.paths.segmentInfoCache
=
/tmp/druid/segmentInfoCache
druid.pusher.local.storageDirectory
=
/tmp/druid/localStorage
druid.pusher.local
=
true
druid.host
=
127.0.0.1:8080
# handoff
druid.pusher.local.storageDirectory
=
/tmp/druid/localStorage
druid.pusher.local
=
true
\ No newline at end of file
examples/config/runtime.properties
已删除
100644 → 0
浏览文件 @
68a3f1ab
druid.host
=
127.0.0.1
druid.port
=
8080
com.metamx.emitter.logging
=
true
druid.processing.formatString
=
processing_%s
druid.processing.numThreads
=
1
druid.processing.buffer.sizeBytes
=
10000000
#emitting, opaque marker
druid.service
=
example
druid.request.logging.dir
=
/tmp/example/log
server/src/main/java/com/metamx/druid/coordination/ZkCoordinator.java
浏览文件 @
2f728f34
...
...
@@ -204,7 +204,6 @@ public class ZkCoordinator implements DataSegmentChangeHandler
DataSegment
segment
=
jsonMapper
.
readValue
(
file
,
DataSegment
.
class
);
if
(
serverManager
.
isSegmentCached
(
segment
))
{
cachedSegments
.
add
(
segment
);
//addSegment(segment);
}
else
{
log
.
warn
(
"Unable to find cache file for %s. Deleting lookup entry"
,
segment
.
getIdentifier
());
...
...
@@ -228,7 +227,15 @@ public class ZkCoordinator implements DataSegmentChangeHandler
public
void
addSegment
(
DataSegment
segment
)
{
try
{
serverManager
.
loadSegment
(
segment
);
log
.
info
(
"Loading segment %s"
,
segment
.
getIdentifier
());
try
{
serverManager
.
loadSegment
(
segment
);
}
catch
(
Exception
e
)
{
removeSegment
(
segment
);
throw
new
SegmentLoadingException
(
e
,
"Exception loading segment[%s]"
,
segment
.
getIdentifier
());
}
File
segmentInfoCacheFile
=
new
File
(
config
.
getSegmentInfoCacheDirectory
(),
segment
.
getIdentifier
());
if
(!
segmentInfoCacheFile
.
exists
())
{
...
...
@@ -263,7 +270,15 @@ public class ZkCoordinator implements DataSegmentChangeHandler
{
try
{
for
(
DataSegment
segment
:
segments
)
{
serverManager
.
loadSegment
(
segment
);
log
.
info
(
"Loading segment %s"
,
segment
.
getIdentifier
());
try
{
serverManager
.
loadSegment
(
segment
);
}
catch
(
Exception
e
)
{
removeSegment
(
segment
);
throw
new
SegmentLoadingException
(
e
,
"Exception loading segment[%s]"
,
segment
.
getIdentifier
());
}
File
segmentInfoCacheFile
=
new
File
(
config
.
getSegmentInfoCacheDirectory
(),
segment
.
getIdentifier
());
if
(!
segmentInfoCacheFile
.
exists
())
{
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录