Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
apache
Iotdb
提交
8d79a5e4
I
Iotdb
项目概览
apache
/
Iotdb
大约 1 年 前同步成功
通知
25
Star
3344
Fork
916
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
I
Iotdb
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
未验证
提交
8d79a5e4
编写于
8月 21, 2023
作者:
S
shuwenwei
提交者:
GitHub
8月 21, 2023
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
Add hot load compaction configs (#10758)
上级
144e5428
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
92 addition
and
1 deletion
+92
-1
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/conf/IoTDBDescriptor.java
...c/main/java/org/apache/iotdb/db/conf/IoTDBDescriptor.java
+92
-0
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/compaction/schedule/CompactionTaskManager.java
...dataregion/compaction/schedule/CompactionTaskManager.java
+0
-1
未找到文件。
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/conf/IoTDBDescriptor.java
浏览文件 @
8d79a5e4
...
...
@@ -35,6 +35,7 @@ import org.apache.iotdb.db.storageengine.dataregion.compaction.constant.Compacti
import
org.apache.iotdb.db.storageengine.dataregion.compaction.execute.performer.constant.CrossCompactionPerformer
;
import
org.apache.iotdb.db.storageengine.dataregion.compaction.execute.performer.constant.InnerSeqCompactionPerformer
;
import
org.apache.iotdb.db.storageengine.dataregion.compaction.execute.performer.constant.InnerUnseqCompactionPerformer
;
import
org.apache.iotdb.db.storageengine.dataregion.compaction.schedule.CompactionTaskManager
;
import
org.apache.iotdb.db.storageengine.dataregion.compaction.schedule.constant.CompactionPriority
;
import
org.apache.iotdb.db.storageengine.dataregion.compaction.selector.constant.CrossCompactionSelector
;
import
org.apache.iotdb.db.storageengine.dataregion.compaction.selector.constant.InnerSequenceCompactionSelector
;
...
...
@@ -1107,6 +1108,94 @@ public class IoTDBDescriptor {
loadWALHotModifiedProps
(
properties
);
}
private
void
loadCompactionHotModifiedProps
(
Properties
properties
)
throws
InterruptedException
{
conf
.
setCompactionValidationLevel
(
CompactionValidationLevel
.
valueOf
(
properties
.
getProperty
(
"compaction_validation_level"
,
conf
.
getCompactionValidationLevel
().
toString
())));
loadCompactionIsEnabledHotModifiedProps
(
properties
);
boolean
restartCompactionTaskManager
=
loadCompactionThreadCountHotModifiedProps
(
properties
);
restartCompactionTaskManager
|=
loadCompactionSubTaskCountHotModifiedProps
(
properties
);
if
(
restartCompactionTaskManager
)
{
CompactionTaskManager
.
getInstance
().
restart
();
}
}
private
boolean
loadCompactionThreadCountHotModifiedProps
(
Properties
properties
)
{
int
newConfigCompactionThreadCount
=
Integer
.
parseInt
(
properties
.
getProperty
(
"compaction_thread_count"
,
Integer
.
toString
(
conf
.
getCompactionThreadCount
())));
if
(
newConfigCompactionThreadCount
<=
0
)
{
logger
.
error
(
"compaction_thread_count must greater than 0"
);
return
false
;
}
if
(
newConfigCompactionThreadCount
==
conf
.
getCompactionThreadCount
())
{
return
false
;
}
conf
.
setCompactionThreadCount
(
Integer
.
parseInt
(
properties
.
getProperty
(
"compaction_thread_count"
,
Integer
.
toString
(
conf
.
getCompactionThreadCount
()))));
return
true
;
}
private
boolean
loadCompactionSubTaskCountHotModifiedProps
(
Properties
properties
)
{
int
newConfigSubtaskNum
=
Integer
.
parseInt
(
properties
.
getProperty
(
"sub_compaction_thread_count"
,
Integer
.
toString
(
conf
.
getSubCompactionTaskNum
())));
if
(
newConfigSubtaskNum
<=
0
)
{
logger
.
error
(
"sub_compaction_thread_count must greater than 0"
);
return
false
;
}
if
(
newConfigSubtaskNum
==
conf
.
getSubCompactionTaskNum
())
{
return
false
;
}
conf
.
setSubCompactionTaskNum
(
newConfigSubtaskNum
);
return
true
;
}
private
void
loadCompactionIsEnabledHotModifiedProps
(
Properties
properties
)
{
boolean
isCompactionEnabled
=
conf
.
isEnableSeqSpaceCompaction
()
||
conf
.
isEnableUnseqSpaceCompaction
()
||
conf
.
isEnableCrossSpaceCompaction
();
boolean
newConfigEnableCrossSpaceCompaction
=
Boolean
.
parseBoolean
(
properties
.
getProperty
(
"enable_cross_space_compaction"
,
Boolean
.
toString
(
conf
.
isEnableCrossSpaceCompaction
())));
boolean
newConfigEnableSeqSpaceCompaction
=
Boolean
.
parseBoolean
(
properties
.
getProperty
(
"enable_seq_space_compaction"
,
Boolean
.
toString
(
conf
.
isEnableSeqSpaceCompaction
())));
boolean
newConfigEnableUnseqSpaceCompaction
=
Boolean
.
parseBoolean
(
properties
.
getProperty
(
"enable_unseq_space_compaction"
,
Boolean
.
toString
(
conf
.
isEnableUnseqSpaceCompaction
())));
boolean
compactionEnabledInNewConfig
=
newConfigEnableCrossSpaceCompaction
||
newConfigEnableSeqSpaceCompaction
||
newConfigEnableUnseqSpaceCompaction
;
if
(!
isCompactionEnabled
&&
compactionEnabledInNewConfig
)
{
logger
.
error
(
"Compaction cannot start in current status."
);
return
;
}
conf
.
setEnableCrossSpaceCompaction
(
newConfigEnableCrossSpaceCompaction
);
conf
.
setEnableSeqSpaceCompaction
(
newConfigEnableSeqSpaceCompaction
);
conf
.
setEnableUnseqSpaceCompaction
(
newConfigEnableUnseqSpaceCompaction
);
}
private
void
loadWALHotModifiedProps
(
Properties
properties
)
{
long
walAsyncModeFsyncDelayInMs
=
Long
.
parseLong
(
...
...
@@ -1531,6 +1620,9 @@ public class IoTDBDescriptor {
WALManager
.
getInstance
().
rebootWALDeleteThread
();
}
// update compaction config
loadCompactionHotModifiedProps
(
properties
);
// update schema quota configuration
conf
.
setClusterSchemaLimitLevel
(
properties
...
...
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/compaction/schedule/CompactionTaskManager.java
浏览文件 @
8d79a5e4
...
...
@@ -398,7 +398,6 @@ public class CompactionTaskManager implements IService {
return
storageGroupName
+
"-"
+
dataRegionId
;
}
@TestOnly
public
void
restart
()
throws
InterruptedException
{
if
(
IoTDBDescriptor
.
getInstance
().
getConfig
().
getCompactionThreadCount
()
>
0
)
{
if
(
subCompactionTaskExecutionPool
!=
null
)
{
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录