Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
milvus
milvus
提交
4d8d34e3
M
milvus
项目概览
milvus
/
milvus
10 个月 前同步成功
通知
260
Star
22476
Fork
2472
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
M
milvus
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
前往新版Gitcode,体验更适合开发者的 AI 搜索 >>
未验证
提交
4d8d34e3
编写于
6月 15, 2023
作者:
A
aoiasd
提交者:
GitHub
6月 15, 2023
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
Refine Rocksdb option (#24394) (#24503)
Signed-off-by:
N
aoiasd
<
zhicheng.yue@zilliz.com
>
上级
f3f3f8a8
变更
4
显示空白变更内容
内联
并排
Showing
4 changed file
with
13 addition
and
2 deletion
+13
-2
internal/core/conanfile.py
internal/core/conanfile.py
+1
-0
internal/core/thirdparty/rocksdb/rocksdb-win.pc.in
internal/core/thirdparty/rocksdb/rocksdb-win.pc.in
+1
-1
internal/core/thirdparty/rocksdb/rocksdb.pc.in
internal/core/thirdparty/rocksdb/rocksdb.pc.in
+1
-1
internal/mq/mqimpl/rocksmq/server/rocksmq_impl.go
internal/mq/mqimpl/rocksmq/server/rocksmq_impl.go
+10
-0
未找到文件。
internal/core/conanfile.py
浏览文件 @
4d8d34e3
...
@@ -50,6 +50,7 @@ class MilvusConan(ConanFile):
...
@@ -50,6 +50,7 @@ class MilvusConan(ConanFile):
generators
=
(
"cmake"
,
"cmake_find_package"
)
generators
=
(
"cmake"
,
"cmake_find_package"
)
default_options
=
{
default_options
=
{
"rocksdb:shared"
:
True
,
"rocksdb:shared"
:
True
,
"rocksdb:with_zstd"
:
True
,
"arrow:parquet"
:
True
,
"arrow:parquet"
:
True
,
"arrow:compute"
:
True
,
"arrow:compute"
:
True
,
"arrow:with_zstd"
:
True
,
"arrow:with_zstd"
:
True
,
...
...
internal/core/thirdparty/rocksdb/rocksdb-win.pc.in
浏览文件 @
4d8d34e3
...
@@ -5,5 +5,5 @@ Description: Rocksdb
...
@@ -5,5 +5,5 @@ Description: Rocksdb
Version: @ROCKSDB_VERSION@
Version: @ROCKSDB_VERSION@
Libs: -L${libdir} -lrocksdb
Libs: -L${libdir} -lrocksdb
Libs.private: -lz -lbz2
│
Libs.private: -lz -lbz2
Cflags: -I${includedir}
Cflags: -I${includedir}
internal/core/thirdparty/rocksdb/rocksdb.pc.in
浏览文件 @
4d8d34e3
internal/mq/mqimpl/rocksmq/server/rocksmq_impl.go
浏览文件 @
4d8d34e3
...
@@ -159,9 +159,16 @@ func NewRocksMQ(name string, idAllocator allocator.Interface) (*rocksmq, error)
...
@@ -159,9 +159,16 @@ func NewRocksMQ(name string, idAllocator allocator.Interface) (*rocksmq, error)
log
.
Debug
(
"Start rocksmq "
,
zap
.
Int
(
"max proc"
,
maxProcs
),
log
.
Debug
(
"Start rocksmq "
,
zap
.
Int
(
"max proc"
,
maxProcs
),
zap
.
Int
(
"parallism"
,
parallelism
),
zap
.
Uint64
(
"lru cache"
,
rocksDBLRUCacheCapacity
))
zap
.
Int
(
"parallism"
,
parallelism
),
zap
.
Uint64
(
"lru cache"
,
rocksDBLRUCacheCapacity
))
bbto
:=
gorocksdb
.
NewDefaultBlockBasedTableOptions
()
bbto
:=
gorocksdb
.
NewDefaultBlockBasedTableOptions
()
bbto
.
SetBlockSize
(
64
<<
10
)
bbto
.
SetBlockCache
(
gorocksdb
.
NewLRUCache
(
rocksDBLRUCacheCapacity
))
bbto
.
SetBlockCache
(
gorocksdb
.
NewLRUCache
(
rocksDBLRUCacheCapacity
))
optsKV
:=
gorocksdb
.
NewDefaultOptions
()
optsKV
:=
gorocksdb
.
NewDefaultOptions
()
// L0:No Compression
// L1,L2: ZSTD
optsKV
.
SetNumLevels
(
3
)
optsKV
.
SetCompressionPerLevel
([]
gorocksdb
.
CompressionType
{
0
,
7
,
7
})
optsKV
.
SetBlockBasedTableFactory
(
bbto
)
optsKV
.
SetBlockBasedTableFactory
(
bbto
)
optsKV
.
SetTargetFileSizeMultiplier
(
2
)
optsKV
.
SetCreateIfMissing
(
true
)
optsKV
.
SetCreateIfMissing
(
true
)
// by default there are only 1 thread for flush compaction, which may block each other.
// by default there are only 1 thread for flush compaction, which may block each other.
// increase to a reasonable thread numbers
// increase to a reasonable thread numbers
...
@@ -179,7 +186,10 @@ func NewRocksMQ(name string, idAllocator allocator.Interface) (*rocksmq, error)
...
@@ -179,7 +186,10 @@ func NewRocksMQ(name string, idAllocator allocator.Interface) (*rocksmq, error)
// finish rocks mq store initialization, rocks mq store has to set the prefix extractor
// finish rocks mq store initialization, rocks mq store has to set the prefix extractor
optsStore
:=
gorocksdb
.
NewDefaultOptions
()
optsStore
:=
gorocksdb
.
NewDefaultOptions
()
// share block cache with kv
// share block cache with kv
optsKV
.
SetNumLevels
(
3
)
optsStore
.
SetCompressionPerLevel
([]
gorocksdb
.
CompressionType
{
0
,
7
,
7
})
optsStore
.
SetBlockBasedTableFactory
(
bbto
)
optsStore
.
SetBlockBasedTableFactory
(
bbto
)
optsStore
.
SetTargetFileSizeMultiplier
(
2
)
optsStore
.
SetCreateIfMissing
(
true
)
optsStore
.
SetCreateIfMissing
(
true
)
// by default there are only 1 thread for flush compaction, which may block each other.
// by default there are only 1 thread for flush compaction, which may block each other.
// increase to a reasonable thread numbers
// increase to a reasonable thread numbers
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录