Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
apache
Shardingsphere
提交
73fc7527
Shardingsphere
项目概览
apache
/
Shardingsphere
通知
56
Star
3
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
Shardingsphere
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
73fc7527
编写于
1月 18, 2017
作者:
G
gaohongtao
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
fix #215 #161 Improve streaming sort performance.
上级
4e63e67d
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
47 addition
and
46 deletion
+47
-46
sharding-jdbc-core/src/main/java/com/dangdang/ddframe/rdb/sharding/merger/pipeline/reducer/StreamingOrderByReducerResultSet.java
...er/pipeline/reducer/StreamingOrderByReducerResultSet.java
+40
-46
sharding-jdbc-doc/content/03-community/release-notes.md
sharding-jdbc-doc/content/03-community/release-notes.md
+7
-0
未找到文件。
sharding-jdbc-core/src/main/java/com/dangdang/ddframe/rdb/sharding/merger/pipeline/reducer/StreamingOrderByReducerResultSet.java
浏览文件 @
73fc7527
...
...
@@ -21,12 +21,14 @@ import com.dangdang.ddframe.rdb.sharding.merger.ResultSetMergeContext;
import
com.dangdang.ddframe.rdb.sharding.merger.resultset.delegate.AbstractDelegateResultSet
;
import
com.dangdang.ddframe.rdb.sharding.merger.resultset.memory.row.OrderByResultSetRow
;
import
com.dangdang.ddframe.rdb.sharding.parser.result.merger.OrderByColumn
;
import
lombok.RequiredArgsConstructor
;
import
lombok.extern.slf4j.Slf4j
;
import
java.sql.ResultSet
;
import
java.sql.SQLException
;
import
java.util.LinkedList
;
import
java.util.List
;
import
java.util.PriorityQueue
;
import
java.util.Queue
;
/**
* 流式排序的聚集结果集.
...
...
@@ -37,72 +39,64 @@ import java.util.List;
@Slf4j
public
final
class
StreamingOrderByReducerResultSet
extends
AbstractDelegateResultSet
{
private
final
List
<
OrderByColumn
>
orderByColumns
;
private
final
Queue
<
ResultSetOrderByWrapper
>
delegateResultSetQueue
;
private
final
List
<
OrderByColumn
>
orderByKeys
;
private
final
List
<
OrderByDelegateResultSet
>
delegateResultSets
=
new
LinkedList
<>();
private
OrderByDelegateResultSet
lastDelegateResultSet
;
public
StreamingOrderByReducerResultSet
(
final
ResultSetMergeContext
resultSetMergeContext
)
throws
SQLException
{
super
(
resultSetMergeContext
.
getShardingResultSets
().
getResultSets
());
orderByColumns
=
resultSetMergeContext
.
getCurrentOrderByKeys
();
List
<
ResultSet
>
mergeResultSets
=
resultSetMergeContext
.
getShardingResultSets
().
getResultSets
();
for
(
ResultSet
each:
mergeResultSets
){
delegateResultSets
.
add
(
new
OrderByDelegateResultSet
(
each
,
orderByColumns
));
}
delegateResultSetQueue
=
new
PriorityQueue
<>(
getResultSets
().
size
());
orderByKeys
=
resultSetMergeContext
.
getCurrentOrderByKeys
();
}
@Override
protected
boolean
firstNext
()
throws
SQLException
{
for
(
OrderByDelegateResultSet
each
:
delegateResultSets
)
{
each
.
next
();
for
(
ResultSet
each
:
getResultSets
())
{
ResultSetOrderByWrapper
wrapper
=
new
ResultSetOrderByWrapper
(
each
);
if
(
wrapper
.
next
())
{
delegateResultSetQueue
.
offer
(
wrapper
);
}
}
return
doNext
();
}
@Override
protected
boolean
afterFirstNext
()
throws
SQLException
{
lastDelegateResultSet
.
next
();
ResultSetOrderByWrapper
firstResultSet
=
delegateResultSetQueue
.
poll
();
setDelegate
(
firstResultSet
.
delegate
);
if
(
firstResultSet
.
next
())
{
delegateResultSetQueue
.
offer
(
firstResultSet
);
}
return
doNext
();
}
private
boolean
doNext
()
throws
SQLException
{
setDelegateResultSet
();
return
!
delegateResultSets
.
isEmpty
();
}
private
void
setDelegateResultSet
()
throws
SQLException
{
OrderByResultSetRow
chosenOrderByValue
=
null
;
for
(
OrderByDelegateResultSet
each
:
delegateResultSets
)
{
OrderByResultSetRow
eachOrderByValue
=
each
.
orderByValue
;
if
(
null
==
chosenOrderByValue
||
chosenOrderByValue
.
compareTo
(
eachOrderByValue
)
>
0
)
{
chosenOrderByValue
=
eachOrderByValue
;
setDelegate
(
each
.
delegate
);
lastDelegateResultSet
=
each
;
}
private
boolean
doNext
()
{
if
(
delegateResultSetQueue
.
isEmpty
())
{
return
false
;
}
log
.
trace
(
"Chosen order by value: {}, current result set hashcode: {}"
,
chosenOrderByValue
,
getDelegate
().
hashCode
());
setDelegate
(
delegateResultSetQueue
.
peek
().
delegate
);
log
.
trace
(
"Chosen order by value: {}, current result set hashcode: {}"
,
delegateResultSetQueue
.
peek
().
row
,
getDelegate
().
hashCode
());
return
true
;
}
class
OrderByDelegateResultSet
{
private
ResultSet
delegate
;
private
List
<
OrderByColumn
>
orderByColumns
;
private
OrderByResultSetRow
orderByValue
;
public
OrderByDelegateResultSet
(
ResultSet
delegate
,
List
<
OrderByColumn
>
orderByColumns
)
throws
SQLException
{
this
.
delegate
=
delegate
;
this
.
orderByColumns
=
orderByColumns
;
}
public
boolean
next
()
throws
SQLException
{
@RequiredArgsConstructor
private
class
ResultSetOrderByWrapper
implements
Comparable
<
ResultSetOrderByWrapper
>
{
private
final
ResultSet
delegate
;
private
OrderByResultSetRow
row
;
boolean
next
()
throws
SQLException
{
boolean
result
=
delegate
.
next
();
if
(
result
)
{
orderByValue
=
new
OrderByResultSetRow
(
delegate
,
orderByColumns
);
}
else
{
delegateResultSets
.
remove
(
this
);
if
(
result
)
{
row
=
new
OrderByResultSetRow
(
delegate
,
orderByKeys
);
}
return
result
;
}
@Override
public
int
compareTo
(
final
ResultSetOrderByWrapper
o
)
{
return
row
.
compareTo
(
o
.
row
);
}
}
}
sharding-jdbc-doc/content/03-community/release-notes.md
浏览文件 @
73fc7527
...
...
@@ -8,6 +8,13 @@ next = "/03-community/directory-structure"
+++
## 1.4.2
### 功能提升
1.
[
ISSUE #215
](
https://github.com/dangdangdotcom/sharding-jdbc/issues/215
)
流式排序的聚集结果集 StreamingOrderByReducerResultSet性能优化
1.
[
ISSUE #161
](
https://github.com/dangdangdotcom/sharding-jdbc/issues/161
)
结果集归并的时候可以采用堆排序来提升性能
## 1.4.1
### 功能提升
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录