Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
1e20d614
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
1e20d614
编写于
4月 29, 2020
作者:
A
Arvid Heise
提交者:
Piotr Nowojski
5月 12, 2020
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[FLINK-17315][checkpointing] Only adding buffers to inflight data of PipelinedSubpartition.
上级
0d08d230
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
14 addition
and
5 deletion
+14
-5
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartition.java
...k/runtime/io/network/partition/PipelinedSubpartition.java
+3
-1
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartitionWithReadViewTest.java
...work/partition/PipelinedSubpartitionWithReadViewTest.java
+11
-4
未找到文件。
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartition.java
浏览文件 @
1e20d614
...
...
@@ -174,7 +174,9 @@ public class PipelinedSubpartition extends ResultSubpartition {
// Meanwhile prepare the collection of in-flight buffers which would be fetched in the next step later.
for
(
BufferConsumer
buffer
:
buffers
)
{
try
(
BufferConsumer
bc
=
buffer
.
copy
())
{
inflightBufferSnapshot
.
add
(
bc
.
build
());
if
(
bc
.
isBuffer
())
{
inflightBufferSnapshot
.
add
(
bc
.
build
());
}
}
}
...
...
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartitionWithReadViewTest.java
浏览文件 @
1e20d614
...
...
@@ -24,6 +24,7 @@ import org.apache.flink.runtime.checkpoint.CheckpointType;
import
org.apache.flink.runtime.event.AbstractEvent
;
import
org.apache.flink.runtime.io.disk.NoOpFileChannelManager
;
import
org.apache.flink.runtime.io.network.api.CheckpointBarrier
;
import
org.apache.flink.runtime.io.network.api.EndOfSuperstepEvent
;
import
org.apache.flink.runtime.io.network.api.serialization.EventSerializer
;
import
org.apache.flink.runtime.io.network.buffer.Buffer
;
import
org.apache.flink.runtime.io.network.buffer.BufferBuilder
;
...
...
@@ -319,7 +320,12 @@ public class PipelinedSubpartitionWithReadViewTest {
assertEquals
(
1
,
availablityListener
.
getNumNotifications
());
assertEquals
(
0
,
availablityListener
.
getNumPriorityEvents
());
subpartition
.
add
(
createFilledFinishedBufferConsumer
(
3
));
BufferConsumer
eventBuffer
=
EventSerializer
.
toBufferConsumer
(
EndOfSuperstepEvent
.
INSTANCE
);
subpartition
.
add
(
eventBuffer
);
assertEquals
(
1
,
availablityListener
.
getNumNotifications
());
assertEquals
(
0
,
availablityListener
.
getNumPriorityEvents
());
subpartition
.
add
(
createFilledFinishedBufferConsumer
(
4
));
assertEquals
(
1
,
availablityListener
.
getNumNotifications
());
assertEquals
(
0
,
availablityListener
.
getNumPriorityEvents
());
...
...
@@ -334,13 +340,14 @@ public class PipelinedSubpartitionWithReadViewTest {
assertEquals
(
0
,
availablityListener
.
getNumPriorityEvents
());
List
<
Buffer
>
inflight
=
subpartition
.
requestInflightBufferSnapshot
();
assertEquals
(
Arrays
.
asList
(
1
,
2
,
3
),
inflight
.
stream
().
map
(
Buffer:
:
getSize
).
collect
(
Collectors
.
toList
()));
assertEquals
(
Arrays
.
asList
(
1
,
2
,
4
),
inflight
.
stream
().
map
(
Buffer:
:
getSize
).
collect
(
Collectors
.
toList
()));
inflight
.
forEach
(
Buffer:
:
recycleBuffer
);
assertNextEvent
(
readView
,
barrierBuffer
.
getWrittenBytes
(),
CheckpointBarrier
.
class
,
true
,
2
,
false
,
true
);
assertNextBuffer
(
readView
,
1
,
true
,
1
,
false
,
true
);
assertNextBuffer
(
readView
,
2
,
false
,
0
,
false
,
true
);
assertNextBuffer
(
readView
,
3
,
false
,
0
,
false
,
true
);
assertNextBuffer
(
readView
,
2
,
true
,
0
,
true
,
true
);
assertNextEvent
(
readView
,
eventBuffer
.
getWrittenBytes
(),
EndOfSuperstepEvent
.
class
,
false
,
0
,
false
,
true
);
assertNextBuffer
(
readView
,
4
,
false
,
0
,
false
,
true
);
assertNoNextBuffer
(
readView
);
}
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录