Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
709edb80
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
709edb80
编写于
3月 10, 2017
作者:
A
Aljoscha Krettek
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[FLINK-4460] Add side output ITCase for multiple side out consumers
上级
c3fc8b97
变更
1
隐藏空白更改
内联
并排
Showing
1 changed file
with
67 addition
and
0 deletion
+67
-0
flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/SideOutputITCase.java
...apache/flink/test/streaming/runtime/SideOutputITCase.java
+67
-0
未找到文件。
flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/SideOutputITCase.java
浏览文件 @
709edb80
...
...
@@ -165,6 +165,73 @@ public class SideOutputITCase extends StreamingMultipleProgramsTestBase implemen
assertEquals
(
Arrays
.
asList
(
"E:1"
,
"E:2"
,
"E:3"
,
"E:4"
,
"E:5"
,
"WM:0"
,
"WM:2"
,
"WM:"
+
Long
.
MAX_VALUE
),
resultSink
.
getSortedResult
());
}
@Test
public
void
testSideOutputWithMultipleConsumers
()
throws
Exception
{
TestListResultSink
<
String
>
sideOutputResultSink1
=
new
TestListResultSink
<>();
TestListResultSink
<
String
>
sideOutputResultSink2
=
new
TestListResultSink
<>();
TestListResultSink
<
Integer
>
resultSink
=
new
TestListResultSink
<>();
StreamExecutionEnvironment
env
=
StreamExecutionEnvironment
.
getExecutionEnvironment
();
env
.
setParallelism
(
3
);
DataStream
<
Integer
>
dataStream
=
env
.
fromCollection
(
elements
);
SingleOutputStreamOperator
<
Integer
>
passThroughtStream
=
dataStream
.
process
(
new
ProcessFunction
<
Integer
,
Integer
>()
{
private
static
final
long
serialVersionUID
=
1L
;
@Override
public
void
processElement
(
Integer
value
,
Context
ctx
,
Collector
<
Integer
>
out
)
throws
Exception
{
out
.
collect
(
value
);
ctx
.
output
(
sideOutputTag1
,
"sideout-"
+
String
.
valueOf
(
value
));
}
});
passThroughtStream
.
getSideOutput
(
sideOutputTag1
).
addSink
(
sideOutputResultSink1
);
passThroughtStream
.
getSideOutput
(
sideOutputTag1
).
addSink
(
sideOutputResultSink2
);
passThroughtStream
.
addSink
(
resultSink
);
env
.
execute
();
assertEquals
(
Arrays
.
asList
(
"sideout-1"
,
"sideout-2"
,
"sideout-3"
,
"sideout-4"
,
"sideout-5"
),
sideOutputResultSink1
.
getSortedResult
());
assertEquals
(
Arrays
.
asList
(
"sideout-1"
,
"sideout-2"
,
"sideout-3"
,
"sideout-4"
,
"sideout-5"
),
sideOutputResultSink2
.
getSortedResult
());
assertEquals
(
Arrays
.
asList
(
1
,
2
,
3
,
4
,
5
),
resultSink
.
getSortedResult
());
}
@Test
public
void
testSideOutputWithMultipleConsumersWithObjectReuse
()
throws
Exception
{
TestListResultSink
<
String
>
sideOutputResultSink1
=
new
TestListResultSink
<>();
TestListResultSink
<
String
>
sideOutputResultSink2
=
new
TestListResultSink
<>();
TestListResultSink
<
Integer
>
resultSink
=
new
TestListResultSink
<>();
StreamExecutionEnvironment
env
=
StreamExecutionEnvironment
.
getExecutionEnvironment
();
env
.
getConfig
().
enableObjectReuse
();
env
.
setParallelism
(
3
);
DataStream
<
Integer
>
dataStream
=
env
.
fromCollection
(
elements
);
SingleOutputStreamOperator
<
Integer
>
passThroughtStream
=
dataStream
.
process
(
new
ProcessFunction
<
Integer
,
Integer
>()
{
private
static
final
long
serialVersionUID
=
1L
;
@Override
public
void
processElement
(
Integer
value
,
Context
ctx
,
Collector
<
Integer
>
out
)
throws
Exception
{
out
.
collect
(
value
);
ctx
.
output
(
sideOutputTag1
,
"sideout-"
+
String
.
valueOf
(
value
));
}
});
passThroughtStream
.
getSideOutput
(
sideOutputTag1
).
addSink
(
sideOutputResultSink1
);
passThroughtStream
.
getSideOutput
(
sideOutputTag1
).
addSink
(
sideOutputResultSink2
);
passThroughtStream
.
addSink
(
resultSink
);
env
.
execute
();
assertEquals
(
Arrays
.
asList
(
"sideout-1"
,
"sideout-2"
,
"sideout-3"
,
"sideout-4"
,
"sideout-5"
),
sideOutputResultSink1
.
getSortedResult
());
assertEquals
(
Arrays
.
asList
(
"sideout-1"
,
"sideout-2"
,
"sideout-3"
,
"sideout-4"
,
"sideout-5"
),
sideOutputResultSink2
.
getSortedResult
());
assertEquals
(
Arrays
.
asList
(
1
,
2
,
3
,
4
,
5
),
resultSink
.
getSortedResult
());
}
/**
* Test ProcessFunction side output.
*/
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录