Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
25484701
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
25484701
编写于
7月 14, 2014
作者:
G
gyfora
提交者:
Stephan Ewen
8月 18, 2014
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[streaming] minor update for partitioning setting with connectWith
上级
44c378ae
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
16 addition
and
10 deletion
+16
-10
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/DataStream.java
...c/main/java/eu/stratosphere/streaming/api/DataStream.java
+14
-8
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/examples/join/JoinLocal.java
...va/eu/stratosphere/streaming/examples/join/JoinLocal.java
+2
-2
未找到文件。
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/DataStream.java
浏览文件 @
25484701
...
...
@@ -48,7 +48,7 @@ public class DataStream<T extends Tuple> {
if
(
context
==
null
)
{
throw
new
NullPointerException
(
"context is null"
);
}
// TODO add name based on component number an preferable sequential id
this
.
id
=
Long
.
toHexString
(
random
.
nextLong
())
+
Long
.
toHexString
(
random
.
nextLong
());
this
.
context
=
context
;
...
...
@@ -77,18 +77,23 @@ public class DataStream<T extends Tuple> {
}
public
DataStream
<
T
>
partitionBy
(
int
keyposition
)
{
ctypes
.
set
(
0
,
ConnectionType
.
FIELD
);
cparams
.
set
(
0
,
keyposition
);
for
(
int
i
=
0
;
i
<
ctypes
.
size
();
i
++)
{
ctypes
.
set
(
i
,
ConnectionType
.
FIELD
);
cparams
.
set
(
i
,
keyposition
);
}
return
this
;
}
public
DataStream
<
T
>
broadcast
()
{
ctypes
.
set
(
0
,
ConnectionType
.
BROADCAST
);
for
(
int
i
=
0
;
i
<
ctypes
.
size
();
i
++)
{
ctypes
.
set
(
i
,
ConnectionType
.
BROADCAST
);
}
return
this
;
}
public
<
R
extends
Tuple
>
DataStream
<
R
>
flatMap
(
FlatMapFunction
<
T
,
R
>
flatMapper
)
{
return
context
.
addFunction
(
"flatMap"
,
this
,
flatMapper
,
new
FlatMapInvokable
<
T
,
R
>(
flatMapper
));
return
context
.
addFunction
(
"flatMap"
,
this
,
flatMapper
,
new
FlatMapInvokable
<
T
,
R
>(
flatMapper
));
}
public
<
R
extends
Tuple
>
DataStream
<
R
>
map
(
MapFunction
<
T
,
R
>
mapper
)
{
...
...
@@ -96,13 +101,14 @@ public class DataStream<T extends Tuple> {
}
public
<
R
extends
Tuple
>
DataStream
<
R
>
batchReduce
(
GroupReduceFunction
<
T
,
R
>
reducer
)
{
return
context
.
addFunction
(
"batchReduce"
,
this
,
reducer
,
new
BatchReduceInvokable
<
T
,
R
>(
reducer
));
return
context
.
addFunction
(
"batchReduce"
,
this
,
reducer
,
new
BatchReduceInvokable
<
T
,
R
>(
reducer
));
}
public
DataStream
<
T
>
filter
(
FilterFunction
<
T
>
filter
)
{
return
context
.
addFunction
(
"filter"
,
this
,
filter
,
new
FilterInvokable
<
T
>(
filter
));
}
public
DataStream
<
T
>
addSink
(
SinkFunction
<
T
>
sinkFunction
)
{
return
context
.
addSink
(
this
,
sinkFunction
);
}
...
...
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/examples/join/JoinLocal.java
浏览文件 @
25484701
...
...
@@ -31,11 +31,11 @@ public class JoinLocal {
StreamExecutionEnvironment
context
=
new
StreamExecutionEnvironment
();
DataStream
<
Tuple3
<
String
,
String
,
Integer
>>
source1
=
context
.
addSource
(
new
JoinSourceOne
())
.
partitionBy
(
1
)
;
.
addSource
(
new
JoinSourceOne
());
@SuppressWarnings
(
"unused"
)
DataStream
<
Tuple3
<
String
,
Integer
,
Integer
>>
source2
=
context
.
addSource
(
new
JoinSourceTwo
()).
partitionBy
(
1
).
connectWith
(
source
1
)
.
addSource
(
new
JoinSourceTwo
()).
connectWith
(
source1
).
partitionBy
(
1
)
.
flatMap
(
new
JoinTask
()).
addSink
(
new
JoinSink
());
context
.
execute
();
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录