Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
87c11cfd
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
87c11cfd
编写于
7月 14, 2014
作者:
G
gaborhermann
提交者:
Stephan Ewen
8月 18, 2014
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[streaming] Making a copy of Record in StreamRecord
上级
e34bcd2c
变更
4
隐藏空白更改
内联
并排
Showing
4 changed file
with
11 addition
and
9 deletion
+11
-9
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/StreamRecord.java
...main/java/eu/stratosphere/streaming/api/StreamRecord.java
+3
-4
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/invokable/StreamInvokable.java
...stratosphere/streaming/api/invokable/StreamInvokable.java
+2
-2
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/test/wordcount/WordCountCounter.java
...ratosphere/streaming/test/wordcount/WordCountCounter.java
+3
-1
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/test/wordcount/WordCountSplitter.java
...atosphere/streaming/test/wordcount/WordCountSplitter.java
+3
-2
未找到文件。
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/StreamRecord.java
浏览文件 @
87c11cfd
...
...
@@ -17,15 +17,14 @@ public final class StreamRecord {
}
public
StreamRecord
(
Record
record
,
String
channelID
)
{
this
(
record
);
record
.
addField
(
uid
);
this
.
record
=
record
.
createCopy
();
this
.
channelID
=
channelID
;
}
public
StreamRecord
set
Id
()
{
public
StreamRecord
add
Id
()
{
Random
rnd
=
new
Random
();
uid
.
setValue
(
channelID
+
"-"
+
rnd
.
nextInt
(
1000
));
record
.
setField
(
record
.
getNumFields
()
-
1
,
uid
);
record
.
addField
(
uid
);
return
this
;
}
...
...
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/invokable/StreamInvokable.java
浏览文件 @
87c11cfd
...
...
@@ -21,10 +21,10 @@ public abstract class StreamInvokable {
this
.
emittedRecords
=
emittedRecords
;
}
public
final
void
emit
(
Record
record
)
{
StreamRecord
streamRecord
=
new
StreamRecord
(
record
,
channelID
).
setId
();
public
final
void
emit
(
Record
record
)
{
for
(
RecordWriter
<
Record
>
output
:
outputs
)
{
try
{
StreamRecord
streamRecord
=
new
StreamRecord
(
record
,
channelID
).
addId
();
output
.
emit
(
streamRecord
.
getRecord
());
emittedRecords
.
put
(
streamRecord
.
getId
(),
streamRecord
);
...
...
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/test/wordcount/WordCountCounter.java
浏览文件 @
87c11cfd
...
...
@@ -29,6 +29,7 @@ public class WordCountCounter extends UserTaskInvokable {
private
StringValue
wordValue
=
new
StringValue
(
""
);
private
IntValue
countValue
=
new
IntValue
(
1
);
private
String
word
=
""
;
private
Record
outputRecord
=
new
Record
(
wordValue
,
countValue
);
private
int
count
=
1
;
@Override
...
...
@@ -41,7 +42,8 @@ public class WordCountCounter extends UserTaskInvokable {
count
=
wordCounts
.
get
(
word
)
+
1
;
wordCounts
.
put
(
word
,
count
);
countValue
.
setValue
(
count
);
Record
outputRecord
=
new
Record
(
wordValue
,
countValue
);
outputRecord
.
setField
(
0
,
wordValue
);
outputRecord
.
setField
(
1
,
countValue
);
emit
(
outputRecord
);
}
else
{
...
...
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/test/wordcount/WordCountSplitter.java
浏览文件 @
87c11cfd
...
...
@@ -24,14 +24,15 @@ public class WordCountSplitter extends UserTaskInvokable {
private
StringValue
sentence
=
new
StringValue
(
""
);
private
String
[]
words
=
new
String
[
0
];
private
StringValue
wordValue
=
new
StringValue
(
""
);
private
Record
outputRecord
=
new
Record
(
wordValue
);
@Override
public
void
invoke
(
Record
record
)
throws
Exception
{
record
.
getFieldInto
(
0
,
sentence
);
words
=
sentence
.
getValue
().
split
(
" "
);
for
(
CharSequence
word
:
words
)
{
wordValue
.
setValue
(
word
);
Record
outputRecord
=
new
Record
(
wordValue
);
outputRecord
.
setField
(
0
,
wordValue
);
emit
(
outputRecord
);
}
}
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录