Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
8951d921
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
8951d921
编写于
7月 14, 2014
作者:
G
gaborhermann
提交者:
Stephan Ewen
8月 18, 2014
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[streaming] StreamComponentTest added
上级
0eba9a86
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
129 addition
and
1 deletion
+129
-1
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/invokable/UserSinkInvokable.java
...ratosphere/streaming/api/invokable/UserSinkInvokable.java
+1
-1
flink-addons/flink-streaming/src/test/java/eu/stratosphere/streaming/api/streamcomponent/StreamComponentTest.java
...re/streaming/api/streamcomponent/StreamComponentTest.java
+128
-0
未找到文件。
flink-addons/flink-streaming/src/main/java/eu/stratosphere/streaming/api/invokable/UserSinkInvokable.java
浏览文件 @
8951d921
...
...
@@ -22,7 +22,7 @@ public abstract class UserSinkInvokable {
public
abstract
void
invoke
(
StreamRecord
record
)
throws
Exception
;
public
String
getResult
()
{
return
"Override
s
etResult() to pass your own results"
;
return
"Override
g
etResult() to pass your own results"
;
}
}
\ No newline at end of file
flink-addons/flink-streaming/src/test/java/eu/stratosphere/streaming/api/streamcomponent/StreamComponentTest.java
0 → 100644
浏览文件 @
8951d921
/***********************************************************************************************************************
*
* Copyright (C) 2010-2014 by the Stratosphere project (http://stratosphere.eu)
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
* the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
* an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
* specific language governing permissions and limitations under the License.
*
**********************************************************************************************************************/
package
eu.stratosphere.streaming.api.streamcomponent
;
import
static
org
.
junit
.
Assert
.
assertEquals
;
import
java.net.InetSocketAddress
;
import
java.util.HashMap
;
import
java.util.Map
;
import
org.apache.log4j.Appender
;
import
org.apache.log4j.ConsoleAppender
;
import
org.apache.log4j.Layout
;
import
org.apache.log4j.Level
;
import
org.apache.log4j.Logger
;
import
org.apache.log4j.spi.ErrorHandler
;
import
org.apache.log4j.spi.Filter
;
import
org.apache.log4j.spi.LoggingEvent
;
import
org.junit.Test
;
import
eu.stratosphere.client.minicluster.NepheleMiniCluster
;
import
eu.stratosphere.client.program.Client
;
import
eu.stratosphere.configuration.Configuration
;
import
eu.stratosphere.nephele.jobgraph.JobGraph
;
import
eu.stratosphere.streaming.api.JobGraphBuilder
;
import
eu.stratosphere.streaming.api.invokable.UserSinkInvokable
;
import
eu.stratosphere.streaming.api.invokable.UserSourceInvokable
;
import
eu.stratosphere.streaming.api.invokable.UserTaskInvokable
;
import
eu.stratosphere.streaming.api.streamrecord.StreamRecord
;
import
eu.stratosphere.types.IntValue
;
public
class
StreamComponentTest
{
private
static
Map
<
Integer
,
Integer
>
data
=
new
HashMap
<
Integer
,
Integer
>();
public
static
class
MySource
extends
UserSourceInvokable
{
public
MySource
()
{
}
@Override
public
void
invoke
()
throws
Exception
{
StreamRecord
record
=
new
StreamRecord
(
new
IntValue
(-
1
));
for
(
int
i
=
0
;
i
<
1000
;
i
++)
{
record
.
setField
(
0
,
new
IntValue
(
i
));
emit
(
record
);
}
}
}
public
static
class
MyTask
extends
UserTaskInvokable
{
public
MyTask
()
{
}
@Override
public
void
invoke
(
StreamRecord
record
)
throws
Exception
{
IntValue
val
=
(
IntValue
)
record
.
getField
(
0
);
Integer
i
=
val
.
getValue
();
emit
(
new
StreamRecord
(
new
IntValue
(
i
),
new
IntValue
(
i
+
1
)));
}
}
public
static
class
MySink
extends
UserSinkInvokable
{
public
MySink
()
{
}
@Override
public
void
invoke
(
StreamRecord
record
)
throws
Exception
{
IntValue
k
=
(
IntValue
)
record
.
getField
(
0
);
IntValue
v
=
(
IntValue
)
record
.
getField
(
1
);
data
.
put
(
k
.
getValue
(),
v
.
getValue
());
}
@Override
public
String
getResult
()
{
return
""
;
}
}
@Test
public
void
test
()
{
Logger
root
=
Logger
.
getRootLogger
();
root
.
removeAllAppenders
();
root
.
addAppender
(
new
ConsoleAppender
());
root
.
setLevel
(
Level
.
OFF
);
JobGraphBuilder
graphBuilder
=
new
JobGraphBuilder
(
"testGraph"
);
graphBuilder
.
setSource
(
"MySource"
,
StreamComponentTest
.
MySource
.
class
);
graphBuilder
.
setTask
(
"MyTask"
,
MyTask
.
class
,
1
);
graphBuilder
.
setSink
(
"MySink"
,
MySink
.
class
);
graphBuilder
.
shuffleConnect
(
"MySource"
,
"MyTask"
);
graphBuilder
.
shuffleConnect
(
"MyTask"
,
"MySink"
);
JobGraph
jG
=
graphBuilder
.
getJobGraph
();
Configuration
configuration
=
jG
.
getJobConfiguration
();
NepheleMiniCluster
exec
=
new
NepheleMiniCluster
();
try
{
exec
.
start
();
Client
client
=
new
Client
(
new
InetSocketAddress
(
"localhost"
,
6498
),
configuration
);
client
.
run
(
jG
,
true
);
exec
.
stop
();
}
catch
(
Exception
e
)
{
e
.
printStackTrace
();
}
assertEquals
(
1000
,
data
.
keySet
().
size
());
for
(
Integer
k
:
data
.
keySet
())
{
assertEquals
((
Integer
)
(
k
+
1
),
data
.
get
(
k
));
}
}
}
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录