Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
bcd83c45
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
未验证
提交
bcd83c45
编写于
2月 17, 2018
作者:
B
Bill Lee
提交者:
Dawid Wysakowicz
7月 15, 2018
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[FLINK-8544] Handle null message key and value in JSONKeyValueDeserializationSchema
This closes #5516
上级
afb8f825
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
40 addition
and
2 deletion
+40
-2
flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/util/serialization/JSONKeyValueDeserializationSchema.java
...util/serialization/JSONKeyValueDeserializationSchema.java
+6
-2
flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/JSONKeyValueDeserializationSchemaTest.java
...nnectors/kafka/JSONKeyValueDeserializationSchemaTest.java
+34
-0
未找到文件。
flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/util/serialization/JSONKeyValueDeserializationSchema.java
浏览文件 @
bcd83c45
...
...
@@ -56,8 +56,12 @@ public class JSONKeyValueDeserializationSchema implements KeyedDeserializationSc
mapper
=
new
ObjectMapper
();
}
ObjectNode
node
=
mapper
.
createObjectNode
();
node
.
set
(
"key"
,
mapper
.
readValue
(
messageKey
,
JsonNode
.
class
));
node
.
set
(
"value"
,
mapper
.
readValue
(
message
,
JsonNode
.
class
));
if
(
messageKey
!=
null
)
{
node
.
set
(
"key"
,
mapper
.
readValue
(
messageKey
,
JsonNode
.
class
));
}
if
(
message
!=
null
)
{
node
.
set
(
"value"
,
mapper
.
readValue
(
message
,
JsonNode
.
class
));
}
if
(
includeMetadata
)
{
node
.
putObject
(
"metadata"
)
.
put
(
"offset"
,
offset
)
...
...
flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/JSONKeyValueDeserializationSchemaTest.java
浏览文件 @
bcd83c45
...
...
@@ -50,6 +50,40 @@ public class JSONKeyValueDeserializationSchemaTest {
Assert
.
assertEquals
(
"world"
,
deserializedValue
.
get
(
"value"
).
get
(
"word"
).
asText
());
}
@Test
public
void
testDeserializeWithoutKey
()
throws
IOException
{
ObjectMapper
mapper
=
new
ObjectMapper
();
byte
[]
serializedKey
=
null
;
ObjectNode
initialValue
=
mapper
.
createObjectNode
();
initialValue
.
put
(
"word"
,
"world"
);
byte
[]
serializedValue
=
mapper
.
writeValueAsBytes
(
initialValue
);
JSONKeyValueDeserializationSchema
schema
=
new
JSONKeyValueDeserializationSchema
(
false
);
ObjectNode
deserializedValue
=
schema
.
deserialize
(
serializedKey
,
serializedValue
,
""
,
0
,
0
);
Assert
.
assertTrue
(
deserializedValue
.
get
(
"metadata"
)
==
null
);
Assert
.
assertTrue
(
deserializedValue
.
get
(
"key"
)
==
null
);
Assert
.
assertEquals
(
"world"
,
deserializedValue
.
get
(
"value"
).
get
(
"word"
).
asText
());
}
@Test
public
void
testDeserializeWithoutValue
()
throws
IOException
{
ObjectMapper
mapper
=
new
ObjectMapper
();
ObjectNode
initialKey
=
mapper
.
createObjectNode
();
initialKey
.
put
(
"index"
,
4
);
byte
[]
serializedKey
=
mapper
.
writeValueAsBytes
(
initialKey
);
byte
[]
serializedValue
=
null
;
JSONKeyValueDeserializationSchema
schema
=
new
JSONKeyValueDeserializationSchema
(
false
);
ObjectNode
deserializedValue
=
schema
.
deserialize
(
serializedKey
,
serializedValue
,
""
,
0
,
0
);
Assert
.
assertTrue
(
deserializedValue
.
get
(
"metadata"
)
==
null
);
Assert
.
assertEquals
(
4
,
deserializedValue
.
get
(
"key"
).
get
(
"index"
).
asInt
());
Assert
.
assertTrue
(
deserializedValue
.
get
(
"value"
)
==
null
);
}
@Test
public
void
testDeserializeWithMetadata
()
throws
IOException
{
ObjectMapper
mapper
=
new
ObjectMapper
();
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录