Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
04a7cd4d
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
04a7cd4d
编写于
6月 14, 2018
作者:
S
sihuazhou
提交者:
zentol
7月 11, 2018
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[FLINK-9584][connector] Properly close output streams in Bucketing-/RollingSink
This closes #6164.
上级
5dbb6dda
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
8 addition
and
14 deletion
+8
-14
flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/RollingSink.java
...org/apache/flink/streaming/connectors/fs/RollingSink.java
+4
-7
flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java
...link/streaming/connectors/fs/bucketing/BucketingSink.java
+4
-7
未找到文件。
flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/RollingSink.java
浏览文件 @
04a7cd4d
...
...
@@ -533,12 +533,9 @@ public class RollingSink<T> extends RichSinkFunction<T>
}
// verify that truncate actually works
FSDataOutputStream
outputStream
;
Path
testPath
=
new
Path
(
UUID
.
randomUUID
().
toString
());
try
{
outputStream
=
fs
.
create
(
testPath
);
try
(
FSDataOutputStream
outputStream
=
fs
.
create
(
testPath
))
{
outputStream
.
writeUTF
(
"hello"
);
outputStream
.
close
();
}
catch
(
IOException
e
)
{
LOG
.
error
(
"Could not create file for checking if truncate works."
,
e
);
throw
new
RuntimeException
(
"Could not create file for checking if truncate works."
,
e
);
...
...
@@ -702,9 +699,9 @@ public class RollingSink<T> extends RichSinkFunction<T>
Path
validLengthFilePath
=
getValidLengthPathFor
(
partPath
);
if
(!
fs
.
exists
(
validLengthFilePath
)
&&
fs
.
exists
(
partPath
))
{
LOG
.
debug
(
"Writing valid-length file for {} to specify valid length {}"
,
partPath
,
bucketState
.
currentFileValidLength
);
FSDataOutputStream
lengthFileOut
=
fs
.
create
(
validLengthFilePath
);
lengthFileOut
.
writeUTF
(
Long
.
toString
(
bucketState
.
currentFileValidLength
));
lengthFileOut
.
close
();
try
(
FSDataOutputStream
lengthFileOut
=
fs
.
create
(
validLengthFilePath
))
{
lengthFileOut
.
writeUTF
(
Long
.
toString
(
bucketState
.
currentFileValidLength
));
}
}
}
...
...
flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java
浏览文件 @
04a7cd4d
...
...
@@ -631,12 +631,9 @@ public class BucketingSink<T>
}
// verify that truncate actually works
FSDataOutputStream
outputStream
;
Path
testPath
=
new
Path
(
UUID
.
randomUUID
().
toString
());
try
{
outputStream
=
fs
.
create
(
testPath
);
try
(
FSDataOutputStream
outputStream
=
fs
.
create
(
testPath
))
{
outputStream
.
writeUTF
(
"hello"
);
outputStream
.
close
();
}
catch
(
IOException
e
)
{
LOG
.
error
(
"Could not create file for checking if truncate works."
,
e
);
throw
new
RuntimeException
(
"Could not create file for checking if truncate works. "
+
...
...
@@ -880,9 +877,9 @@ public class BucketingSink<T>
Path
validLengthFilePath
=
getValidLengthPathFor
(
partPath
);
if
(!
fs
.
exists
(
validLengthFilePath
)
&&
fs
.
exists
(
partPath
))
{
LOG
.
debug
(
"Writing valid-length file for {} to specify valid length {}"
,
partPath
,
validLength
);
FSDataOutputStream
lengthFileOut
=
fs
.
create
(
validLengthFilePath
);
lengthFileOut
.
writeUTF
(
Long
.
toString
(
validLength
));
lengthFileOut
.
close
();
try
(
FSDataOutputStream
lengthFileOut
=
fs
.
create
(
validLengthFilePath
))
{
lengthFileOut
.
writeUTF
(
Long
.
toString
(
validLength
));
}
}
}
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录