Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
apache
Iotdb
提交
b24cdde3
I
Iotdb
项目概览
apache
/
Iotdb
12 个月 前同步成功
通知
25
Star
3344
Fork
916
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
I
Iotdb
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
b24cdde3
编写于
4月 08, 2020
作者:
仲
仲炜
提交者:
Jialin Qiao
4月 08, 2020
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
fix compile error caused by rebase and add a new test to help maintain the TSFileConfigUtil.
上级
4846b4aa
变更
3
隐藏空白更改
内联
并排
Showing
3 changed file
with
87 addition
and
3 deletion
+87
-3
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/TsFileInputFormat.java
...java/org/apache/iotdb/flink/tsfile/TsFileInputFormat.java
+2
-2
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/util/TSFileConfigUtil.java
.../org/apache/iotdb/flink/tsfile/util/TSFileConfigUtil.java
+1
-1
flink-tsfile-connector/src/test/java/org/apache/iotdb/flink/util/TSFileConfigUtilCompletenessTest.java
...he/iotdb/flink/util/TSFileConfigUtilCompletenessTest.java
+84
-0
未找到文件。
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/TsFileInputFormat.java
浏览文件 @
b24cdde3
...
...
@@ -36,7 +36,7 @@ import org.apache.iotdb.tsfile.read.TsFileSequenceReader;
import
org.apache.iotdb.tsfile.read.common.RowRecord
;
import
org.apache.iotdb.tsfile.read.expression.QueryExpression
;
import
org.apache.iotdb.tsfile.read.query.dataset.QueryDataSet
;
import
org.apache.iotdb.tsfile.read.reader.
Default
TsFileInput
;
import
org.apache.iotdb.tsfile.read.reader.
Local
TsFileInput
;
import
org.apache.iotdb.tsfile.read.reader.TsFileInput
;
import
javax.annotation.Nullable
;
...
...
@@ -102,7 +102,7 @@ public class TsFileInputFormat<T> extends FileInputFormat<T> implements ResultTy
hadoopConf
);
}
else
{
// Local File System
in
=
new
Default
TsFileInput
(
Paths
.
get
(
currentSplit
.
getPath
().
toUri
()));
in
=
new
Local
TsFileInput
(
Paths
.
get
(
currentSplit
.
getPath
().
toUri
()));
}
}
catch
(
URISyntaxException
e
)
{
throw
new
FlinkRuntimeException
(
e
);
...
...
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/util/TSFileConfigUtil.java
浏览文件 @
b24cdde3
...
...
@@ -58,7 +58,7 @@ public class TSFileConfigUtil {
globalConfig
.
setSdtMaxError
(
config
.
getSdtMaxError
());
globalConfig
.
setTimeEncoder
(
config
.
getTimeEncoder
());
globalConfig
.
setTimeSeriesDataType
(
config
.
getTimeSeriesDataType
());
globalConfig
.
setTSFileStorageFs
(
config
.
getTSFileStorageFs
()
.
toString
()
);
globalConfig
.
setTSFileStorageFs
(
config
.
getTSFileStorageFs
());
globalConfig
.
setUseKerberos
(
config
.
isUseKerberos
());
globalConfig
.
setValueEncoder
(
config
.
getValueEncoder
());
}
...
...
flink-tsfile-connector/src/test/java/org/apache/iotdb/flink/util/TSFileConfigUtilCompletenessTest.java
0 → 100644
浏览文件 @
b24cdde3
/*
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership. The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing,
* software distributed under the License is distributed on an
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
* KIND, either express or implied. See the License for the
* specific language governing permissions and limitations
* under the License.
*/
package
org.apache.iotdb.flink.util
;
import
org.apache.iotdb.tsfile.common.conf.TSFileConfig
;
import
org.junit.Test
;
import
java.lang.reflect.Method
;
import
java.util.Arrays
;
import
java.util.Set
;
import
java.util.stream.Collectors
;
import
static
org
.
junit
.
Assert
.
assertTrue
;
/**
* This test is used to help maintain the {@link org.apache.iotdb.flink.tsfile.util.TSFileConfigUtil}.
*/
public
class
TSFileConfigUtilCompletenessTest
{
@Test
public
void
testTSFileConfigUtilCompleteness
()
{
String
[]
addedSetters
=
{
"setBatchSize"
,
"setBloomFilterErrorRate"
,
"setCompressor"
,
"setCoreSitePath"
,
"setDeltaBlockSize"
,
"setDfsClientFailoverProxyProvider"
,
"setDfsHaAutomaticFailoverEnabled"
,
"setDfsHaNamenodes"
,
"setDfsNameServices"
,
"setDftSatisfyRate"
,
"setEndian"
,
"setFloatPrecision"
,
"setFreqType"
,
"setGroupSizeInByte"
,
"setHdfsIp"
,
"setHdfsPort"
,
"setHdfsSitePath"
,
"setKerberosKeytabFilePath"
,
"setKerberosPrincipal"
,
"setMaxNumberOfPointsInPage"
,
"setMaxStringLength"
,
"setPageCheckSizeThreshold"
,
"setPageSizeInByte"
,
"setPlaMaxError"
,
"setRleBitWidth"
,
"setSdtMaxError"
,
"setTimeEncoder"
,
"setTimeSeriesDataType"
,
"setTSFileStorageFs"
,
"setUseKerberos"
,
"setValueEncoder"
};
Set
<
String
>
newSetters
=
Arrays
.
stream
(
TSFileConfig
.
class
.
getMethods
())
.
map
(
Method:
:
getName
)
.
filter
(
s
->
s
.
startsWith
(
"set"
))
.
filter
(
s
->
!
Arrays
.
asList
(
addedSetters
).
contains
(
s
))
.
collect
(
Collectors
.
toSet
());
assertTrue
(
String
.
format
(
"New setters in TSFileConfig are detected, please add them to "
+
"org.apache.iotdb.flink.tsfile.util.TSFileConfigUtil. The setters need to be added: %s"
,
newSetters
),
newSetters
.
isEmpty
());
}
}
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录