Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doujutun3207
flink
提交
c8a23c74
F
flink
项目概览
doujutun3207
/
flink
与 Fork 源项目一致
从无法访问的项目Fork
通知
24
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
F
flink
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
未验证
提交
c8a23c74
编写于
4月 02, 2020
作者:
J
Jingsong Lee
提交者:
GitHub
4月 02, 2020
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
[FLINK-16860][orc] Distinguish empty filters from no pushed down in expainSource
This closes #11594
上级
9ffa85aa
变更
2
隐藏空白更改
内联
并排
Showing
2 changed file
with
34 addition
and
14 deletion
+34
-14
flink-formats/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java
...rc/src/main/java/org/apache/flink/orc/OrcTableSource.java
+3
-1
flink-formats/flink-orc/src/test/java/org/apache/flink/orc/OrcTableSourceTest.java
...rc/test/java/org/apache/flink/orc/OrcTableSourceTest.java
+31
-13
未找到文件。
flink-formats/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java
浏览文件 @
c8a23c74
...
...
@@ -218,7 +218,9 @@ public class OrcTableSource
}
private
String
predicateString
()
{
if
(
predicates
==
null
||
predicates
.
length
==
0
)
{
if
(
predicates
==
null
)
{
return
"NULL"
;
}
else
if
(
predicates
.
length
==
0
)
{
return
"TRUE"
;
}
else
{
return
"AND("
+
Arrays
.
toString
(
predicates
)
+
")"
;
...
...
flink-formats/flink-orc/src/test/java/org/apache/flink/orc/OrcTableSourceTest.java
浏览文件 @
c8a23c74
...
...
@@ -44,12 +44,14 @@ import org.junit.Test;
import
org.mockito.ArgumentCaptor
;
import
java.util.ArrayList
;
import
java.util.Collections
;
import
java.util.List
;
import
java.util.stream.Collectors
;
import
static
org
.
junit
.
Assert
.
assertArrayEquals
;
import
static
org
.
junit
.
Assert
.
assertEquals
;
import
static
org
.
junit
.
Assert
.
assertFalse
;
import
static
org
.
junit
.
Assert
.
assertNotEquals
;
import
static
org
.
junit
.
Assert
.
assertNotNull
;
import
static
org
.
junit
.
Assert
.
assertTrue
;
import
static
org
.
mockito
.
Matchers
.
any
;
...
...
@@ -184,18 +186,6 @@ public class OrcTableSourceTest {
Expression
pred2
=
new
EqualTo
(
new
PlannerResolvedFieldReference
(
"string1"
,
Types
.
STRING
),
new
Literal
(
"hello"
,
Types
.
STRING
));
// unsupported predicate
Expression
unsupportedPred
=
new
EqualTo
(
new
GetCompositeField
(
new
ItemAt
(
new
PlannerResolvedFieldReference
(
"list"
,
ObjectArrayTypeInfo
.
getInfoFor
(
Types
.
ROW_NAMED
(
new
String
[]
{
"int1"
,
"string1"
},
Types
.
INT
,
Types
.
STRING
))),
new
Literal
(
1
,
Types
.
INT
)),
"int1"
),
new
Literal
(
1
,
Types
.
INT
)
);
// invalid predicate
Expression
invalidPred
=
new
EqualTo
(
new
PlannerResolvedFieldReference
(
"long1"
,
Types
.
LONG
),
...
...
@@ -206,7 +196,7 @@ public class OrcTableSourceTest {
ArrayList
<
Expression
>
preds
=
new
ArrayList
<>();
preds
.
add
(
pred1
);
preds
.
add
(
pred2
);
preds
.
add
(
unsupportedPred
);
preds
.
add
(
unsupportedPred
()
);
preds
.
add
(
invalidPred
);
// apply predicates on TableSource
...
...
@@ -244,6 +234,34 @@ public class OrcTableSourceTest {
assertFalse
(
orc
.
isFilterPushedDown
());
}
private
Expression
unsupportedPred
()
{
return
new
EqualTo
(
new
GetCompositeField
(
new
ItemAt
(
new
PlannerResolvedFieldReference
(
"list"
,
ObjectArrayTypeInfo
.
getInfoFor
(
Types
.
ROW_NAMED
(
new
String
[]
{
"int1"
,
"string1"
},
Types
.
INT
,
Types
.
STRING
))),
new
Literal
(
1
,
Types
.
INT
)),
"int1"
),
new
Literal
(
1
,
Types
.
INT
)
);
}
@Test
public
void
testUnsupportedPredOnly
()
{
OrcTableSource
orc
=
OrcTableSource
.
builder
()
.
path
(
getPath
(
TEST_FILE_NESTED
))
.
forOrcSchema
(
TEST_SCHEMA_NESTED
)
.
build
();
// apply predicates on TableSource
OrcTableSource
projected
=
(
OrcTableSource
)
orc
.
applyPredicate
(
Collections
.
singletonList
(
unsupportedPred
()));
assertNotEquals
(
orc
.
explainSource
(),
projected
.
explainSource
());
}
@Test
public
void
testBuilder
()
throws
Exception
{
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录