Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
openeuler
A-Tune
提交
6cbc6f4f
A
A-Tune
项目概览
openeuler
/
A-Tune
通知
5
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
A
A-Tune
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
6cbc6f4f
编写于
8月 27, 2020
作者:
O
openeuler-ci-bot
提交者:
Gitee
8月 27, 2020
浏览文件
操作
浏览文件
下载
差异文件
!161 bug fixing for abnormal detection function
Merge pull request !161 from xiaotongji/master
上级
ddd43d02
dcf7dd70
变更
1
显示空白变更内容
内联
并排
Showing
1 changed file
with
7 addition
and
10 deletion
+7
-10
analysis/optimizer/workload_characterization.py
analysis/optimizer/workload_characterization.py
+7
-10
未找到文件。
analysis/optimizer/workload_characterization.py
浏览文件 @
6cbc6f4f
...
...
@@ -64,31 +64,29 @@ class WorkloadCharacterization:
"""
detect abnormal data points
:param x_axis: the input data
:returns
x_axis
: filtered data
:returns
result
: filtered data
"""
bool_normal
=
(
x_axis
.
mean
()
-
3
*
x_axis
.
std
()
<=
x_axis
)
&
\
(
x_axis
<=
x_axis
.
mean
()
+
3
*
x_axis
.
std
())
x_axis
[
bool_normal
].
dropna
(
axis
=
0
,
how
=
'any'
)
return
x_axis
result
=
x_axis
[
bool_normal
]
return
result
def
parsing
(
self
,
data_path
,
header
=
0
,
analysis
=
False
):
"""
parse the data from csv
:param data_path: the path of csv
:returns dataset: converted data
"""
df_content
=
[]
csvfiles
=
glob
.
glob
(
data_path
)
selected_cols
=
self
.
data_features
selected_cols
=
list
(
self
.
data_features
)
selected_cols
.
append
(
'workload.type'
)
selected_cols
.
append
(
'workload.appname'
)
for
csv
in
csvfiles
:
data
=
pd
.
read_csv
(
csv
,
index_col
=
None
,
header
=
header
,
usecols
=
selected_cols
)
data
=
self
.
abnormal_detection
(
data
)
df_content
.
append
(
data
)
dataset
=
pd
.
concat
(
df_content
,
sort
=
False
)
self
.
dataset
=
dataset
data
[
self
.
data_features
]
=
self
.
abnormal_detection
(
data
[
self
.
data_features
])
df_content
.
append
(
data
.
dropna
(
axis
=
0
))
self
.
dataset
=
pd
.
concat
(
df_content
,
sort
=
False
)
if
analysis
:
status_content
=
[]
for
app
,
group
in
self
.
dataset
.
groupby
(
'workload.appname'
):
...
...
@@ -97,7 +95,6 @@ class WorkloadCharacterization:
status_content
.
append
(
status
)
total_status
=
pd
.
concat
(
status_content
,
sort
=
False
)
total_status
.
to_csv
(
'statistics.csv'
)
return
dataset
def
feature_selection
(
self
,
x_axis
,
y_axis
,
clfpath
=
None
):
"""
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录