Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
DiDi
kafka-manager
提交
36e3d6c1
K
kafka-manager
项目概览
DiDi
/
kafka-manager
8 个月 前同步成功
通知
58
Star
6372
Fork
1229
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
K
kafka-manager
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
前往新版Gitcode,体验更适合开发者的 AI 搜索 >>
提交
36e3d6c1
编写于
11月 22, 2020
作者:
Z
zengqiao
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
修复上报夜莺功能
上级
fb20cf60
变更
20
隐藏空白更改
内联
并排
Showing
20 changed file
with
357 addition
and
194 deletion
+357
-194
kafka-manager-extends/kafka-manager-account/src/main/java/com/xiaojukeji/kafka/manager/account/common/entry/N9eResult.java
...ojukeji/kafka/manager/account/common/entry/N9eResult.java
+35
-0
kafka-manager-extends/kafka-manager-account/src/main/java/com/xiaojukeji/kafka/manager/account/common/entry/N9eUserData.java
...ukeji/kafka/manager/account/common/entry/N9eUserData.java
+134
-0
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/MonitorSinkConstant.java
...eji/kafka/manager/monitor/common/MonitorSinkConstant.java
+0
-2
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/MetricSinkPoint.java
...i/kafka/manager/monitor/common/entry/MetricSinkPoint.java
+30
-17
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/AbstractMonitorKafkaSinkTag.java
...onitor/common/entry/sink/AbstractMonitorKafkaSinkTag.java
+13
-0
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/AbstractMonitorSinkTag.java
...ger/monitor/common/entry/sink/AbstractMonitorSinkTag.java
+9
-0
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorBaseSinkTag.java
...manager/monitor/common/entry/sink/MonitorBaseSinkTag.java
+0
-31
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorConsumePartitionSinkTag.java
...tor/common/entry/sink/MonitorConsumePartitionSinkTag.java
+8
-12
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorConsumeTopicSinkTag.java
...monitor/common/entry/sink/MonitorConsumeTopicSinkTag.java
+28
-0
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorKafkaBaseSinkTag.java
...er/monitor/common/entry/sink/MonitorKafkaBaseSinkTag.java
+0
-30
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorPartitionSinkTag.java
...er/monitor/common/entry/sink/MonitorPartitionSinkTag.java
+29
-0
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorTopicSinkTag.java
...anager/monitor/common/entry/sink/MonitorTopicSinkTag.java
+9
-14
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorTopicThrottledSinkTag.java
...nitor/common/entry/sink/MonitorTopicThrottledSinkTag.java
+5
-29
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/component/n9e/N9eConverter.java
...eji/kafka/manager/monitor/component/n9e/N9eConverter.java
+2
-1
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/component/n9e/N9eService.java
...ukeji/kafka/manager/monitor/component/n9e/N9eService.java
+16
-14
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/component/n9e/entry/N9eMetricSinkPoint.java
...nager/monitor/component/n9e/entry/N9eMetricSinkPoint.java
+29
-28
kafka-manager-task/src/main/java/com/xiaojukeji/kafka/manager/task/dispatch/metrics/store/SinkCommunityTopicMetrics2Monitor.java
...atch/metrics/store/SinkCommunityTopicMetrics2Monitor.java
+0
-3
kafka-manager-task/src/main/java/com/xiaojukeji/kafka/manager/task/listener/SinkConsumerMetrics2Monitor.java
...ka/manager/task/listener/SinkConsumerMetrics2Monitor.java
+3
-6
kafka-manager-task/src/main/java/com/xiaojukeji/kafka/manager/task/listener/SinkTopicThrottledMetrics2Monitor.java
...ager/task/listener/SinkTopicThrottledMetrics2Monitor.java
+0
-2
kafka-manager-web/src/main/resources/application.yml
kafka-manager-web/src/main/resources/application.yml
+7
-5
未找到文件。
kafka-manager-extends/kafka-manager-account/src/main/java/com/xiaojukeji/kafka/manager/account/common/entry/N9eResult.java
0 → 100644
浏览文件 @
36e3d6c1
package
com.xiaojukeji.kafka.manager.account.common.entry
;
/**
* @author zengqiao
* @date 20/9/7
*/
public
class
N9eResult
<
T
>
{
private
T
dat
;
private
String
err
;
public
T
getDat
()
{
return
dat
;
}
public
void
setDat
(
T
dat
)
{
this
.
dat
=
dat
;
}
public
String
getErr
()
{
return
err
;
}
public
void
setErr
(
String
err
)
{
this
.
err
=
err
;
}
@Override
public
String
toString
()
{
return
"N9eResult{"
+
"dat="
+
dat
+
", err='"
+
err
+
'\''
+
'}'
;
}
}
\ No newline at end of file
kafka-manager-extends/kafka-manager-account/src/main/java/com/xiaojukeji/kafka/manager/account/common/entry/N9eUserData.java
0 → 100644
浏览文件 @
36e3d6c1
package
com.xiaojukeji.kafka.manager.account.common.entry
;
/**
* @author zengqiao
* @date 20/9/7
*/
public
class
N9eUserData
{
private
Long
id
;
private
String
uuid
;
private
String
username
;
private
String
dispname
;
private
String
phone
;
private
String
email
;
private
String
im
;
private
String
portrait
;
private
Integer
is_root
;
private
Integer
leader_id
;
private
String
leader_name
;
public
Long
getId
()
{
return
id
;
}
public
void
setId
(
Long
id
)
{
this
.
id
=
id
;
}
public
String
getUuid
()
{
return
uuid
;
}
public
void
setUuid
(
String
uuid
)
{
this
.
uuid
=
uuid
;
}
public
String
getUsername
()
{
return
username
;
}
public
void
setUsername
(
String
username
)
{
this
.
username
=
username
;
}
public
String
getDispname
()
{
return
dispname
;
}
public
void
setDispname
(
String
dispname
)
{
this
.
dispname
=
dispname
;
}
public
String
getPhone
()
{
return
phone
;
}
public
void
setPhone
(
String
phone
)
{
this
.
phone
=
phone
;
}
public
String
getEmail
()
{
return
email
;
}
public
void
setEmail
(
String
email
)
{
this
.
email
=
email
;
}
public
String
getIm
()
{
return
im
;
}
public
void
setIm
(
String
im
)
{
this
.
im
=
im
;
}
public
String
getPortrait
()
{
return
portrait
;
}
public
void
setPortrait
(
String
portrait
)
{
this
.
portrait
=
portrait
;
}
public
Integer
getIs_root
()
{
return
is_root
;
}
public
void
setIs_root
(
Integer
is_root
)
{
this
.
is_root
=
is_root
;
}
public
Integer
getLeader_id
()
{
return
leader_id
;
}
public
void
setLeader_id
(
Integer
leader_id
)
{
this
.
leader_id
=
leader_id
;
}
public
String
getLeader_name
()
{
return
leader_name
;
}
public
void
setLeader_name
(
String
leader_name
)
{
this
.
leader_name
=
leader_name
;
}
@Override
public
String
toString
()
{
return
"EPRIResult{"
+
"id="
+
id
+
", uuid='"
+
uuid
+
'\''
+
", username='"
+
username
+
'\''
+
", dispname='"
+
dispname
+
'\''
+
", phone='"
+
phone
+
'\''
+
", email='"
+
email
+
'\''
+
", im='"
+
im
+
'\''
+
", portrait='"
+
portrait
+
'\''
+
", is_root="
+
is_root
+
", leader_id="
+
leader_id
+
", leader_name='"
+
leader_name
+
'\''
+
'}'
;
}
}
\ No newline at end of file
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/MonitorSinkConstant.java
浏览文件 @
36e3d6c1
...
...
@@ -5,8 +5,6 @@ package com.xiaojukeji.kafka.manager.monitor.common;
* @date 17/5/24.
*/
public
class
MonitorSinkConstant
{
public
static
final
String
MONITOR_SYSTEM_TAG_DEFAULT_HOST
=
"kafka-manager-ser01.ys01"
;
/**
* 指标名前缀
*/
...
...
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/MetricSinkPoint.java
浏览文件 @
36e3d6c1
package
com.xiaojukeji.kafka.manager.monitor.common.entry
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.sink.MonitorBaseSinkTag
;
import
java.text.DecimalFormat
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.sink.AbstractMonitorSinkTag
;
/**
* @author huangjw
...
...
@@ -17,7 +15,7 @@ public class MetricSinkPoint {
/**
* 指标值
*/
private
String
value
;
private
Double
value
;
/**
* 上报周期
...
...
@@ -32,16 +30,11 @@ public class MetricSinkPoint {
/**
* tags
*/
private
MonitorBaseSinkTag
tags
;
private
static
final
DecimalFormat
DECIMAL_FORMAT
=
new
DecimalFormat
(
"0.00"
);
private
AbstractMonitorSinkTag
tags
;
public
MetricSinkPoint
(
String
name
,
double
value
,
int
step
,
long
timestamp
,
MonitorBaseSinkTag
tags
)
{
if
(
value
<=
0.001
)
{
value
=
0.0
;
}
public
MetricSinkPoint
(
String
name
,
double
value
,
int
step
,
long
timestamp
,
AbstractMonitorSinkTag
tags
)
{
this
.
name
=
name
;
this
.
value
=
DECIMAL_FORMAT
.
format
(
value
)
;
this
.
value
=
value
;
this
.
step
=
step
;
this
.
timestamp
=
timestamp
;
this
.
tags
=
tags
;
...
...
@@ -51,25 +44,45 @@ public class MetricSinkPoint {
return
name
;
}
public
String
getValue
()
{
public
void
setName
(
String
name
)
{
this
.
name
=
name
;
}
public
Double
getValue
()
{
return
value
;
}
public
void
setValue
(
Double
value
)
{
this
.
value
=
value
;
}
public
int
getStep
()
{
return
step
;
}
public
void
setStep
(
int
step
)
{
this
.
step
=
step
;
}
public
long
getTimestamp
()
{
return
timestamp
;
}
public
MonitorBaseSinkTag
getTags
()
{
public
void
setTimestamp
(
long
timestamp
)
{
this
.
timestamp
=
timestamp
;
}
public
AbstractMonitorSinkTag
getTags
()
{
return
tags
;
}
public
int
getStep
(
)
{
return
step
;
public
void
setTags
(
AbstractMonitorSinkTag
tags
)
{
this
.
tags
=
tags
;
}
@Override
public
String
toString
()
{
return
"MetricPoint{"
+
return
"Metric
Sink
Point{"
+
"name='"
+
name
+
'\''
+
", value='"
+
value
+
'\''
+
", timestamp="
+
timestamp
+
...
...
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/AbstractMonitorKafkaSinkTag.java
0 → 100644
浏览文件 @
36e3d6c1
package
com.xiaojukeji.kafka.manager.monitor.common.entry.sink
;
/**
* @author zengqiao
* @date 20/5/24
*/
public
abstract
class
AbstractMonitorKafkaSinkTag
extends
AbstractMonitorSinkTag
{
protected
String
cluster
;
public
AbstractMonitorKafkaSinkTag
(
String
cluster
)
{
this
.
cluster
=
cluster
;
}
}
\ No newline at end of file
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/AbstractMonitorSinkTag.java
0 → 100644
浏览文件 @
36e3d6c1
package
com.xiaojukeji.kafka.manager.monitor.common.entry.sink
;
/**
* @author zengqiao
* @date 20/5/24
*/
public
abstract
class
AbstractMonitorSinkTag
{
public
abstract
String
convert2Tags
();
}
\ No newline at end of file
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorBaseSinkTag.java
已删除
100644 → 0
浏览文件 @
fb20cf60
package
com.xiaojukeji.kafka.manager.monitor.common.entry.sink
;
/**
* @author zengqiao
* @date 20/5/24
*/
public
class
MonitorBaseSinkTag
{
/**
* 主机名
*/
protected
String
host
;
public
MonitorBaseSinkTag
(
String
host
)
{
this
.
host
=
host
;
}
public
String
getHost
()
{
return
host
;
}
public
void
setHost
(
String
host
)
{
this
.
host
=
host
;
}
@Override
public
String
toString
()
{
return
"BaseTag{"
+
"host='"
+
host
+
'\''
+
'}'
;
}
}
\ No newline at end of file
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorConsumePartitionSinkTag.java
浏览文件 @
36e3d6c1
...
...
@@ -4,19 +4,11 @@ package com.xiaojukeji.kafka.manager.monitor.common.entry.sink;
* @author zengqiao
* @date 20/09/02
*/
public
class
MonitorConsumePartitionSinkTag
extends
Monitor
Topic
PartitionSinkTag
{
public
class
MonitorConsumePartitionSinkTag
extends
MonitorPartitionSinkTag
{
private
String
consumerGroup
;
public
MonitorConsumePartitionSinkTag
(
String
host
,
String
cluster
,
String
topic
,
Integer
partition
,
String
consumerGroup
)
{
super
(
host
,
cluster
,
topic
,
partition
);
this
.
consumerGroup
=
consumerGroup
;
}
public
String
getConsumerGroup
()
{
return
consumerGroup
;
}
public
void
setConsumerGroup
(
String
consumerGroup
)
{
public
MonitorConsumePartitionSinkTag
(
String
cluster
,
String
topic
,
Integer
partition
,
String
consumerGroup
)
{
super
(
cluster
,
topic
,
partition
);
this
.
consumerGroup
=
consumerGroup
;
}
...
...
@@ -27,7 +19,11 @@ public class MonitorConsumePartitionSinkTag extends MonitorTopicPartitionSinkTag
", topic='"
+
topic
+
'\''
+
", partition='"
+
partition
+
'\''
+
", cluster='"
+
cluster
+
'\''
+
", host='"
+
host
+
'\''
+
'}'
;
}
@Override
public
String
convert2Tags
()
{
return
String
.
format
(
"cluster=%s,topic=%s,partition=%s,consumerGroup=%s"
,
cluster
,
topic
,
partition
,
consumerGroup
);
}
}
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorConsume
r
SinkTag.java
→
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorConsume
Topic
SinkTag.java
浏览文件 @
36e3d6c1
...
...
@@ -4,40 +4,25 @@ package com.xiaojukeji.kafka.manager.monitor.common.entry.sink;
* @author huangjw
* @date 17/5/25.
*/
public
class
MonitorConsumerSinkTag
extends
MonitorKafkaBaseSinkTag
{
private
String
topic
;
public
class
MonitorConsumeTopicSinkTag
extends
MonitorTopicSinkTag
{
private
String
consumerGroup
;
public
MonitorConsumerSinkTag
(
String
host
,
String
cluster
,
String
topic
,
String
consumerGroup
)
{
super
(
host
,
cluster
);
this
.
topic
=
topic
;
this
.
consumerGroup
=
consumerGroup
;
}
public
String
getTopic
()
{
return
topic
;
}
public
void
setTopic
(
String
topic
)
{
this
.
topic
=
topic
;
}
public
String
getConsumerGroup
()
{
return
consumerGroup
;
}
public
void
setConsumerGroup
(
String
consumerGroup
)
{
public
MonitorConsumeTopicSinkTag
(
String
cluster
,
String
topic
,
String
consumerGroup
)
{
super
(
cluster
,
topic
);
this
.
consumerGroup
=
consumerGroup
;
}
@Override
public
String
toString
()
{
return
"MonitorConsume
r
SinkTag{"
+
"
topic='"
+
topic
+
'\''
+
",
consumerGroup='"
+
consumerGroup
+
'\''
+
return
"MonitorConsume
Topic
SinkTag{"
+
"
consumerGroup='"
+
consumerGroup
+
'\''
+
",
topic='"
+
topic
+
'\''
+
", cluster='"
+
cluster
+
'\''
+
", host='"
+
host
+
'\''
+
'}'
;
}
@Override
public
String
convert2Tags
()
{
return
String
.
format
(
"cluster=%s,topic=%s,consumerGroup=%s"
,
cluster
,
topic
,
consumerGroup
);
}
}
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorKafkaBaseSinkTag.java
已删除
100644 → 0
浏览文件 @
fb20cf60
package
com.xiaojukeji.kafka.manager.monitor.common.entry.sink
;
/**
* @author zengqiao
* @date 20/5/24
*/
public
class
MonitorKafkaBaseSinkTag
extends
MonitorBaseSinkTag
{
protected
String
cluster
;
public
MonitorKafkaBaseSinkTag
(
String
host
,
String
cluster
)
{
super
(
host
);
this
.
cluster
=
cluster
;
}
public
String
getCluster
()
{
return
cluster
;
}
public
void
setCluster
(
String
cluster
)
{
this
.
cluster
=
cluster
;
}
@Override
public
String
toString
()
{
return
"MonitorKafkaBaseSinkTag{"
+
"cluster='"
+
cluster
+
'\''
+
", host='"
+
host
+
'\''
+
'}'
;
}
}
\ No newline at end of file
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/Monitor
Topic
PartitionSinkTag.java
→
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorPartitionSinkTag.java
浏览文件 @
36e3d6c1
...
...
@@ -4,40 +4,26 @@ package com.xiaojukeji.kafka.manager.monitor.common.entry.sink;
* @author zengqiao
* @date 20/9/3
*/
public
class
MonitorTopicPartitionSinkTag
extends
MonitorKafkaBaseSinkTag
{
protected
String
topic
;
public
class
MonitorPartitionSinkTag
extends
MonitorTopicSinkTag
{
protected
String
partition
;
public
Monitor
TopicPartitionSinkTag
(
String
host
,
String
cluster
,
String
topic
,
Integer
partition
)
{
super
(
host
,
cluster
);
public
Monitor
PartitionSinkTag
(
String
cluster
,
String
topic
,
Integer
partition
)
{
super
(
cluster
,
topic
);
this
.
topic
=
topic
;
this
.
partition
=
String
.
valueOf
(
partition
);
}
public
String
getTopic
()
{
return
topic
;
}
public
void
setTopic
(
String
topic
)
{
this
.
topic
=
topic
;
}
public
String
getPartition
()
{
return
partition
;
}
public
void
setPartition
(
String
partition
)
{
this
.
partition
=
partition
;
}
@Override
public
String
toString
()
{
return
"Monitor
Topic
PartitionSinkTag{"
+
return
"MonitorPartitionSinkTag{"
+
"topic='"
+
topic
+
'\''
+
", partition='"
+
partition
+
'\''
+
", cluster='"
+
cluster
+
'\''
+
", host='"
+
host
+
'\''
+
'}'
;
}
@Override
public
String
convert2Tags
()
{
return
String
.
format
(
"cluster=%s,topic=%s,partition=%s"
,
cluster
,
topic
,
partition
);
}
}
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorTopicSinkTag.java
浏览文件 @
36e3d6c1
...
...
@@ -4,20 +4,11 @@ package com.xiaojukeji.kafka.manager.monitor.common.entry.sink;
* @author huangjw
* @date 17/5/24.
*/
public
class
MonitorTopicSinkTag
extends
MonitorKafkaBaseSinkTag
{
public
class
MonitorTopicSinkTag
extends
AbstractMonitorKafkaSinkTag
{
protected
String
topic
;
private
String
topic
;
public
MonitorTopicSinkTag
(
String
host
,
String
cluster
,
String
topic
)
{
super
(
host
,
cluster
);
this
.
topic
=
topic
;
}
public
String
getTopic
()
{
return
topic
;
}
public
void
setTopic
(
String
topic
)
{
public
MonitorTopicSinkTag
(
String
cluster
,
String
topic
)
{
super
(
cluster
);
this
.
topic
=
topic
;
}
...
...
@@ -26,7 +17,11 @@ public class MonitorTopicSinkTag extends MonitorKafkaBaseSinkTag {
return
"MonitorTopicSinkTag{"
+
"topic='"
+
topic
+
'\''
+
", cluster='"
+
cluster
+
'\''
+
", host='"
+
host
+
'\''
+
'}'
;
}
@Override
public
String
convert2Tags
()
{
return
String
.
format
(
"cluster=%s,topic=%s"
,
cluster
,
topic
);
}
}
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/common/entry/sink/MonitorTopicThrottledSinkTag.java
浏览文件 @
36e3d6c1
...
...
@@ -4,40 +4,16 @@ package com.xiaojukeji.kafka.manager.monitor.common.entry.sink;
* @author crius
* @date 19/5/21.
*/
public
class
MonitorTopicThrottledSinkTag
extends
MonitorKafkaBaseSinkTag
{
private
String
topic
;
public
class
MonitorTopicThrottledSinkTag
extends
MonitorTopicSinkTag
{
private
String
appId
;
public
MonitorTopicThrottledSinkTag
(
String
host
,
String
cluster
,
String
topic
,
String
appId
)
{
super
(
host
,
cluster
);
this
.
topic
=
topic
;
this
.
appId
=
appId
;
}
public
String
getTopic
()
{
return
topic
;
}
public
void
setTopic
(
String
topic
)
{
this
.
topic
=
topic
;
}
public
String
getAppId
()
{
return
appId
;
}
public
void
setAppId
(
String
appId
)
{
public
MonitorTopicThrottledSinkTag
(
String
cluster
,
String
topic
,
String
appId
)
{
super
(
cluster
,
topic
);
this
.
appId
=
appId
;
}
@Override
public
String
toString
()
{
return
"MonitorTopicThrottledSinkTag{"
+
"topic='"
+
topic
+
'\''
+
", appId='"
+
appId
+
'\''
+
", cluster='"
+
cluster
+
'\''
+
", host='"
+
host
+
'\''
+
'}'
;
public
String
convert2Tags
()
{
return
String
.
format
(
"cluster=%s,topic=%s,appId=%s"
,
cluster
,
topic
,
appId
);
}
}
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/component/n9e/N9eConverter.java
浏览文件 @
36e3d6c1
...
...
@@ -13,13 +13,14 @@ import java.util.List;
* @date 20/8/26
*/
public
class
N9eConverter
{
public
static
List
<
N9eMetricSinkPoint
>
convert2N9eMetricSinkPointList
(
List
<
MetricSinkPoint
>
pointList
)
{
public
static
List
<
N9eMetricSinkPoint
>
convert2N9eMetricSinkPointList
(
String
nid
,
List
<
MetricSinkPoint
>
pointList
)
{
if
(
pointList
==
null
||
pointList
.
isEmpty
())
{
return
new
ArrayList
<>();
}
List
<
N9eMetricSinkPoint
>
n9ePointList
=
new
ArrayList
<>();
for
(
MetricSinkPoint
sinkPoint:
pointList
)
{
n9ePointList
.
add
(
new
N9eMetricSinkPoint
(
nid
,
sinkPoint
.
getName
(),
sinkPoint
.
getValue
(),
sinkPoint
.
getStep
(),
...
...
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/component/n9e/N9eService.java
浏览文件 @
36e3d6c1
...
...
@@ -28,10 +28,13 @@ public class N9eService extends AbstractMonitorService {
private
Integer
monitorN9eNid
;
@Value
(
"${monitor.n9e.user-token}"
)
private
String
monitorN9eToken
;
private
String
monitorN9e
User
Token
;
@Value
(
"${monitor.n9e.base-url}"
)
private
String
monitorN9eBaseUrl
;
@Value
(
"${monitor.n9e.mon.base-url}"
)
private
String
monitorN9eMonBaseUrl
;
@Value
(
"${monitor.n9e.sink.base-url}"
)
private
String
monitorN9eSinkBaseUrl
;
/**
* 告警策略
...
...
@@ -82,7 +85,7 @@ public class N9eService extends AbstractMonitorService {
String
response
=
null
;
try
{
response
=
HttpUtils
.
postForString
(
monitorN9eBaseUrl
+
STRATEGY_ADD_URL
,
monitorN9e
Mon
BaseUrl
+
STRATEGY_ADD_URL
,
JSON
.
toJSONString
(
N9eConverter
.
convert2N9eStrategy
(
strategy
,
monitorN9eNid
)),
buildHeader
()
);
...
...
@@ -106,7 +109,7 @@ public class N9eService extends AbstractMonitorService {
String
response
=
null
;
try
{
response
=
HttpUtils
.
deleteForString
(
monitorN9eBaseUrl
+
STRATEGY_DEL_URL
,
monitorN9e
Mon
BaseUrl
+
STRATEGY_DEL_URL
,
JSON
.
toJSONString
(
params
),
buildHeader
()
);
...
...
@@ -127,7 +130,7 @@ public class N9eService extends AbstractMonitorService {
String
response
=
null
;
try
{
response
=
HttpUtils
.
putForString
(
monitorN9eBaseUrl
+
STRATEGY_MODIFY_URL
,
monitorN9e
Mon
BaseUrl
+
STRATEGY_MODIFY_URL
,
JSON
.
toJSONString
(
N9eConverter
.
convert2N9eStrategy
(
strategy
,
monitorN9eNid
)),
buildHeader
()
);
...
...
@@ -150,7 +153,7 @@ public class N9eService extends AbstractMonitorService {
String
response
=
null
;
try
{
response
=
HttpUtils
.
get
(
monitorN9eBaseUrl
+
STRATEGY_QUERY_BY_NS_URL
,
params
,
buildHeader
());
response
=
HttpUtils
.
get
(
monitorN9e
Mon
BaseUrl
+
STRATEGY_QUERY_BY_NS_URL
,
params
,
buildHeader
());
N9eResult
n9eResult
=
JSON
.
parseObject
(
response
,
N9eResult
.
class
);
if
(!
ValidateUtils
.
isBlank
(
n9eResult
.
getErr
()))
{
LOGGER
.
error
(
"get monitor strategies failed, response:{}."
,
response
);
...
...
@@ -169,7 +172,7 @@ public class N9eService extends AbstractMonitorService {
String
response
=
null
;
try
{
response
=
HttpUtils
.
get
(
monitorN9eBaseUrl
+
uri
,
new
HashMap
<>(
0
),
buildHeader
());
response
=
HttpUtils
.
get
(
monitorN9e
Mon
BaseUrl
+
uri
,
new
HashMap
<>(
0
),
buildHeader
());
N9eResult
n9eResult
=
JSON
.
parseObject
(
response
,
N9eResult
.
class
);
if
(!
ValidateUtils
.
isBlank
(
n9eResult
.
getErr
()))
{
LOGGER
.
error
(
"get monitor strategy failed, response:{}."
,
response
);
...
...
@@ -221,13 +224,13 @@ public class N9eService extends AbstractMonitorService {
public
Boolean
sinkMetrics
(
List
<
MetricSinkPoint
>
pointList
)
{
String
response
=
null
;
try
{
String
content
=
JSON
.
toJSONString
(
N9eConverter
.
convert2N9eMetricSinkPointList
(
pointList
));
String
content
=
JSON
.
toJSONString
(
N9eConverter
.
convert2N9eMetricSinkPointList
(
String
.
valueOf
(
this
.
monitorN9eNid
),
pointList
));
long
startTime
=
System
.
currentTimeMillis
();
response
=
HttpUtils
.
postForString
(
monitorN9eBaseUrl
+
COLLECTOR_SINK_DATA_URL
,
monitorN9e
Sink
BaseUrl
+
COLLECTOR_SINK_DATA_URL
,
content
,
null
buildHeader
()
);
LOGGER
.
info
(
"sinkMetrics cost-time:{}."
,
System
.
currentTimeMillis
()
-
startTime
);
...
...
@@ -251,7 +254,7 @@ public class N9eService extends AbstractMonitorService {
public
List
<
NotifyGroup
>
getNotifyGroups
()
{
String
response
=
null
;
try
{
response
=
HttpUtils
.
get
(
monitorN9eBaseUrl
+
ALL_NOTIFY_GROUP_URL
,
new
HashMap
<>(
0
),
buildHeader
());
response
=
HttpUtils
.
get
(
monitorN9e
Mon
BaseUrl
+
ALL_NOTIFY_GROUP_URL
,
new
HashMap
<>(
0
),
buildHeader
());
N9eResult
n9eResult
=
JSON
.
parseObject
(
response
,
N9eResult
.
class
);
if
(!
ValidateUtils
.
isBlank
(
n9eResult
.
getErr
()))
{
LOGGER
.
error
(
"get notify group failed, response:{}."
,
response
);
...
...
@@ -267,8 +270,7 @@ public class N9eService extends AbstractMonitorService {
private
Map
<
String
,
String
>
buildHeader
()
{
Map
<
String
,
String
>
header
=
new
HashMap
<>(
2
);
header
.
put
(
"Content-Type"
,
"application/json"
);
header
.
put
(
"X-User-Token"
,
monitorN9eToken
);
header
.
put
(
"X-User-Token"
,
monitorN9e
User
Token
);
return
header
;
}
}
kafka-manager-extends/kafka-manager-monitor/src/main/java/com/xiaojukeji/kafka/manager/monitor/component/n9e/entry/N9eMetricSinkPoint.java
浏览文件 @
36e3d6c1
package
com.xiaojukeji.kafka.manager.monitor.component.n9e.entry
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.sink.
MonitorBase
SinkTag
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.sink.
AbstractMonitor
SinkTag
;
/**
* 夜莺上报监控数据点
...
...
@@ -9,19 +9,19 @@ import com.xiaojukeji.kafka.manager.monitor.common.entry.sink.MonitorBaseSinkTag
*/
public
class
N9eMetricSinkPoint
{
/**
*
指标名
*
节点ID
*/
private
String
metric
;
private
String
nid
;
/**
* 指标
对应的机器
* 指标
名
*/
private
String
endpoint
;
private
String
metric
;
/**
* 指标值
*/
private
String
value
;
private
Double
value
;
/**
* 上报周期
...
...
@@ -36,42 +36,43 @@ public class N9eMetricSinkPoint {
/**
* tags
*/
private
MonitorBaseSinkTa
g
tags
;
private
Strin
g
tags
;
public
N9eMetricSinkPoint
(
String
metric
,
String
value
,
public
N9eMetricSinkPoint
(
String
nid
,
String
metric
,
Double
value
,
int
step
,
long
timestamp
,
MonitorBaseSinkTag
tags
)
{
AbstractMonitorSinkTag
tags
)
{
this
.
nid
=
nid
;
this
.
metric
=
metric
;
this
.
endpoint
=
tags
.
getHost
();
this
.
value
=
value
;
this
.
step
=
step
;
this
.
timestamp
=
timestamp
;
this
.
tags
=
tags
;
this
.
tags
=
tags
.
convert2Tags
()
;
}
public
String
get
Metric
()
{
return
metric
;
public
String
get
Nid
()
{
return
nid
;
}
public
void
set
Metric
(
String
metric
)
{
this
.
metric
=
metric
;
public
void
set
Nid
(
String
nid
)
{
this
.
nid
=
nid
;
}
public
String
get
Endpoint
()
{
return
endpoint
;
public
String
get
Metric
()
{
return
metric
;
}
public
void
set
Endpoint
(
String
endpoint
)
{
this
.
endpoint
=
endpoint
;
public
void
set
Metric
(
String
metric
)
{
this
.
metric
=
metric
;
}
public
String
getValue
()
{
public
Double
getValue
()
{
return
value
;
}
public
void
setValue
(
String
value
)
{
public
void
setValue
(
Double
value
)
{
this
.
value
=
value
;
}
...
...
@@ -91,23 +92,23 @@ public class N9eMetricSinkPoint {
this
.
timestamp
=
timestamp
;
}
public
MonitorBaseSinkTa
g
getTags
()
{
public
Strin
g
getTags
()
{
return
tags
;
}
public
void
setTags
(
MonitorBaseSinkTa
g
tags
)
{
public
void
setTags
(
Strin
g
tags
)
{
this
.
tags
=
tags
;
}
@Override
public
String
toString
()
{
return
"N9eMetricSinkPoint{"
+
"
metric='"
+
metric
+
'\''
+
",
endpoint='"
+
endpoint
+
'\''
+
", value=
'"
+
value
+
'\''
+
"
nid="
+
nid
+
",
metric='"
+
metric
+
'\''
+
", value=
"
+
value
+
", step="
+
step
+
", timestamp="
+
timestamp
+
", tags=
"
+
tags
+
", tags=
'"
+
tags
+
'\''
+
'}'
;
}
}
\ No newline at end of file
kafka-manager-task/src/main/java/com/xiaojukeji/kafka/manager/task/dispatch/metrics/store/SinkCommunityTopicMetrics2Monitor.java
浏览文件 @
36e3d6c1
...
...
@@ -100,7 +100,6 @@ public class SinkCommunityTopicMetrics2Monitor extends AbstractScheduledTask<Clu
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
timestamp
,
new
MonitorTopicSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
logicalClusterName
,
metrics
.
getTopicName
()
)
...
...
@@ -112,7 +111,6 @@ public class SinkCommunityTopicMetrics2Monitor extends AbstractScheduledTask<Clu
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
timestamp
,
new
MonitorTopicSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
logicalClusterName
,
metrics
.
getTopicName
()
)
...
...
@@ -124,7 +122,6 @@ public class SinkCommunityTopicMetrics2Monitor extends AbstractScheduledTask<Clu
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
timestamp
,
new
MonitorTopicSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
logicalClusterName
,
metrics
.
getTopicName
()
)
...
...
kafka-manager-task/src/main/java/com/xiaojukeji/kafka/manager/task/listener/SinkConsumerMetrics2Monitor.java
浏览文件 @
36e3d6c1
...
...
@@ -11,7 +11,7 @@ import com.xiaojukeji.kafka.manager.common.utils.ValidateUtils;
import
com.xiaojukeji.kafka.manager.common.zookeeper.znode.brokers.TopicMetadata
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.MetricSinkPoint
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.sink.MonitorConsumePartitionSinkTag
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.sink.MonitorConsume
r
SinkTag
;
import
com.xiaojukeji.kafka.manager.monitor.common.entry.sink.MonitorConsume
Topic
SinkTag
;
import
com.xiaojukeji.kafka.manager.monitor.component.AbstractMonitorService
;
import
com.xiaojukeji.kafka.manager.service.cache.KafkaMetricsCache
;
import
com.xiaojukeji.kafka.manager.service.cache.LogicalClusterMetadataManager
;
...
...
@@ -99,7 +99,6 @@ public class SinkConsumerMetrics2Monitor implements ApplicationListener<Consumer
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
timestamp
,
new
MonitorConsumePartitionSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
logicalClusterName
,
metrics
.
getTopicName
(),
partitionId
,
...
...
@@ -115,8 +114,7 @@ public class SinkConsumerMetrics2Monitor implements ApplicationListener<Consumer
maxLag
,
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
timestamp
,
new
MonitorConsumerSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
new
MonitorConsumeTopicSinkTag
(
logicalClusterName
,
metrics
.
getTopicName
(),
metrics
.
getConsumerGroup
()
...
...
@@ -139,8 +137,7 @@ public class SinkConsumerMetrics2Monitor implements ApplicationListener<Consumer
maxDelayTime
,
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
timestamp
,
new
MonitorConsumerSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
new
MonitorConsumeTopicSinkTag
(
logicalClusterName
,
metrics
.
getTopicName
(),
metrics
.
getConsumerGroup
()
...
...
kafka-manager-task/src/main/java/com/xiaojukeji/kafka/manager/task/listener/SinkTopicThrottledMetrics2Monitor.java
浏览文件 @
36e3d6c1
...
...
@@ -85,7 +85,6 @@ public class SinkTopicThrottledMetrics2Monitor implements ApplicationListener<To
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
startTime
/
1000
,
new
MonitorTopicThrottledSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
logicalClusterName
,
metrics
.
getTopicName
(),
metrics
.
getAppId
()
...
...
@@ -100,7 +99,6 @@ public class SinkTopicThrottledMetrics2Monitor implements ApplicationListener<To
MonitorSinkConstant
.
MONITOR_SYSTEM_SINK_STEP
,
startTime
/
1000
,
new
MonitorTopicThrottledSinkTag
(
MonitorSinkConstant
.
MONITOR_SYSTEM_TAG_DEFAULT_HOST
,
logicalClusterName
,
metrics
.
getTopicName
(),
metrics
.
getAppId
()
...
...
kafka-manager-web/src/main/resources/application.yml
浏览文件 @
36e3d6c1
...
...
@@ -19,7 +19,7 @@ spring:
allow-bean-definition-overriding
:
true
profiles
:
active
:
dev
,account-dev,monitor-dev,notify-dev,kcm-dev
active
:
dev
servlet
:
multipart
:
max-file-size
:
60MB
...
...
@@ -48,10 +48,12 @@ kcm:
monitor
:
enabled
:
false
n9e
:
base-url
:
http://127.0.0.1/api
username
:
admin
user-token
:
admin
nid
:
10
nid
:
2
user-token
:
1234567890
mon
:
base-url
:
http://127.0.0.1:8032
sink
:
base-url
:
http://127.0.0.1:8008
notify
:
kafka
:
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录