Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
doodoocoder
prometheus
提交
9a217794
P
prometheus
项目概览
doodoocoder
/
prometheus
与 Fork 源项目一致
从无法访问的项目Fork
通知
2
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
P
prometheus
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
9a217794
编写于
6月 28, 2019
作者:
B
beorn7
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
Protect gauge-based alerts against failed scrapes
Signed-off-by:
N
beorn7
<
beorn@grafana.com
>
上级
52707535
变更
1
隐藏空白更改
内联
并排
Showing
1 changed file
with
14 addition
and
6 deletion
+14
-6
documentation/prometheus-mixin/alerts.libsonnet
documentation/prometheus-mixin/alerts.libsonnet
+14
-6
未找到文件。
documentation/prometheus-mixin/alerts.libsonnet
浏览文件 @
9a217794
...
@@ -7,9 +7,11 @@
...
@@ -7,9 +7,11 @@
{
{
alert
:
'PrometheusBadConfig'
,
alert
:
'PrometheusBadConfig'
,
expr
:
|||
expr
:
|||
prometheus_config_last_reload_successful{%(prometheusSelector)s} == 0
# Without max_over_time, failed scrapes could create false negatives, see
# https://www.robustperception.io/alerting-on-gauges-in-prometheus-2-0 for details.
max_over_time(prometheus_config_last_reload_successful{%(prometheusSelector)s}[5m]) == 0
|||
%
$
.
_config
,
|||
%
$
.
_config
,
'for'
:
'1
5
m'
,
'for'
:
'1
0
m'
,
labels
:
{
labels
:
{
severity
:
'critical'
,
severity
:
'critical'
,
},
},
...
@@ -21,10 +23,12 @@
...
@@ -21,10 +23,12 @@
{
{
alert
:
'PrometheusNotificationQueueRunningFull'
,
alert
:
'PrometheusNotificationQueueRunningFull'
,
expr
:
|||
expr
:
|||
# Without min_over_time, failed scrapes could create false negatives, see
# https://www.robustperception.io/alerting-on-gauges-in-prometheus-2-0 for details.
(
(
predict_linear(prometheus_notifications_queue_length{%(prometheusSelector)s}[5m], 60 * 30)
predict_linear(prometheus_notifications_queue_length{%(prometheusSelector)s}[5m], 60 * 30)
>
>
prometheus_notifications_queue_capacity{%(prometheusSelector)s}
min_over_time(prometheus_notifications_queue_capacity{%(prometheusSelector)s}[5m])
)
)
|||
%
$
.
_config
,
|||
%
$
.
_config
,
'for'
:
'15m'
,
'for'
:
'15m'
,
...
@@ -79,7 +83,9 @@
...
@@ -79,7 +83,9 @@
{
{
alert
:
'PrometheusNotConnectedToAlertmanagers'
,
alert
:
'PrometheusNotConnectedToAlertmanagers'
,
expr
:
|||
expr
:
|||
prometheus_notifications_alertmanagers_discovered{%(prometheusSelector)s} < 1
# Without max_over_time, failed scrapes could create false negatives, see
# https://www.robustperception.io/alerting-on-gauges-in-prometheus-2-0 for details.
max_over_time(prometheus_notifications_alertmanagers_discovered{%(prometheusSelector)s}[5m]) < 1
|||
%
$
.
_config
,
|||
%
$
.
_config
,
'for'
:
'10m'
,
'for'
:
'10m'
,
labels
:
{
labels
:
{
...
@@ -201,10 +207,12 @@
...
@@ -201,10 +207,12 @@
{
{
alert
:
'PrometheusRemoteWriteBehind'
,
alert
:
'PrometheusRemoteWriteBehind'
,
expr
:
|||
expr
:
|||
# Without max_over_time, failed scrapes could create false negatives, see
# https://www.robustperception.io/alerting-on-gauges-in-prometheus-2-0 for details.
(
(
prometheus_remote_storage_highest_timestamp_in_seconds{%(prometheusSelector)s}
max_over_time(prometheus_remote_storage_highest_timestamp_in_seconds{%(prometheusSelector)s}[5m])
- on(job, instance) group_right
- on(job, instance) group_right
prometheus_remote_storage_queue_highest_sent_timestamp_seconds{%(prometheusSelector)s}
max_over_time(prometheus_remote_storage_queue_highest_sent_timestamp_seconds{%(prometheusSelector)s}[5m])
)
)
> 120
> 120
|||
%
$
.
_config
,
|||
%
$
.
_config
,
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录