aboutsummaryrefslogtreecommitdiffstats
path: root/kubernetes
diff options
context:
space:
mode:
authorGravatar Johannes Christ <[email protected]>2024-08-31 20:16:32 +0200
committerGravatar Joe Banks <[email protected]>2024-09-01 17:12:31 +0100
commit276645b02d53b1b9833e969ddecdd0d30a30d35a (patch)
tree9c9008b3cb4f1fa0a6d55c3c18a831b9d876ae29 /kubernetes
parentPleasure the style dictator (diff)
Raise time threshold for 4xx alerts
At present we get plenty of unactionable, flapping alarms. So far, they have shown us nothing of value. Raise the time consecutive errors need to be seen before we alert.
Diffstat (limited to 'kubernetes')
-rw-r--r--kubernetes/namespaces/monitoring/alerts/alerts.d/nginx.yaml2
1 files changed, 1 insertions, 1 deletions
diff --git a/kubernetes/namespaces/monitoring/alerts/alerts.d/nginx.yaml b/kubernetes/namespaces/monitoring/alerts/alerts.d/nginx.yaml
index bf177c3..8573d67 100644
--- a/kubernetes/namespaces/monitoring/alerts/alerts.d/nginx.yaml
+++ b/kubernetes/namespaces/monitoring/alerts/alerts.d/nginx.yaml
@@ -4,7 +4,7 @@ groups:
- alert: nginx/4xx-requests
expr: sum by (service, status) (rate(nginx_ingress_controller_requests{service!="pixels",status!~"404|444",status=~"^4.."}[1m])) / sum by (service, status) (rate(nginx_ingress_controller_requests[1m])) > 0.5
- for: 1m
+ for: 10m
labels:
severity: page
annotations: