Skip to content

Commit cb2604a

Browse files
committed
alert if deploy canary metric is missing
1 parent 253f419 commit cb2604a

File tree

1 file changed

+22
-1
lines changed

1 file changed

+22
-1
lines changed

charts/deployd/templates/alerts.yaml

+22-1
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,27 @@ spec:
2929
3030
Documentation: https://github.com/nais/deploy
3131
Logs: https://logs.adeo.no/goto/cb6b89c655dcb051fa633ce35070d385
32-
Instrumentation: https://grafana.nais.io/d/Ehcyf6UZk/canary?orgId=1
32+
Instrumentation: https://monitoring.nais.io/d/9Wb381o4k/deploy-canary
3333
2nd line: @nais-features
34+
- alert: NAIS deploy canary metric missing
35+
expr: |
36+
absent(nais_testapp_time_since_deploy{app="nais-deploy-canary",namespace="nais-verification"})
37+
for: 5m
38+
labels:
39+
namespace: nais-system
40+
severity: danger
41+
annotations:
42+
summary: |
43+
The metric used to determine if the canary application is deployed is missing.
44+
45+
Canary application should produce metrics in order for other alerts to work.
46+
consequence: NAIS deploy might be available, but we can't know.
47+
action: |
48+
* `kubectl --context management -n nais-system describe job -l app=canary-deployer`
49+
* `kubectl --context management -n nais-system describe deploy hookd`
50+
* Ensure deployd is running in cluster that alerts
51+
52+
Documentation: https://github.com/nais/deploy
53+
Logs: https://logs.adeo.no/goto/cb6b89c655dcb051fa633ce35070d385
54+
Instrumentation: https://monitoring.nais.io/d/9Wb381o4k/deploy-canary
3455
{{- end }}

0 commit comments

Comments
 (0)