ddmitry/clickstream-ch-kafka-superset-demo
1
0
Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases Wiki Activity

fix(monitoring): correct Kafka metrics and alert rules

Browse Source 
- Why:
  - dashboard showed offset as throughput and produced misleading values
  - kafka-exporter metric/label naming was inconsistent across alerts/docs
  - consumer-group-missing alert was noisy for demo runs
- What:
  - switch throughput panel to rate(kafka_topic_partition_current_offset[5m]) aggregated by topic and exclude __* topics
  - align lag metric/labels to kafka_consumergroup_lag + consumergroup
  - remove Kafka Consumer Group Missing alert from provisioning
  - pin kafka-exporter image to v1.9.0 and update OPERATIONS.md checks
- Check:
  - airflow dags list-import-errors -> No data found
  - Prometheus targets: clickhouse up, kafka up
  - PromQL kafka_consumergroup_lag returns series
  - Grafana dashboards provisioning reload returns success
This commit is contained in:
ddadmin
2026-02-08 21:52:21 +03:00
parent afdfc98eef
commit 8e31b06241
4 changed files with 11 additions and 42 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docker-compose.yml
+1 -1
View File
@@ -232,7 +232,7 @@ services:
# Kafka Exporter для мониторинга через Prometheus
kafka-exporter:
image: danielqsj/kafka-exporter:latest
image: danielqsj/kafka-exporter:v1.9.0
command: ["--kafka.server=kafka:29092"]
ports:
- "9308:9308"