ddmitry/clickstream-ch-kafka-superset-demo
1
0 Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 3bed37f532 docs(docs): add 10-15 minute demo script ddadmin 2026-02-10 23:57:38 +03:00
  • 22f08382e5 fix(superset): align bootstrap with clickhousedb uri ddadmin 2026-02-10 23:51:38 +03:00
  • 6533f8b32c fix(superset): fix dashboard chart rendering in Superset 4 ddadmin 2026-02-10 23:49:40 +03:00
  • cb3665c1be feat(superset): автоматическая инициализация с PostgreSQL метаданными ddadmin 2026-02-10 21:56:47 +03:00
  • 91f1a790cb fix: исправлен путь Kafka volume и обновлены скрипты Superset ddadmin 2026-02-08 01:00:28 +03:00
  • 2e48f6065a feat: добавлен дашборд Superset для e-commerce аналитики ddadmin 2026-02-08 00:18:03 +03:00
  • 21fd58dc9d Merge branch 'feature/monitoring' ddadmin 2026-02-09 18:53:38 +03:00
  • e6c26ce353 docs(docs): add 5-minute demo cheatsheet ddadmin 2026-02-09 18:52:16 +03:00
  • c8aca36e82 Merge branch 'feature/monitoring' ddadmin 2026-02-09 10:27:59 +03:00
  • f411a46aea docs(docs): add comprehensive system test plan ddadmin 2026-02-09 09:54:31 +03:00
  • 0e470604fe chore(scripts): add make down and clean targets ddadmin 2026-02-09 09:33:54 +03:00
  • e851ef9788 fix(monitoring): add recover flow for stuck monitoring stack ddadmin 2026-02-09 09:28:13 +03:00
  • df173c00f7 fix(monitoring): revert incorrect clickhouse dashboard query edits ddadmin 2026-02-08 23:19:54 +03:00
  • 39df4f2469 fix(monitoring): add missing ClickHouse Prometheus port and fix dashboard queries ddadmin 2026-02-08 23:00:32 +03:00
  • a310bc6c39 fix(monitoring): align airflow statsd mapping and reload flow ddadmin 2026-02-08 22:51:09 +03:00
  • 8a6306954e fix(monitoring): use delta() instead of rate() for CPU gauge metric ddadmin 2026-02-08 22:48:36 +03:00
  • 68862a47c1 docs(repo-map): add monitoring configs and plans ddadmin 2026-02-08 22:33:01 +03:00
  • 4917a9a6ad feat(monitoring): add Airflow monitoring via statsd-exporter ddadmin 2026-02-08 22:27:32 +03:00
  • 8e31b06241 fix(monitoring): correct Kafka metrics and alert rules ddadmin 2026-02-08 21:52:21 +03:00
  • afdfc98eef fix(infra): harden grafana permissions and document recovery ddadmin 2026-02-08 21:38:23 +03:00
  • ae593fd08c feat(monitoring): add Kafka monitoring via kafka-exporter ddadmin 2026-02-08 21:25:31 +03:00
  • 41c867d68d docs(operations): add post-pull monitoring refresh runbook ddadmin 2026-02-08 20:53:49 +03:00
  • 5270273d8a feat(monitoring): add Grafana alert rules and fix datasource binding ddadmin 2026-02-08 20:49:31 +03:00
  • 140b711233 docs(docs): clarify multiline commit body usage ddadmin 2026-02-08 20:49:18 +03:00
  • fdeb48fdb2 feat(monitoring): add Grafana dashboard for ClickHouse ddadmin 2026-02-08 20:29:43 +03:00
  • 03de68e0c5 docs(docs): slim down AGENTS and split runbook sections ddadmin 2026-02-08 20:23:42 +03:00
  • a185a56762 docs(readme): add DBeaver guide and move DE-task to docs ddadmin 2026-02-08 19:57:11 +03:00
  • b0a91480ca Merge branch 'feature/airflow-orchestration' ddadmin 2026-02-08 19:34:54 +03:00
  • 869c189fe8 refactor(airflow): move DAGs to airflow/dags and update paths ddadmin 2026-02-08 19:34:10 +03:00
  • 44a75691e8 feat(airflow): полная реализация фазы 2 — DAG для загрузки данных в Kafka ddadmin 2026-02-08 19:06:47 +03:00
  • 60482af66b docs: обновлены Mermaid-диаграммы в README и ARCHITECTURE ddadmin 2026-02-08 19:03:11 +03:00
  • 0b75da9c08 docs(docs): align docs with airflow-first ingest workflow ddadmin 2026-02-08 18:52:44 +03:00
  • d7588a8caa chore: добавлен полноценный .gitignore для ETL-проекта ddadmin 2026-02-08 18:48:20 +03:00
  • 1b9991f595 fix(airflow): simplify kafka_load params and align docs ddadmin 2026-02-08 18:33:54 +03:00
  • 10f5bc3510 feat(airflow): реализован DAG kafka_load для загрузки в Kafka (фаза 2) ddadmin 2026-02-08 18:13:22 +03:00
  • 12f35679f0 docs: update commit rules to support English language ddadmin 2026-02-08 17:25:04 +03:00
  • 4819e10cf8 feat: изменён режим загрузки данных по умолчанию — теперь все записи ddadmin 2026-02-08 17:21:22 +03:00
  • 33f8172892 Слой ODS теперь собирается в Airflow ddadmin 2026-02-08 17:00:01 +03:00
  • 60cb20406f docs(docs): добавить правила оформления коммитов ddadmin 2026-02-08 16:42:43 +03:00
  • 284dc3dc1f Move STG->ODS to Airflow batch and align monitoring ddadmin 2026-02-08 16:36:01 +03:00
  • a7963c17b3 fix: исправлен путь Kafka volume ddadmin 2026-02-08 15:24:00 +03:00
  • 413a711ddf Удаление ненужного файла ddadmin 2026-02-08 15:16:52 +03:00
  • 767198f6e2 Merge branch 'feature/airflow-orchestration' ddadmin 2026-02-07 22:03:41 +03:00
  • 225ae8bedb docs: update README and architecture docs for Airflow orchestration workflow ddadmin 2026-02-07 22:03:13 +03:00
  • d9b8a3f909 docs(airflow): update plugin and DAG docs ddadmin 2026-02-07 21:57:15 +03:00
  • 4d8f9d42f4 feat(infra): add clickhouse data persistence volume ddadmin 2026-02-07 21:53:52 +03:00
  • 14d16c5cae feat(airflow): implement dag orchestration for ddl and etl ddadmin 2026-02-07 21:52:31 +03:00
  • de9d0429a2 fix(data): update dataset permissions for execution ddadmin 2026-02-07 21:36:55 +03:00
  • 226807ecae chore(airflow): replace clickhouse-connect with airflow-clickhouse-plugin ddadmin 2026-02-07 20:55:14 +03:00
  • 9e340bb729 refactor(sql): reorganize sql files into structured directory hierarchy ddadmin 2026-02-07 20:51:51 +03:00
  • 6466921bda docs(airflow): refactor dag implementation plan to separate kafka ingestion ddadmin 2026-02-07 19:44:37 +03:00
  • 4da6a34e4c docs(airflow): update dag implementation plan for mvp ddadmin 2026-02-07 00:03:32 +03:00
  • cca315e4f6 docs(airflow): add migration plan for ETL orchestration ddadmin 2026-02-06 23:42:50 +03:00
  • fe9c15c0fe feat(airflow): configure ClickHouse connection and update infrastructure ddadmin 2026-02-06 23:34:45 +03:00
  • d33cdb3fb0 feat(infra): add airflow orchestration services ddadmin 2026-02-06 23:20:58 +03:00
  • d7cff5ad1e docs: add russian comments to pipeline files ddadmin 2026-02-06 22:45:39 +03:00
  • 36139e0c78 docs: restructure AGENTS.md and add commenting conventions ddadmin 2026-02-06 22:37:49 +03:00
  • cbf5f22064 docs(architecture): update ODS error handling and DDS partial data support ddadmin 2026-02-06 22:21:16 +03:00
  • e44b988d76 feat(data): add error handling for ODS layer and improve partial data support ddadmin 2026-02-06 22:10:51 +03:00
  • 6bbb26b9b3 feat(infra): implement batch transformation layer and comprehensive documentation ddadmin 2026-02-06 21:58:17 +03:00
  • 78b8b29fc7 docs(plans): update ddl architecture to use batch transforms for ods to dds ddadmin 2026-02-05 23:07:57 +03:00
  • c8564bfe03 docs(plans): add DDL modernization plan and restructure documentation ddadmin 2026-02-05 22:37:51 +03:00
  • a39dba6dae docs: add runbook reference and makefile commands ddadmin 2026-02-05 22:12:51 +03:00
  • a81a2c1b68 docs: add project readme ddadmin 2026-02-05 22:11:10 +03:00
  • eb80bc1870 feat(infra): add makefile and kafka data loading script ddadmin 2026-02-05 22:10:48 +03:00
  • 380e8fcff3 docs(plans): fix kafka broker address and add data loading docs ddadmin 2026-02-05 21:49:09 +03:00
  • a2a1fdb785 feat(docker): add superset service ddadmin 2026-02-04 23:17:11 +03:00
  • 60d02fdb28 fix(docker): correct network name and remove hardcoded container names ddadmin 2026-02-04 23:06:03 +03:00
  • f860bc47db Описание для роботов ddadmin 2026-02-04 22:49:31 +03:00
  • 06ffb0cf16 Наброски инфраструктуры ddadmin 2026-02-04 22:47:19 +03:00
  • df50e507e5 План трансформаций: JSON → витрины BI ddadmin 2026-02-04 22:13:17 +03:00
  • 70e12fbfb3 Текст задания ddadmin 2026-02-04 22:11:07 +03:00
  • aab9264121 Расширение исходных данных ddadmin 2026-02-04 21:25:53 +03:00
  • 06730fdf19 Исходные данные ddadmin 2026-02-04 20:14:02 +03:00