clickstream-ch-kafka-superset-demo

10 Commits 1 Branch 0 Tags

3 Commits

Include renames

Author	SHA1	Message	Date
ddadmin	eb80bc1870	feat(infra): add makefile and kafka data loading script Add build automation via Makefile with targets for docker compose management, DDL application, and data ingestion. Implement a robust bash script for loading JSONL demo data into Kafka topics with configurable options for limits, full dataset loading, and topic reset behavior.	2026-02-05 22:10:48 +03:00
ddadmin	380e8fcff3	docs(plans): fix kafka broker address and add data loading docs Update Kafka broker address to use internal Docker network port (29092) instead of external port (9092). Add kafka_ingest_plan.md with detailed implementation strategy and runbook.md with user instructions.	2026-02-05 21:49:09 +03:00
ddadmin	df50e507e5	План трансформаций: JSON → витрины BI - Описаны слои STG/ODS/DDS/DM и связи потоков (`event_id`/`click_id`) - Добавлены DDL и MV-пайплайн для ingestion из Kafka (ClickHouse) + типизация/дедуп/DQ - Добавлены витрины/VIEW для BI (Superset), mermaid-диаграмма и операционные заметки	2026-02-04 22:17:28 +03:00

Author

SHA1

Message

Date

ddadmin

eb80bc1870

feat(infra): add makefile and kafka data loading script

Add build automation via Makefile with targets for docker compose
management, DDL application, and data ingestion. Implement a robust bash
script for loading JSONL demo data into Kafka topics with configurable
options for limits, full dataset loading, and topic reset behavior.

2026-02-05 22:10:48 +03:00

ddadmin

380e8fcff3

docs(plans): fix kafka broker address and add data loading docs

Update Kafka broker address to use internal Docker network port (29092)
instead of external port (9092). Add kafka_ingest_plan.md with detailed
implementation strategy and runbook.md with user instructions.

2026-02-05 21:49:09 +03:00

ddadmin

df50e507e5

План трансформаций: JSON → витрины BI

- Описаны слои STG/ODS/DDS/DM и связи потоков (`event_id`/`click_id`)
- Добавлены DDL и MV-пайплайн для ingestion из Kafka (ClickHouse) + типизация/дедуп/DQ
- Добавлены витрины/VIEW для BI (Superset), mermaid-диаграмма и операционные заметки

2026-02-04 22:17:28 +03:00