refactor(sql): reorganize sql files into structured directory hierarchy
Move DDL files from flat ddl/ directory to sql/ddl/ with layer-based subdirectories (stg, ods, dds, dm). Move batch transformation SQL from jobs/ to sql/ layer directories. Update scripts and documentation to reflect new paths for improved organization and Airflow integration.
This commit is contained in:
@@ -109,8 +109,15 @@ flowchart TB
|
||||
```
|
||||
.
|
||||
├── dags/ # Airflow DAGs для оркестрации
|
||||
├── ddl/ # SQL для создания объектов (00_databases → 40_dm)
|
||||
├── jobs/ # Batch-трансформации (ODS→DDS, DDS→DM)
|
||||
├── sql/
|
||||
│ ├── ddl/ # DDL по слоям
|
||||
│ │ ├── 00_databases.sql
|
||||
│ │ ├── stg/10_stg.sql
|
||||
│ │ ├── ods/20_ods.sql
|
||||
│ │ ├── dds/30_dds.sql
|
||||
│ │ └── dm/40_dm.sql
|
||||
│ ├── dds/ # Batch SQL: ODS -> DDS
|
||||
│ └── dm/ # Batch SQL: DDS -> DM
|
||||
├── scripts/ # Автоматизация (apply ddl, load data, run batch)
|
||||
├── airflow/ # Конфигурация Airflow
|
||||
│ └── requirements.txt
|
||||
|
||||
Reference in New Issue
Block a user