ddadmin
fe9c15c0fe
Update Airflow configuration to integrate with ClickHouse DWH instead of PostgreSQL training database. Changes include: - Switch Airflow dependencies from PostgreSQL to ClickHouse connector - Update docker-compose to use ClickHouse connection and correct Dockerfile - Refactor airflow/requirements.txt to include only essential packages - Add DAGs directory for ETL pipeline orchestration - Update documentation to reflect Airflow integration and access credentials - Adjust service dependencies to wait for ClickHouse startup
12 lines
359 B
Plaintext
12 lines
359 B
Plaintext
# Airflow requirements для ClickHouse DWH проекта
|
|
|
|
# Core database connector для metadata
|
|
psycopg2-binary==2.9.9
|
|
|
|
# ClickHouse provider для ETL
|
|
# Примечание: официальный провайдер deprecated, используем clickhouse-connect
|
|
clickhouse-connect==0.8.0
|
|
|
|
# Для работы с данными
|
|
pandas==2.1.4
|