amiirkhl/telecom-cdr-pipeline
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add clickhouse micro-batch storage

Browse Source
This commit is contained in:
Amirhossein Khalili
2026-09-20 15:33:44 +03:30
parent 0e23e5bde8
commit 1a2f492992
8 changed files with 468 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
.env.sample
View File

@@ -58,10 +58,23 @@ KAFKA_PRODUCER_MAX_MESSAGES=100000
CLICKHOUSE_VERSION=26.8.7.19
CLICKHOUSE_HOST=clickhouse
# Used by Python applications running directly on the host.
CLICKHOUSE_HOST=localhost
# Used later by Dockerized API/worker services.
CLICKHOUSE_INTERNAL_HOST=clickhouse
CLICKHOUSE_PORT=8123
CLICKHOUSE_HTTP_HOST_PORT=8123
CLICKHOUSE_DATABASE=telecom
CLICKHOUSE_USER=telecom
CLICKHOUSE_PASSWORD=telecom_dev_password
# =========================
# Worker batching
# =========================
BATCH_SIZE=1000
BATCH_FLUSH_INTERVAL_SECONDS=2