amiirkhl/telecom-cdr-pipeline-ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs(pipeline): align worker and storage contracts

Browse Source
This commit is contained in:
Amirhossein Khalili
2026-09-20 10:40:58 +03:30
parent 81cef7f732
commit dc66e7fe97
4 changed files with 13 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
openspec/changes/telecom-cdr-pipeline/specs/processing-worker/spec.md
View File

@@ -102,6 +102,7 @@ The worker SHALL disable automatic offset storage, commit explicit next offsets,
#### Scenario: Valid record precedes an invalid record
- **WHEN** an invalid record follows buffered valid records
- **THEN** flush and commit those valid records before acknowledging and committing the invalid record to DLQ
- **THEN** route the invalid record to DLQ and defer committing its offset until buffered valid records are flushed, or commit immediately if no preceding uncommitted records exist on that partition
#### Scenario: Destination or commit failure
- **WHEN** DLQ delivery or any partition commit fails
@@ -109,7 +110,8 @@ The worker SHALL disable automatic offset storage, commit explicit next offsets,
#### Scenario: Exhausted ClickHouse retries
- **WHEN** three configured insert attempts fail
- **THEN** publish original vendor payloads with ch_insert_failed and commit only after all DLQ deliveries succeed
- **THEN** publish original vendor payloads with `normalization_error` and commit only after all DLQ deliveries succeed
- **THEN** publish original vendor payloads with normalization_error and commit only after all DLQ deliveries succeed
### Requirement: Storage-safe normalization
The worker SHALL reject numeric booleans, fractional numeric fields, out-of-range UInt64 and UInt32 values including total bytes, invalid IPv4, and timestamps outside DateTime range without crashing.