Enhance deferred fields for production ETL reliability#168

Open

bosd wants to merge 62 commits intomasterfrom

feature/production-ready-etl

Commits on Dec 22, 2025

feat: add advanced import options for handling missing refs and fallbacks
bosd
committed
perf: remove connection cap, add caching and pre-calculation

bosd
and
claude
committed
feat: add --protocol option for RPC protocol selection

bosd
and
claude
committed
fix: convert --ignore from comma-separated string to list

bosd
and
claude
committed
docs: add protocol selection and worker tuning documentation

bosd
and
claude
committed
test: add Unicode and multiline CSV handling test

bosd
and
claude
committed
feat: add --delay option for rate limiting between batches

bosd
and
claude
committed
feat: add adaptive throttling for 503/502 server overload errors

bosd
and
claude
committed
fix: prevent Rich progress bar shifting by suppressing log handler

bosd
and
claude
committed
chore: update mypyc configuration for better compatibility

bosd
and
claude
committed
test: improve test coverage to 85%

bosd
and
claude
committed

Commits on Dec 23, 2025

feat: add streaming CSV support for memory-efficient large file imports

bosd
and
claude
committed
Add checkpoint/resume support and --all-companies flag

bosd
and
claude
committed
feat: add dry-run validation mode

bosd
and
claude
committed
feat: add pre-import reference check

bosd
and
claude
committed
feat: add smart retry logic module

bosd
and
claude
committed
feat: add idempotent import module

bosd
and
claude
committed
feat: add health-aware throttling module

bosd
and
claude
committed

Commits on Dec 24, 2025

feat: integrate retry, idempotent, and throttle modules

bosd
and
claude
committed

Commits on Dec 25, 2025

Commits on Dec 27, 2025

Commits on Dec 28, 2025

Add data cleaning module for transformation pipelines
bosd
committed

Commits on Dec 29, 2025

Commits on Jan 2, 2026

Commits on Jan 4, 2026

Commits on Jan 5, 2026