feat: Add ScanOrder and concurrent_files to ArrowScan for bounded-memory reads#3046

Open

sumedhsakdeo wants to merge 16 commits intoapache:mainfrom

sumedhsakdeo:fix/arrow-scan-benchmark-3036

Commits on Feb 15, 2026

feat: forward batch_size parameter to PyArrow Scanner

sumedhsakdeo
and
claude
committed
style: fix ruff formatting in residual_evaluator lambda

sumedhsakdeo
and
claude
committed
chore: remove unintended vendor directory changes

sumedhsakdeo
and
claude
committed

Commits on Feb 17, 2026

feat: add ScanOrder enum to ArrowScan.to_record_batches

sumedhsakdeo
and
claude
committed
feat: add concurrent_files flag for bounded concurrent streaming

sumedhsakdeo
and
claude
committed
fix: remove unused imports in test_bounded_concurrent_batches

sumedhsakdeo
and
claude
committed
refactor: simplify _bounded_concurrent_batches with per-scan executor

sumedhsakdeo
and
claude
committed
refactor: replace streaming param with order=ScanOrder in concurrent tests and docs

sumedhsakdeo
and
claude
committed
feat: add read throughput micro-benchmark for ArrowScan configurations
sumedhsakdeo
committed
fix: remove extraneous f-string prefix in benchmark

sumedhsakdeo
and
claude
committed
fix: properly reset mock call_count in test_hive_wait_for_lock

sumedhsakdeo
and
claude
committed
feat: add default-4threads benchmark and time-to-first-record metric

sumedhsakdeo
and
claude
committed
chore: remove default-4threads benchmark configuration

sumedhsakdeo
and
claude
committed
docs: add configuration guidance table to streaming API docs

sumedhsakdeo
and
claude
committed
chore: remove benchmark marker so tests run in CI

sumedhsakdeo
and
claude
committed
refactor: replace streaming param with order=ScanOrder in benchmarks and docs

sumedhsakdeo
and
claude
committed