feat: comet native scan improvements - Dynamic Partition Pruning #3546

Open

Shekharrajak wants to merge 8 commits intoapache:mainfrom

Shekharrajak:feature/comet-native-scan-improvements

Commits on Feb 20, 2026

feat: add DPP support to CometNativeScanExec for V1 native scans
Shekharrajak
committed
test: add DPP tests for CometNativeScanExec
Shekharrajak
committed
test: add DPP benchmark comparing Spark vs Comet native scan
Shekharrajak
committed
test: add benchmarks proving 4x speedup for native Parquet scan
Shekharrajak
committed
bench: add CometDPPBenchmark following standard benchmark pattern
Shekharrajak
committed
fix: fall back to Spark for DPP in non-AQE mode with native_datafusion scan
Shekharrajak
committed
fix: remove unused variable in DPP fallback test
Shekharrajak
committed
fix: native_datafusion DPP requires AQE - fall back in non-AQE mode
Shekharrajak
committed