infra: use spark connect to run pytests#2491

kevinjqliu merged 7 commits intoapache:mainapache/iceberg-python:mainfrom

kevinjqliu:kevinjqliu/clean-up-sparkkevinjqliu/iceberg-python:kevinjqliu/clean-up-sparkCopy head branch name to clipboard