-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Spark: Add location overlap validation for SnapshotTableAction #14933
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Spark: Add location overlap validation for SnapshotTableAction #14933
Conversation
…ng destination table location from overlaping source table location. Resolves TODO comment in SnapshotTableSparkAction.java for spark v4.1
…ng destination table location from overlaping source table location. Resolves TODO comment in SnapshotTableSparkAction.java for spark v4.1
…ng destination table location from overlaping source table location. Resolves TODO comment in SnapshotTableSparkAction.java for spark v4.1
|
Definitely needs a test case, not sure why windows would make testing impossible since our locations are stored as strings |
|
Iceberg errors follow this format "Cannot X because Y (possibly fix Z)" So in this case Cannot create a snapshot at location ... because it would overlap with source table ... Overlapping snapshot and source would .... |
Thanks for the feedback. All CI checks are passing now. |
@RussellSpitzer |
Description
Implements location overlap validation for
SnapshotTableActionto prevent destination table location from overlapping with source table location.Resolves TODO comment in
SnapshotTableSparkAction.java:127in spark v4.1.Type of change
How Has This Been Tested?
Checklist