Skip to content

[SPARK-55335][PYTHON][TESTS] Use eventually instead of hard-coded wait for datasource test#54110

Closed
gaogaotiantian wants to merge 2 commits intoapache:masterfrom
gaogaotiantian:fix-sleep-test
Closed

[SPARK-55335][PYTHON][TESTS] Use eventually instead of hard-coded wait for datasource test#54110
gaogaotiantian wants to merge 2 commits intoapache:masterfrom
gaogaotiantian:fix-sleep-test

Conversation

@gaogaotiantian
Copy link
Contributor

What changes were proposed in this pull request?

Instead of a hard-coded time.sleep(6), do a eventually until we have some rows committed.

Why are the changes needed?

coverage run is slower than normal runs, which could result in no committed row for this test. Using eventually can guarantee some rows to be there while not waiting too long.

https://github.com/apache/spark/actions/runs/21586206793/job/62195041694

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Locally passed.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions
Copy link

github-actions bot commented Feb 3, 2026

JIRA Issue Information

=== Test SPARK-55335 ===
Summary: Use eventually for test_stream_arrow_writer to avoid unfinished query
Assignee: None
Status: Open
Affected: ["4.2.0"]


This comment was automatically generated by GitHub Actions

@zhengruifeng
Copy link
Contributor

merged to master

@gaogaotiantian gaogaotiantian deleted the fix-sleep-test branch February 10, 2026 21:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants