Skip to content

Cutover test runs#44110

Open
scbedd wants to merge 85 commits intomainfrom
cutover-test-runs
Open

Cutover test runs#44110
scbedd wants to merge 85 commits intomainfrom
cutover-test-runs

Conversation

@scbedd
Copy link
Member

@scbedd scbedd commented Nov 19, 2025 •
edited
Loading

Resolves #42601 @JennyPng @mccoyp feel free to commit anything you wish here!

This PR:

  • Cuts over all pytest-invoking environments to uv runs over using tox for dependency management + venv creation.
  • After this merges, a follow-up PR will be submitted to clean out the rest of the existing tox code locations.

Todo:

  • A ton of validation around some of our "commonly hitting errors" services ml, ai, etc. As they're seeing a ton of churn. We want to ensure that everything is the same between old and new.
  • Some last validation of test publishing counts, coverage outputs, to ensure we're not accidentally ignoring any sets of tests in the new world
  • Build up update for contributing, effectively getting the documentation PR for issue

scbedd and others added 22 commits November 20, 2025 00:48
@scbedd
fix the pipeline
97b39f6
@scbedd
command was bleeding forward
4d35f37
@scbedd
nicely format the printed results so that we can easily examine the o…
a6c4a6f 
…utput for a specific package
@scbedd
we actually fail when pytest fails
3c30e06
@scbedd
failures will actually fail this thing now
4358502
@scbedd
how is this not failing the entire invocation? I don't get it
6da6464
@JennyPng
add pytest exit code
670aa5c
@scbedd
resolve conflict
ea62859
@scbedd
patch up the test invocation
6090b95
@scbedd
manual migration of whl/sdist/whl_no_aio. copilot mindependency but I…
aacd30c 
… don't trust it yet
@scbedd
enable a couple more envs
f709a23
@scbedd
updates to dependency checking
177efe0
@scbedd
ensure that the local CWD being the package directory being added to …
d3006bf 
…the PATH doesn't break import_all script
@scbedd
changes to import_all
8f48ce5
@scbedd
mis-using ignore glob means we accidentally picked up at file from wi…
a9b5bd9 
…thin the site-packages directory
@scbedd
small upgrades
8f48ac6
@scbedd
force re-init of logger from subprocess
526a5f5
@scbedd
we should use the wheel dir to fix the parallelism issues
af16ff4
@scbedd
fix the failing test
1ef77ce
@scbedd
save progress
fd740fd
@scbedd
apply black format. add buildid to the build run
099d79f
@scbedd
fix reference
f853d82
mccoyp
mccoyp reviewed Feb 3, 2026
View reviewed changes
JennyPng
JennyPng reviewed Feb 4, 2026
View reviewed changes
JennyPng
JennyPng reviewed Feb 4, 2026
View reviewed changes
JennyPng
JennyPng reviewed Feb 4, 2026
View reviewed changes
JennyPng
JennyPng reviewed Feb 4, 2026
View reviewed changes
JennyPng
JennyPng reviewed Feb 4, 2026
View reviewed changes
scbedd added 14 commits February 4, 2026 14:24
@scbedd
once a check has exited, the process will just _end_, we will no long…
39a6e0c 
…er wait for sys.exit() which honors atexit() etc. cosmos has zombie processes and those are hanging the sys.exit() forever
@scbedd
we were not forwarding the check value properly. THATS why we were ex…
10ff352 
…ploding.
@scbedd
save the logging of the executing command
bec9ad8
@scbedd
fix mindependency!
4fd3467
@scbedd
remove mark argument from analyze, where it doesn't make sense
e1ba28b
@scbedd
swapping over to set_checks instead of set_tox_environment. moved tha…
99870da 
…t function call. fixed mindependency to pass the pytest arg properly so that cosmos won't hang.
@scbedd
skip env
769512f
@scbedd
finally resolve the wonky import errors that we were seeing. this SHO…
ce57329 
…ULD get solid invocation now
@scbedd
apply the same fix to apply_depend_packages so we can can simply take…
db3a769 
… ours when merging main
@scbedd
Merge branch 'main' into cutover-test-runs
5f8ffd0
@scbedd
Merge branch 'main' into cutover-test-runs
d25aeb1
@scbedd
save the progress on this thing.
87327b5
@scbedd
lots of doc updates as well.
7fc171e
@scbedd
Run.ToxCustomEnvs -> ChecksOverride
0632f9d
@scbedd scbedd requested a review from a team as a code owner February 7, 2026 00:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mccoyp mccoyp mccoyp left review comments

@JennyPng JennyPng JennyPng left review comments

Copilot code review Copilot Copilot left review comments

@weshaggard weshaggard Awaiting requested review from weshaggard weshaggard is a code owner

@benbp benbp Awaiting requested review from benbp benbp is a code owner

@catalinaperalta catalinaperalta Awaiting requested review from catalinaperalta catalinaperalta is a code owner

@paulshealy1 paulshealy1 Awaiting requested review from paulshealy1 paulshealy1 is a code owner

@achauhan-scc achauhan-scc Awaiting requested review from achauhan-scc achauhan-scc is a code owner

@kingernupur kingernupur Awaiting requested review from kingernupur kingernupur is a code owner

@jayesh-tanna jayesh-tanna Awaiting requested review from jayesh-tanna jayesh-tanna is a code owner

@lmazuel lmazuel Awaiting requested review from lmazuel lmazuel is a code owner

@annatisch annatisch Awaiting requested review from annatisch annatisch is a code owner

@johanste johanste Awaiting requested review from johanste johanste is a code owner

@xiangyan99 xiangyan99 Awaiting requested review from xiangyan99 xiangyan99 is a code owner

@iscai-msft iscai-msft Awaiting requested review from iscai-msft iscai-msft is a code owner

@kashifkhan kashifkhan Awaiting requested review from kashifkhan kashifkhan is a code owner

@pvaneck pvaneck Awaiting requested review from pvaneck pvaneck is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

@scbedd scbedd

Labels

None yet

Projects

Azure SDK EngSys 📆🎇
Status: 🔬 Dev in PR

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Migrate checks away from tox, reflect in azsdkcli python tool

3 participants

@scbedd @mccoyp @JennyPng