tests: introduce testing framework #106
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
Author
|
@srinathkr-nv @krajunv @vasn1k @zlatinski I would be pleased to get your feedback on this framework which will help to track down possible regressions with current and future PRs. There is a list of disabled tests because there are failing by now. I'm planning to address the issue in coming PRs. |
dabrain34
force-pushed
the
dab_test_framework
branch
from
fc1d025 to
1592749
Compare
zlatinski
approved these changes
Oct 14, 2025
Contributor
zlatinski
left a comment
zlatinski
left a comment
There was a problem hiding this comment.
Great work! Thank you, Stephane for this framework!
dabrain34
force-pushed
the
dab_test_framework
branch
5 times, most recently
from
c7c98c2 to
d4689d7
Compare
dabrain34
force-pushed
the
dab_test_framework
branch
3 times, most recently
from
1f83b5e to
e09207b
Compare
dabrain34
force-pushed
the
dab_test_framework
branch
from
e09207b to
d0d7894
Compare
Contributor
|
Thanks Stephan. Looks good to me. |
dabrain34
force-pushed
the
dab_test_framework
branch
4 times, most recently
from
d91f00c to
65282c9
Compare
ceyusa
reviewed
Dec 3, 2025
|
what are your plans for the pylint issues? |
dabrain34
force-pushed
the
dab_test_framework
branch
from
65282c9 to
5d45ff6
Compare
ceyusa
reviewed
Dec 3, 2025
dabrain34
force-pushed
the
dab_test_framework
branch
8 times, most recently
from
942f119 to
f8c61c9
Compare
dabrain34
force-pushed
the
dab_test_framework
branch
3 times, most recently
from
226c94e to
de5bdf6
Compare
krajunv
reviewed
Dec 11, 2025
dabrain34
force-pushed
the
dab_test_framework
branch
2 times, most recently
from
6ef9270 to
9474e6b
Compare
dabrain34
force-pushed
the
dab_test_framework
branch
3 times, most recently
from
fbfaade to
e9a6d4b
Compare
dabrain34
force-pushed
the
dab_test_framework
branch
4 times, most recently
from
8c52620 to
6d8c04c
Compare
The application should use standard exit code for most of the app exit such as EXIT_FAILURE or EXIT_SUCCESS. Add custom VVS_EXIT_CUSTOM_CODE_QUEUE_FAMILY_NOT_SUPPORT when the queue does not support the family requested. The application version is now defined in VkVSCommon.h
dabrain34
force-pushed
the
dab_test_framework
branch
12 times, most recently
from
360495c to
003bc98
Compare
This framework provides a testing infrastructure for Vulkan Video encode and decode operations. Key features: - Multi-codec support: H.264, H.265, AV1, VP9 (decode); H.264, H.265, AV1 (encode) - Automatic sample download with checksum verification (MD5/SHA256) - Decoder validation with MD5 (fluster approach) - Encoder validation via decoder roundtrip testing - External test suite support (Fluster/Soothe formats) - Flexible filtering by codec, pattern, and skipped status - Platform-agnostic (Windows/Linux) Usage: - See tests/README.md for details
dabrain34
force-pushed
the
dab_test_framework
branch
from
003bc98 to
29a1754
Compare
crmurillo
reviewed
Jan 20, 2026
|
|
||
| - **`encode_samples.json`** - Encoder test definitions with YUV input files | ||
| - **`decode_samples.json`** - Decoder test definitions with codec samples | ||
| - **`denied_samples.json`** - Test deny list with conditions for skipping tests |
Contributor
There was a problem hiding this comment.
The file name was updated to skipped_samples.json.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This framework provides a testing infrastructure for Vulkan
Video encode and decode operations.
Key features:
AV1 (encode)
Usage:
The application use standard exit code for most
of the app exit such as EXIT_FAILURE or EXIT_SUCCESS.
Add custom VVS_EXIT_UNSUPPORTED
when the queue does not support the family requested.
The application version is now defined in VkVSCommon.h