-
Notifications
You must be signed in to change notification settings - Fork 26
[TEST] Bench MLD_CONFIG_SERIAL_FIPS202_ONLY #754
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Hanno Becker <beckphan@amazon.co.uk>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mac Mini (M1, 2020) benchmarks (opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
69311 cycles |
46401 cycles |
1.49 |
ML-DSA-44 sign |
174183 cycles |
132012 cycles |
1.32 |
ML-DSA-44 verify |
68457 cycles |
47801 cycles |
1.43 |
ML-DSA-65 keypair |
122564 cycles |
81348 cycles |
1.51 |
ML-DSA-65 sign |
280551 cycles |
218272 cycles |
1.29 |
ML-DSA-65 verify |
116099 cycles |
80066 cycles |
1.45 |
ML-DSA-87 keypair |
208272 cycles |
132472 cycles |
1.57 |
ML-DSA-87 sign |
381670 cycles |
279832 cycles |
1.36 |
ML-DSA-87 verify |
202357 cycles |
130423 cycles |
1.55 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Mac Mini (M1, 2020) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
69311 cycles |
46401 cycles |
1.49 |
ML-DSA-44 sign |
174183 cycles |
132012 cycles |
1.32 |
ML-DSA-44 verify |
68457 cycles |
47801 cycles |
1.43 |
ML-DSA-65 keypair |
122564 cycles |
81348 cycles |
1.51 |
ML-DSA-65 sign |
280551 cycles |
218272 cycles |
1.29 |
ML-DSA-65 verify |
116099 cycles |
80066 cycles |
1.45 |
ML-DSA-87 keypair |
208272 cycles |
132472 cycles |
1.57 |
ML-DSA-87 sign |
381670 cycles |
279832 cycles |
1.36 |
ML-DSA-87 verify |
202357 cycles |
130423 cycles |
1.55 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mac Mini (M1, 2020) benchmarks (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
110113 cycles |
114340 cycles |
0.96 |
ML-DSA-44 sign |
428001 cycles |
428698 cycles |
1.00 |
ML-DSA-44 verify |
120104 cycles |
121503 cycles |
0.99 |
ML-DSA-65 keypair |
191963 cycles |
195867 cycles |
0.98 |
ML-DSA-65 sign |
696235 cycles |
697612 cycles |
1.00 |
ML-DSA-65 verify |
193863 cycles |
196437 cycles |
0.99 |
ML-DSA-87 keypair |
310294 cycles |
322703 cycles |
0.96 |
ML-DSA-87 sign |
861476 cycles |
879913 cycles |
0.98 |
ML-DSA-87 verify |
321465 cycles |
326641 cycles |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 4th gen (c7i)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
68455 cycles |
35634 cycles |
1.92 |
ML-DSA-44 sign |
179987 cycles |
120330 cycles |
1.50 |
ML-DSA-44 verify |
67701 cycles |
38177 cycles |
1.77 |
ML-DSA-65 keypair |
119946 cycles |
61943 cycles |
1.94 |
ML-DSA-65 sign |
287778 cycles |
201528 cycles |
1.43 |
ML-DSA-65 verify |
114182 cycles |
63378 cycles |
1.80 |
ML-DSA-87 keypair |
206023 cycles |
94335 cycles |
2.18 |
ML-DSA-87 sign |
393409 cycles |
234601 cycles |
1.68 |
ML-DSA-87 verify |
197950 cycles |
94699 cycles |
2.09 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Intel Xeon 4th gen (c7i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
68455 cycles |
35634 cycles |
1.92 |
ML-DSA-44 sign |
179987 cycles |
120330 cycles |
1.50 |
ML-DSA-44 verify |
67701 cycles |
38177 cycles |
1.77 |
ML-DSA-65 keypair |
119946 cycles |
61943 cycles |
1.94 |
ML-DSA-65 sign |
287778 cycles |
201528 cycles |
1.43 |
ML-DSA-65 verify |
114182 cycles |
63378 cycles |
1.80 |
ML-DSA-87 keypair |
206023 cycles |
94335 cycles |
2.18 |
ML-DSA-87 sign |
393409 cycles |
234601 cycles |
1.68 |
ML-DSA-87 verify |
197950 cycles |
94699 cycles |
2.09 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 4th gen (c7i) (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
92851 cycles |
96370 cycles |
0.96 |
ML-DSA-44 sign |
350672 cycles |
349450 cycles |
1.00 |
ML-DSA-44 verify |
100624 cycles |
101814 cycles |
0.99 |
ML-DSA-65 keypair |
163012 cycles |
163455 cycles |
1.00 |
ML-DSA-65 sign |
568007 cycles |
566882 cycles |
1.00 |
ML-DSA-65 verify |
161440 cycles |
166298 cycles |
0.97 |
ML-DSA-87 keypair |
262301 cycles |
268024 cycles |
0.98 |
ML-DSA-87 sign |
711476 cycles |
723716 cycles |
0.98 |
ML-DSA-87 verify |
270201 cycles |
272795 cycles |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
250255 cycles |
225589 cycles |
1.11 |
ML-DSA-44 sign |
721047 cycles |
648119 cycles |
1.11 |
ML-DSA-44 verify |
252258 cycles |
224494 cycles |
1.12 |
ML-DSA-65 keypair |
445448 cycles |
393058 cycles |
1.13 |
ML-DSA-65 sign |
1156799 cycles |
1062639 cycles |
1.09 |
ML-DSA-65 verify |
427673 cycles |
375566 cycles |
1.14 |
ML-DSA-87 keypair |
743168 cycles |
648661 cycles |
1.15 |
ML-DSA-87 sign |
1507503 cycles |
1445719 cycles |
1.04 |
ML-DSA-87 verify |
721672 cycles |
640437 cycles |
1.13 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A72 (Raspberry Pi 4) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
250255 cycles |
225589 cycles |
1.11 |
ML-DSA-44 sign |
721047 cycles |
648119 cycles |
1.11 |
ML-DSA-44 verify |
252258 cycles |
224494 cycles |
1.12 |
ML-DSA-65 keypair |
445448 cycles |
393058 cycles |
1.13 |
ML-DSA-65 sign |
1156799 cycles |
1062639 cycles |
1.09 |
ML-DSA-65 verify |
427673 cycles |
375566 cycles |
1.14 |
ML-DSA-87 keypair |
743168 cycles |
648661 cycles |
1.15 |
ML-DSA-87 sign |
1507503 cycles |
1445719 cycles |
1.04 |
ML-DSA-87 verify |
721672 cycles |
640437 cycles |
1.13 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A55 (Snapdragon 888) benchmarks (opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
268759 cycles |
279165 cycles |
0.96 |
ML-DSA-44 sign |
876376 cycles |
874261 cycles |
1.00 |
ML-DSA-44 verify |
278832 cycles |
277128 cycles |
1.01 |
ML-DSA-65 keypair |
472464 cycles |
479543 cycles |
0.99 |
ML-DSA-65 sign |
1478033 cycles |
1454731 cycles |
1.02 |
ML-DSA-65 verify |
450679 cycles |
457690 cycles |
0.98 |
ML-DSA-87 keypair |
794839 cycles |
814576 cycles |
0.98 |
ML-DSA-87 sign |
1929571 cycles |
1952187 cycles |
0.99 |
ML-DSA-87 verify |
771554 cycles |
786914 cycles |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton4
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
93934 cycles |
69066 cycles |
1.36 |
ML-DSA-44 sign |
255859 cycles |
208474 cycles |
1.23 |
ML-DSA-44 verify |
93692 cycles |
71317 cycles |
1.31 |
ML-DSA-65 keypair |
165770 cycles |
122339 cycles |
1.36 |
ML-DSA-65 sign |
410837 cycles |
342254 cycles |
1.20 |
ML-DSA-65 verify |
157292 cycles |
118498 cycles |
1.33 |
ML-DSA-87 keypair |
277502 cycles |
199585 cycles |
1.39 |
ML-DSA-87 sign |
543950 cycles |
439866 cycles |
1.24 |
ML-DSA-87 verify |
270841 cycles |
195445 cycles |
1.39 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton4'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
93934 cycles |
69066 cycles |
1.36 |
ML-DSA-44 sign |
255859 cycles |
208474 cycles |
1.23 |
ML-DSA-44 verify |
93692 cycles |
71317 cycles |
1.31 |
ML-DSA-65 keypair |
165770 cycles |
122339 cycles |
1.36 |
ML-DSA-65 sign |
410837 cycles |
342254 cycles |
1.20 |
ML-DSA-65 verify |
157292 cycles |
118498 cycles |
1.33 |
ML-DSA-87 keypair |
277502 cycles |
199585 cycles |
1.39 |
ML-DSA-87 sign |
543950 cycles |
439866 cycles |
1.24 |
ML-DSA-87 verify |
270841 cycles |
195445 cycles |
1.39 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 3rd gen (c6a)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
99258 cycles |
70402 cycles |
1.41 |
ML-DSA-44 sign |
241057 cycles |
188258 cycles |
1.28 |
ML-DSA-44 verify |
96890 cycles |
70244 cycles |
1.38 |
ML-DSA-65 keypair |
174564 cycles |
121073 cycles |
1.44 |
ML-DSA-65 sign |
380319 cycles |
300114 cycles |
1.27 |
ML-DSA-65 verify |
164487 cycles |
117273 cycles |
1.40 |
ML-DSA-87 keypair |
297417 cycles |
206560 cycles |
1.44 |
ML-DSA-87 sign |
519511 cycles |
392655 cycles |
1.32 |
ML-DSA-87 verify |
286943 cycles |
197708 cycles |
1.45 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'AMD EPYC 3rd gen (c6a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
99258 cycles |
70402 cycles |
1.41 |
ML-DSA-44 sign |
241057 cycles |
188258 cycles |
1.28 |
ML-DSA-44 verify |
96890 cycles |
70244 cycles |
1.38 |
ML-DSA-65 keypair |
174564 cycles |
121073 cycles |
1.44 |
ML-DSA-65 sign |
380319 cycles |
300114 cycles |
1.27 |
ML-DSA-65 verify |
164487 cycles |
117273 cycles |
1.40 |
ML-DSA-87 keypair |
297417 cycles |
206560 cycles |
1.44 |
ML-DSA-87 sign |
519511 cycles |
392655 cycles |
1.32 |
ML-DSA-87 verify |
286943 cycles |
197708 cycles |
1.45 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 3rd gen (c6i)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
109106 cycles |
56802 cycles |
1.92 |
ML-DSA-44 sign |
274631 cycles |
179952 cycles |
1.53 |
ML-DSA-44 verify |
107694 cycles |
61446 cycles |
1.75 |
ML-DSA-65 keypair |
192233 cycles |
99157 cycles |
1.94 |
ML-DSA-65 sign |
435317 cycles |
295764 cycles |
1.47 |
ML-DSA-65 verify |
181976 cycles |
101081 cycles |
1.80 |
ML-DSA-87 keypair |
326983 cycles |
152966 cycles |
2.14 |
ML-DSA-87 sign |
589652 cycles |
353644 cycles |
1.67 |
ML-DSA-87 verify |
316690 cycles |
153700 cycles |
2.06 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Intel Xeon 3rd gen (c6i)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
109106 cycles |
56802 cycles |
1.92 |
ML-DSA-44 sign |
274631 cycles |
179952 cycles |
1.53 |
ML-DSA-44 verify |
107694 cycles |
61446 cycles |
1.75 |
ML-DSA-65 keypair |
192233 cycles |
99157 cycles |
1.94 |
ML-DSA-65 sign |
435317 cycles |
295764 cycles |
1.47 |
ML-DSA-65 verify |
181976 cycles |
101081 cycles |
1.80 |
ML-DSA-87 keypair |
326983 cycles |
152966 cycles |
2.14 |
ML-DSA-87 sign |
589652 cycles |
353644 cycles |
1.67 |
ML-DSA-87 verify |
316690 cycles |
153700 cycles |
2.06 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 4th gen (c7a)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
84403 cycles |
41083 cycles |
2.05 |
ML-DSA-44 sign |
207123 cycles |
129539 cycles |
1.60 |
ML-DSA-44 verify |
83065 cycles |
43660 cycles |
1.90 |
ML-DSA-65 keypair |
151455 cycles |
73249 cycles |
2.07 |
ML-DSA-65 sign |
332164 cycles |
211437 cycles |
1.57 |
ML-DSA-65 verify |
142336 cycles |
73099 cycles |
1.95 |
ML-DSA-87 keypair |
253547 cycles |
115211 cycles |
2.20 |
ML-DSA-87 sign |
446381 cycles |
259199 cycles |
1.72 |
ML-DSA-87 verify |
246934 cycles |
115309 cycles |
2.14 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'AMD EPYC 4th gen (c7a)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
84403 cycles |
41083 cycles |
2.05 |
ML-DSA-44 sign |
207123 cycles |
129539 cycles |
1.60 |
ML-DSA-44 verify |
83065 cycles |
43660 cycles |
1.90 |
ML-DSA-65 keypair |
151455 cycles |
73249 cycles |
2.07 |
ML-DSA-65 sign |
332164 cycles |
211437 cycles |
1.57 |
ML-DSA-65 verify |
142336 cycles |
73099 cycles |
1.95 |
ML-DSA-87 keypair |
253547 cycles |
115211 cycles |
2.20 |
ML-DSA-87 sign |
446381 cycles |
259199 cycles |
1.72 |
ML-DSA-87 verify |
246934 cycles |
115309 cycles |
2.14 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton4 (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
126842 cycles |
128211 cycles |
0.99 |
ML-DSA-44 sign |
457402 cycles |
456792 cycles |
1.00 |
ML-DSA-44 verify |
137136 cycles |
136403 cycles |
1.01 |
ML-DSA-65 keypair |
220417 cycles |
220499 cycles |
1.00 |
ML-DSA-65 sign |
748490 cycles |
746804 cycles |
1.00 |
ML-DSA-65 verify |
222789 cycles |
220745 cycles |
1.01 |
ML-DSA-87 keypair |
363975 cycles |
365166 cycles |
1.00 |
ML-DSA-87 sign |
937288 cycles |
943188 cycles |
0.99 |
ML-DSA-87 verify |
374318 cycles |
369224 cycles |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton2
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
141568 cycles |
115123 cycles |
1.23 |
ML-DSA-44 sign |
423462 cycles |
372483 cycles |
1.14 |
ML-DSA-44 verify |
144059 cycles |
119572 cycles |
1.20 |
ML-DSA-65 keypair |
247710 cycles |
199612 cycles |
1.24 |
ML-DSA-65 sign |
690877 cycles |
615863 cycles |
1.12 |
ML-DSA-65 verify |
239365 cycles |
196757 cycles |
1.22 |
ML-DSA-87 keypair |
414440 cycles |
327036 cycles |
1.27 |
ML-DSA-87 sign |
898317 cycles |
784964 cycles |
1.14 |
ML-DSA-87 verify |
408830 cycles |
322690 cycles |
1.27 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton2'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
141568 cycles |
115123 cycles |
1.23 |
ML-DSA-44 sign |
423462 cycles |
372483 cycles |
1.14 |
ML-DSA-44 verify |
144059 cycles |
119572 cycles |
1.20 |
ML-DSA-65 keypair |
247710 cycles |
199612 cycles |
1.24 |
ML-DSA-65 sign |
690877 cycles |
615863 cycles |
1.12 |
ML-DSA-65 verify |
239365 cycles |
196757 cycles |
1.22 |
ML-DSA-87 keypair |
414440 cycles |
327036 cycles |
1.27 |
ML-DSA-87 sign |
898317 cycles |
784964 cycles |
1.14 |
ML-DSA-87 verify |
408830 cycles |
322690 cycles |
1.27 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 3rd gen (c6a) (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
139475 cycles |
136309 cycles |
1.02 |
ML-DSA-44 sign |
562000 cycles |
544469 cycles |
1.03 |
ML-DSA-44 verify |
155519 cycles |
149701 cycles |
1.04 |
ML-DSA-65 keypair |
229682 cycles |
231155 cycles |
0.99 |
ML-DSA-65 sign |
916536 cycles |
900594 cycles |
1.02 |
ML-DSA-65 verify |
242918 cycles |
241691 cycles |
1.01 |
ML-DSA-87 keypair |
374987 cycles |
376526 cycles |
1.00 |
ML-DSA-87 sign |
1118685 cycles |
1114315 cycles |
1.00 |
ML-DSA-87 verify |
396133 cycles |
389940 cycles |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'AMD EPYC 3rd gen (c6a) (no-opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 sign |
562000 cycles |
544469 cycles |
1.03 |
ML-DSA-44 verify |
155519 cycles |
149701 cycles |
1.04 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton3
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
101845 cycles |
73313 cycles |
1.39 |
ML-DSA-44 sign |
274707 cycles |
221362 cycles |
1.24 |
ML-DSA-44 verify |
101986 cycles |
76301 cycles |
1.34 |
ML-DSA-65 keypair |
180979 cycles |
129439 cycles |
1.40 |
ML-DSA-65 sign |
446718 cycles |
367978 cycles |
1.21 |
ML-DSA-65 verify |
171770 cycles |
126733 cycles |
1.36 |
ML-DSA-87 keypair |
304814 cycles |
210585 cycles |
1.45 |
ML-DSA-87 sign |
596295 cycles |
467797 cycles |
1.27 |
ML-DSA-87 verify |
298130 cycles |
206394 cycles |
1.44 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Intel Xeon 3rd gen (c6i) (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
148888 cycles |
158392 cycles |
0.94 |
ML-DSA-44 sign |
558968 cycles |
565764 cycles |
0.99 |
ML-DSA-44 verify |
163620 cycles |
170174 cycles |
0.96 |
ML-DSA-65 keypair |
253331 cycles |
269909 cycles |
0.94 |
ML-DSA-65 sign |
915930 cycles |
930662 cycles |
0.98 |
ML-DSA-65 verify |
263868 cycles |
276200 cycles |
0.96 |
ML-DSA-87 keypair |
425446 cycles |
451116 cycles |
0.94 |
ML-DSA-87 sign |
1148941 cycles |
1184313 cycles |
0.97 |
ML-DSA-87 verify |
442622 cycles |
461912 cycles |
0.96 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Graviton3'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
101845 cycles |
73313 cycles |
1.39 |
ML-DSA-44 sign |
274707 cycles |
221362 cycles |
1.24 |
ML-DSA-44 verify |
101986 cycles |
76301 cycles |
1.34 |
ML-DSA-65 keypair |
180979 cycles |
129439 cycles |
1.40 |
ML-DSA-65 sign |
446718 cycles |
367978 cycles |
1.21 |
ML-DSA-65 verify |
171770 cycles |
126733 cycles |
1.36 |
ML-DSA-87 keypair |
304814 cycles |
210585 cycles |
1.45 |
ML-DSA-87 sign |
596295 cycles |
467797 cycles |
1.27 |
ML-DSA-87 verify |
298130 cycles |
206394 cycles |
1.44 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AMD EPYC 4th gen (c7a) (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
118666 cycles |
120521 cycles |
0.98 |
ML-DSA-44 sign |
453778 cycles |
453993 cycles |
1.00 |
ML-DSA-44 verify |
130056 cycles |
130244 cycles |
1.00 |
ML-DSA-65 keypair |
199801 cycles |
204770 cycles |
0.98 |
ML-DSA-65 sign |
738576 cycles |
737583 cycles |
1.00 |
ML-DSA-65 verify |
210888 cycles |
211337 cycles |
1.00 |
ML-DSA-87 keypair |
331732 cycles |
337447 cycles |
0.98 |
ML-DSA-87 sign |
909295 cycles |
924483 cycles |
0.98 |
ML-DSA-87 verify |
345160 cycles |
346633 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton2 (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
210091 cycles |
214687 cycles |
0.98 |
ML-DSA-44 sign |
782281 cycles |
783087 cycles |
1.00 |
ML-DSA-44 verify |
230804 cycles |
230629 cycles |
1.00 |
ML-DSA-65 keypair |
383591 cycles |
385316 cycles |
1.00 |
ML-DSA-65 sign |
1306197 cycles |
1310091 cycles |
1.00 |
ML-DSA-65 verify |
378994 cycles |
376142 cycles |
1.01 |
ML-DSA-87 keypair |
598470 cycles |
607295 cycles |
0.99 |
ML-DSA-87 sign |
1604222 cycles |
1625713 cycles |
0.99 |
ML-DSA-87 verify |
620938 cycles |
618989 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
oqs-bot
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graviton3 (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
136190 cycles |
138933 cycles |
0.98 |
ML-DSA-44 sign |
493359 cycles |
493797 cycles |
1.00 |
ML-DSA-44 verify |
148433 cycles |
148542 cycles |
1.00 |
ML-DSA-65 keypair |
242294 cycles |
242264 cycles |
1.00 |
ML-DSA-65 sign |
807839 cycles |
809038 cycles |
1.00 |
ML-DSA-65 verify |
240692 cycles |
240986 cycles |
1.00 |
ML-DSA-87 keypair |
389788 cycles |
396932 cycles |
0.98 |
ML-DSA-87 sign |
1009201 cycles |
1026922 cycles |
0.98 |
ML-DSA-87 verify |
402272 cycles |
401732 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A55 (Snapdragon 888) benchmarks (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
463972 cycles |
464437 cycles |
1.00 |
ML-DSA-44 sign |
2208390 cycles |
2209734 cycles |
1.00 |
ML-DSA-44 verify |
552422 cycles |
545758 cycles |
1.01 |
ML-DSA-65 keypair |
784581 cycles |
778345 cycles |
1.01 |
ML-DSA-65 sign |
3630329 cycles |
3626961 cycles |
1.00 |
ML-DSA-65 verify |
862088 cycles |
848202 cycles |
1.02 |
ML-DSA-87 keypair |
1263118 cycles |
1253917 cycles |
1.01 |
ML-DSA-87 sign |
4440286 cycles |
4441925 cycles |
1.00 |
ML-DSA-87 verify |
1385132 cycles |
1362808 cycles |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A72 (Raspberry Pi 4) benchmarks (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
309283 cycles |
309872 cycles |
1.00 |
ML-DSA-44 sign |
1209428 cycles |
1187783 cycles |
1.02 |
ML-DSA-44 verify |
333347 cycles |
333988 cycles |
1.00 |
ML-DSA-65 keypair |
568939 cycles |
560192 cycles |
1.02 |
ML-DSA-65 sign |
1957478 cycles |
1946557 cycles |
1.01 |
ML-DSA-65 verify |
539761 cycles |
537030 cycles |
1.01 |
ML-DSA-87 keypair |
842692 cycles |
851259 cycles |
0.99 |
ML-DSA-87 sign |
2423378 cycles |
2448376 cycles |
0.99 |
ML-DSA-87 verify |
890144 cycles |
875812 cycles |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
141239 cycles |
114840 cycles |
1.23 |
ML-DSA-44 sign |
422547 cycles |
371801 cycles |
1.14 |
ML-DSA-44 verify |
143670 cycles |
119321 cycles |
1.20 |
ML-DSA-65 keypair |
247564 cycles |
199212 cycles |
1.24 |
ML-DSA-65 sign |
690125 cycles |
614733 cycles |
1.12 |
ML-DSA-65 verify |
239195 cycles |
196306 cycles |
1.22 |
ML-DSA-87 keypair |
413909 cycles |
325841 cycles |
1.27 |
ML-DSA-87 sign |
897782 cycles |
782773 cycles |
1.15 |
ML-DSA-87 verify |
408734 cycles |
322124 cycles |
1.27 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Arm Cortex-A76 (Raspberry Pi 5) benchmarks (opt)'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.03.
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
141239 cycles |
114840 cycles |
1.23 |
ML-DSA-44 sign |
422547 cycles |
371801 cycles |
1.14 |
ML-DSA-44 verify |
143670 cycles |
119321 cycles |
1.20 |
ML-DSA-65 keypair |
247564 cycles |
199212 cycles |
1.24 |
ML-DSA-65 sign |
690125 cycles |
614733 cycles |
1.12 |
ML-DSA-65 verify |
239195 cycles |
196306 cycles |
1.22 |
ML-DSA-87 keypair |
413909 cycles |
325841 cycles |
1.27 |
ML-DSA-87 sign |
897782 cycles |
782773 cycles |
1.15 |
ML-DSA-87 verify |
408734 cycles |
322124 cycles |
1.27 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Arm Cortex-A76 (Raspberry Pi 5) benchmarks (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
209591 cycles |
213772 cycles |
0.98 |
ML-DSA-44 sign |
781134 cycles |
784138 cycles |
1.00 |
ML-DSA-44 verify |
230012 cycles |
229859 cycles |
1.00 |
ML-DSA-65 keypair |
383084 cycles |
385021 cycles |
0.99 |
ML-DSA-65 sign |
1304629 cycles |
1314493 cycles |
0.99 |
ML-DSA-65 verify |
378462 cycles |
375786 cycles |
1.01 |
ML-DSA-87 keypair |
597262 cycles |
607112 cycles |
0.98 |
ML-DSA-87 sign |
1598766 cycles |
1623345 cycles |
0.98 |
ML-DSA-87 verify |
619323 cycles |
618854 cycles |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
SpacemiT K1 8 (Banana Pi F3) benchmarks (no-opt)
| Benchmark suite | Current: fa971d3 | Previous: 0e242f8 | Ratio |
|---|---|---|---|
ML-DSA-44 keypair |
814213 cycles |
827717 cycles |
0.98 |
ML-DSA-44 sign |
3338721 cycles |
3339586 cycles |
1.00 |
ML-DSA-44 verify |
918219 cycles |
919601 cycles |
1.00 |
ML-DSA-65 keypair |
1392207 cycles |
1407860 cycles |
0.99 |
ML-DSA-65 sign |
5437445 cycles |
5459687 cycles |
1.00 |
ML-DSA-65 verify |
1471931 cycles |
1471128 cycles |
1.00 |
ML-DSA-87 keypair |
2270840 cycles |
2313207 cycles |
0.98 |
ML-DSA-87 sign |
6693494 cycles |
6819578 cycles |
0.98 |
ML-DSA-87 verify |
2417709 cycles |
2403520 cycles |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
No description provided.