Add display name as parameter in JUnit5 dynamic tests by daniel-mohedano · Pull Request #10649 · DataDog/dd-trace-java

daniel-mohedano · 2026-02-20T11:11:35Z

What Does This Do

For JUnit5 Dynamic Tests, the display name will be added as a parameter: {"metadata": {"test_name": displayName}}.
A new test.junit5.is_dynamic is introduced to differentiate between actual parameterized tests and dynamic tests.

Motivation

The changes allow dynamically generated tests to have independent fingerprints. Previously, they were reported with the method name (in this case the factory method) as test.name, which made it impossible for our backend to differentiate between all dynamic tests inside the same factory. The factory method is still kept as test name to avoid possible issues where different dynamic tests might have identical display names, which would cause collisions in features such as EFD or FTM.

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

cit-pr-commenter-54b7da · 2026-02-20T11:18:43Z

Test Environment - sbt-scalatest

Job Status: success

Scenario	Overhead (%)
agent	57.90
agentEvpProxy	58.78

cit-pr-commenter-54b7da · 2026-02-20T11:21:25Z

Test Environment - netflix-zuul

Job Status: success

Scenario	Overhead (%)
agent	91.18
agentless	84.30
agentlessCodeCoverage	99.39
agentlessLineCoverage	115.79

cit-pr-commenter-54b7da · 2026-02-20T11:22:06Z

Test Environment - nebula-release-plugin

Job Status: success

Scenario	Overhead (%)
agent	37.41
agentless	37.65
agentlessCodeCoverage	43.85
agentlessLineCoverage	73.96

cit-pr-commenter-54b7da · 2026-02-20T11:23:10Z

Test Environment - reactive-streams-jvm

Job Status: success

Scenario	Overhead (%)
agent	22.57
agentless	19.19
agentlessCodeCoverage	20.95
agentlessLineCoverage	30.84

cit-pr-commenter-54b7da · 2026-02-20T11:24:52Z

Test Environment - pass4s

Job Status: success

Scenario	Overhead (%)
agent	1.68
agentless	6.77
agentlessCodeCoverage	12.15

cit-pr-commenter-54b7da · 2026-02-20T11:30:52Z

Test Environment - sonar-kotlin

Job Status: success

Scenario	Overhead (%)
agent	9.84
agentless	10.01
agentlessCodeCoverage	12.01
agentlessLineCoverage	17.68

cit-pr-commenter-54b7da · 2026-02-20T11:33:40Z

Test Environment - jolokia

Job Status: success

Scenario	Overhead (%)
agent	93.84
agentless	90.28
agentlessCodeCoverage	98.41
agentlessLineCoverage	97.79

cit-pr-commenter-54b7da · 2026-02-20T11:39:18Z

Test Environment - okhttp

Job Status: success

Scenario	Overhead (%)
agent	23.50
agentless	20.91
agentlessCodeCoverage	22.31
agentlessLineCoverage	39.70

cit-pr-commenter-54b7da · 2026-02-20T11:44:53Z

Test Environment - spring_boot

Job Status: success

Scenario	Overhead (%)
agent	16.45
agentless	10.26
agentlessCodeCoverage	12.99
agentlessLineCoverage	32.26

cit-pr-commenter-54b7da · 2026-02-20T11:58:53Z

Test Environment - sonar-java

Job Status: success

Scenario	Overhead (%)
agent	41.23
agentless	15.97
agentlessCodeCoverage	101.71
agentlessLineCoverage	144.73

pr-commenter · 2026-02-20T11:59:44Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/junit-dynamic-tests
git_commit_date	1771808874	1771843497
git_commit_sha	`d7515c8`	`1efe6a6`
release_version	1.60.0-SNAPSHOT~d7515c8b3c	1.60.0-SNAPSHOT~1efe6a6641

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1771845173	1771845173
ci_job_id	1446913138	1446913138
ci_pipeline_id	98187086	98187086
cpu_model	Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-tuokzocu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-tuokzocu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1093069
Total [baseline] (11.252 s) : 0, 11251601
Agent [candidate] (1.101 s) : 0, 1101196
Total [candidate] (11.31 s) : 0, 11309791
section appsec
Agent [baseline] (1.267 s) : 0, 1267327
Total [baseline] (11.308 s) : 0, 11307870
Agent [candidate] (1.27 s) : 0, 1270031
Total [candidate] (11.288 s) : 0, 11287675
section iast
Agent [baseline] (1.265 s) : 0, 1265207
Total [baseline] (11.464 s) : 0, 11464397
Agent [candidate] (1.275 s) : 0, 1274532
Total [candidate] (11.479 s) : 0, 11478734
section profiling
Agent [baseline] (1.226 s) : 0, 1225968
Total [baseline] (11.278 s) : 0, 11278112
Agent [candidate] (1.22 s) : 0, 1219631
Total [candidate] (11.446 s) : 0, 11445748

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.093 s	-
Agent	appsec	1.267 s	174.259 ms (15.9%)
Agent	iast	1.265 s	172.138 ms (15.7%)
Agent	profiling	1.226 s	132.9 ms (12.2%)
Total	tracing	11.252 s	-
Total	appsec	11.308 s	56.268 ms (0.5%)
Total	iast	11.464 s	212.795 ms (1.9%)
Total	profiling	11.278 s	26.511 ms (0.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.101 s	-
Agent	appsec	1.27 s	168.835 ms (15.3%)
Agent	iast	1.275 s	173.336 ms (15.7%)
Agent	profiling	1.22 s	118.435 ms (10.8%)
Total	tracing	11.31 s	-
Total	appsec	11.288 s	-22.116 ms (-0.2%)
Total	iast	11.479 s	168.944 ms (1.5%)
Total	profiling	11.446 s	135.957 ms (1.2%)

gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.276 ms) : 0, 1276
crashtracking [candidate] (1.249 ms) : 0, 1249
BytebuddyAgent [baseline] (641.988 ms) : 0, 641988
BytebuddyAgent [candidate] (644.475 ms) : 0, 644475
AgentMeter [baseline] (29.765 ms) : 0, 29765
AgentMeter [candidate] (30.175 ms) : 0, 30175
GlobalTracer [baseline] (265.393 ms) : 0, 265393
GlobalTracer [candidate] (268.476 ms) : 0, 268476
AppSec [baseline] (34.057 ms) : 0, 34057
AppSec [candidate] (34.633 ms) : 0, 34633
Debugger [baseline] (67.955 ms) : 0, 67955
Debugger [candidate] (68.601 ms) : 0, 68601
Remote Config [baseline] (660.405 µs) : 0, 660
Remote Config [candidate] (671.902 µs) : 0, 672
Telemetry [baseline] (10.398 ms) : 0, 10398
Telemetry [candidate] (10.505 ms) : 0, 10505
Flare Poller [baseline] (4.729 ms) : 0, 4729
Flare Poller [candidate] (5.644 ms) : 0, 5644
section appsec
crashtracking [baseline] (1.25 ms) : 0, 1250
crashtracking [candidate] (1.243 ms) : 0, 1243
BytebuddyAgent [baseline] (669.837 ms) : 0, 669837
BytebuddyAgent [candidate] (671.786 ms) : 0, 671786
AgentMeter [baseline] (12.337 ms) : 0, 12337
AgentMeter [candidate] (12.348 ms) : 0, 12348
GlobalTracer [baseline] (265.005 ms) : 0, 265005
GlobalTracer [candidate] (265.881 ms) : 0, 265881
IAST [baseline] (26.276 ms) : 0, 26276
IAST [candidate] (26.206 ms) : 0, 26206
AppSec [baseline] (173.245 ms) : 0, 173245
AppSec [candidate] (174.045 ms) : 0, 174045
Debugger [baseline] (68.781 ms) : 0, 68781
Debugger [candidate] (67.871 ms) : 0, 67871
Remote Config [baseline] (665.185 µs) : 0, 665
Remote Config [candidate] (671.87 µs) : 0, 672
Telemetry [baseline] (9.677 ms) : 0, 9677
Telemetry [candidate] (9.643 ms) : 0, 9643
Flare Poller [baseline] (3.629 ms) : 0, 3629
Flare Poller [candidate] (3.68 ms) : 0, 3680
section iast
crashtracking [baseline] (1.26 ms) : 0, 1260
crashtracking [candidate] (1.253 ms) : 0, 1253
BytebuddyAgent [baseline] (813.536 ms) : 0, 813536
BytebuddyAgent [candidate] (820.843 ms) : 0, 820843
AgentMeter [baseline] (11.639 ms) : 0, 11639
AgentMeter [candidate] (11.741 ms) : 0, 11741
GlobalTracer [baseline] (256.43 ms) : 0, 256430
GlobalTracer [candidate] (257.449 ms) : 0, 257449
IAST [baseline] (28.328 ms) : 0, 28328
IAST [candidate] (28.842 ms) : 0, 28842
AppSec [baseline] (35.643 ms) : 0, 35643
AppSec [candidate] (35.294 ms) : 0, 35294
Debugger [baseline] (68.526 ms) : 0, 68526
Debugger [candidate] (69.294 ms) : 0, 69294
Remote Config [baseline] (581.308 µs) : 0, 581
Remote Config [candidate] (572.349 µs) : 0, 572
Telemetry [baseline] (8.917 ms) : 0, 8917
Telemetry [candidate] (8.919 ms) : 0, 8919
Flare Poller [baseline] (3.61 ms) : 0, 3610
Flare Poller [candidate] (3.593 ms) : 0, 3593
section profiling
crashtracking [baseline] (1.253 ms) : 0, 1253
crashtracking [candidate] (1.244 ms) : 0, 1244
BytebuddyAgent [baseline] (700.181 ms) : 0, 700181
BytebuddyAgent [candidate] (697.045 ms) : 0, 697045
AgentMeter [baseline] (8.889 ms) : 0, 8889
AgentMeter [candidate] (8.813 ms) : 0, 8813
GlobalTracer [baseline] (225.067 ms) : 0, 225067
GlobalTracer [candidate] (224.44 ms) : 0, 224440
AppSec [baseline] (34.067 ms) : 0, 34067
AppSec [candidate] (33.698 ms) : 0, 33698
Debugger [baseline] (70.429 ms) : 0, 70429
Debugger [candidate] (69.299 ms) : 0, 69299
Remote Config [baseline] (680.668 µs) : 0, 681
Remote Config [candidate] (677.516 µs) : 0, 678
Telemetry [baseline] (9.389 ms) : 0, 9389
Telemetry [candidate] (9.248 ms) : 0, 9248
Flare Poller [baseline] (3.946 ms) : 0, 3946
Flare Poller [candidate] (3.778 ms) : 0, 3778
ProfilingAgent [baseline] (100.156 ms) : 0, 100156
ProfilingAgent [candidate] (99.758 ms) : 0, 99758
Profiling [baseline] (100.749 ms) : 0, 100749
Profiling [candidate] (100.352 ms) : 0, 100352

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.088 s) : 0, 1087942
Total [baseline] (9.322 s) : 0, 9322456
Agent [candidate] (1.091 s) : 0, 1091396
Total [candidate] (9.38 s) : 0, 9380166
section iast
Agent [baseline] (1.26 s) : 0, 1259535
Total [baseline] (9.988 s) : 0, 9987766
Agent [candidate] (1.268 s) : 0, 1267533
Total [candidate] (9.951 s) : 0, 9950775

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.088 s	-
Agent	iast	1.26 s	171.593 ms (15.8%)
Total	tracing	9.322 s	-
Total	iast	9.988 s	665.31 ms (7.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.091 s	-
Agent	iast	1.268 s	176.137 ms (16.1%)
Total	tracing	9.38 s	-
Total	iast	9.951 s	570.609 ms (6.1%)

gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.237 ms) : 0, 1237
crashtracking [candidate] (1.25 ms) : 0, 1250
BytebuddyAgent [baseline] (639.375 ms) : 0, 639375
BytebuddyAgent [candidate] (640.828 ms) : 0, 640828
AgentMeter [baseline] (29.58 ms) : 0, 29580
AgentMeter [candidate] (29.655 ms) : 0, 29655
GlobalTracer [baseline] (264.614 ms) : 0, 264614
GlobalTracer [candidate] (265.155 ms) : 0, 265155
AppSec [baseline] (33.572 ms) : 0, 33572
AppSec [candidate] (33.698 ms) : 0, 33698
Debugger [baseline] (66.641 ms) : 0, 66641
Debugger [candidate] (69.064 ms) : 0, 69064
Remote Config [baseline] (638.501 µs) : 0, 639
Remote Config [candidate] (635.237 µs) : 0, 635
Telemetry [baseline] (10.2 ms) : 0, 10200
Telemetry [candidate] (9.561 ms) : 0, 9561
Flare Poller [baseline] (5.502 ms) : 0, 5502
Flare Poller [candidate] (4.745 ms) : 0, 4745
section iast
crashtracking [baseline] (1.245 ms) : 0, 1245
crashtracking [candidate] (1.255 ms) : 0, 1255
BytebuddyAgent [baseline] (811.448 ms) : 0, 811448
BytebuddyAgent [candidate] (817.439 ms) : 0, 817439
AgentMeter [baseline] (11.59 ms) : 0, 11590
AgentMeter [candidate] (11.684 ms) : 0, 11684
GlobalTracer [baseline] (255.289 ms) : 0, 255289
GlobalTracer [candidate] (256.57 ms) : 0, 256570
IAST [baseline] (28.216 ms) : 0, 28216
IAST [candidate] (28.607 ms) : 0, 28607
AppSec [baseline] (37.101 ms) : 0, 37101
AppSec [candidate] (35.286 ms) : 0, 35286
Debugger [baseline] (65.165 ms) : 0, 65165
Debugger [candidate] (67.197 ms) : 0, 67197
Remote Config [baseline] (574.336 µs) : 0, 574
Remote Config [candidate] (556.501 µs) : 0, 557
Telemetry [baseline] (8.923 ms) : 0, 8923
Telemetry [candidate] (8.816 ms) : 0, 8816
Flare Poller [baseline] (3.592 ms) : 0, 3592
Flare Poller [candidate] (3.519 ms) : 0, 3519

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/junit-dynamic-tests
git_commit_date	1771808874	1771843497
git_commit_sha	`d7515c8`	`1efe6a6`
release_version	1.60.0-SNAPSHOT~d7515c8b3c	1.60.0-SNAPSHOT~1efe6a6641

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1771845699	1771845699
ci_job_id	1446913139	1446913139
ci_pipeline_id	98187086	98187086
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-ehl532d8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-ehl532d8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 6 performance improvements and 1 performance regressions! Performance is the same for 12 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-311.917µs; -216.709µs] or [-10.749%; -7.468%]	better [-670.581µs; -320.214µs] or [-8.323%; -3.974%]	unstable [-31.690op/s; +233.440op/s] or [-2.520%; +18.564%]	2.637ms	7.562ms	1358.344op/s	2.902ms	8.057ms	1257.469op/s
scenario:load:insecure-bank:no_agent:high_load	better [-50.952µs; -20.392µs] or [-5.113%; -2.046%]	unstable [-338.970µs; +194.903µs] or [-12.381%; +7.119%]	unstable [-258.591op/s; +523.528op/s] or [-7.095%; +14.365%]	960.879µs	2.666ms	3776.906op/s	996.551µs	2.738ms	3644.438op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-342.142µs; -108.480µs] or [-6.528%; -2.070%]	unsure [-853.838µs; -168.136µs] or [-6.858%; -1.351%]	unstable [-45.057op/s; +105.432op/s] or [-5.730%; +13.409%]	5.016ms	11.939ms	816.469op/s	5.241ms	12.450ms	786.281op/s
scenario:load:petclinic:code_origins:high_load	worse [+388.509µs; +1213.164µs] or [+2.251%; +7.029%]	same [-9.820µs; +1593.650µs] or [-0.034%; +5.593%]	unstable [-35.113op/s; +14.488op/s] or [-13.269%; +5.475%]	18.061ms	29.286ms	254.312op/s	17.260ms	28.494ms	264.625op/s
scenario:load:petclinic:tracing:high_load	better [-1.653ms; -0.819ms] or [-9.019%; -4.468%]	better [-2.303ms; -0.827ms] or [-7.730%; -2.777%]	unstable [-8.794op/s; +40.107op/s] or [-3.505%; +15.987%]	17.088ms	28.229ms	266.531op/s	18.324ms	29.794ms	250.875op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.086 ms) : 18890, 19282
.   : milestone, 19086,
appsec (18.269 ms) : 18085, 18453
.   : milestone, 18269,
code_origins (17.631 ms) : 17459, 17803
.   : milestone, 17631,
iast (17.61 ms) : 17435, 17785
.   : milestone, 17610,
profiling (18.824 ms) : 18637, 19012
.   : milestone, 18824,
tracing (18.606 ms) : 18420, 18791
.   : milestone, 18606,
section candidate
no_agent (19.032 ms) : 18835, 19228
.   : milestone, 19032,
appsec (18.708 ms) : 18521, 18895
.   : milestone, 18708,
code_origins (18.354 ms) : 18169, 18540
.   : milestone, 18354,
iast (17.416 ms) : 17242, 17589
.   : milestone, 17416,
profiling (18.632 ms) : 18447, 18818
.   : milestone, 18632,
tracing (17.505 ms) : 17333, 17677
.   : milestone, 17505,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.086 ms [18.89 ms, 19.282 ms]	-
appsec	18.269 ms [18.085 ms, 18.453 ms]	-816.621 µs (-4.3%)
code_origins	17.631 ms [17.459 ms, 17.803 ms]	-1.455 ms (-7.6%)
iast	17.61 ms [17.435 ms, 17.785 ms]	-1.476 ms (-7.7%)
profiling	18.824 ms [18.637 ms, 19.012 ms]	-261.809 µs (-1.4%)
tracing	18.606 ms [18.42 ms, 18.791 ms]	-480.427 µs (-2.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.032 ms [18.835 ms, 19.228 ms]	-
appsec	18.708 ms [18.521 ms, 18.895 ms]	-323.589 µs (-1.7%)
code_origins	18.354 ms [18.169 ms, 18.54 ms]	-677.329 µs (-3.6%)
iast	17.416 ms [17.242 ms, 17.589 ms]	-1.616 ms (-8.5%)
profiling	18.632 ms [18.447 ms, 18.818 ms]	-399.154 µs (-2.1%)
tracing	17.505 ms [17.333 ms, 17.677 ms]	-1.527 ms (-8.0%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.21 ms) : 1198, 1222
.   : milestone, 1210,
iast (3.139 ms) : 3101, 3177
.   : milestone, 3139,
iast_FULL (5.882 ms) : 5823, 5941
.   : milestone, 5882,
iast_GLOBAL (3.649 ms) : 3593, 3705
.   : milestone, 3649,
profiling (2.175 ms) : 2154, 2195
.   : milestone, 2175,
tracing (1.842 ms) : 1826, 1857
.   : milestone, 1842,
section candidate
no_agent (1.166 ms) : 1155, 1177
.   : milestone, 1166,
iast (3.173 ms) : 3126, 3220
.   : milestone, 3173,
iast_FULL (5.661 ms) : 5606, 5717
.   : milestone, 5661,
iast_GLOBAL (3.371 ms) : 3322, 3420
.   : milestone, 3371,
profiling (2.093 ms) : 2074, 2112
.   : milestone, 2093,
tracing (1.806 ms) : 1791, 1821
.   : milestone, 1806,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.21 ms [1.198 ms, 1.222 ms]	-
iast	3.139 ms [3.101 ms, 3.177 ms]	1.929 ms (159.4%)
iast_FULL	5.882 ms [5.823 ms, 5.941 ms]	4.672 ms (386.1%)
iast_GLOBAL	3.649 ms [3.593 ms, 3.705 ms]	2.439 ms (201.6%)
profiling	2.175 ms [2.154 ms, 2.195 ms]	964.579 µs (79.7%)
tracing	1.842 ms [1.826 ms, 1.857 ms]	631.607 µs (52.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.166 ms [1.155 ms, 1.177 ms]	-
iast	3.173 ms [3.126 ms, 3.22 ms]	2.007 ms (172.2%)
iast_FULL	5.661 ms [5.606 ms, 5.717 ms]	4.495 ms (385.6%)
iast_GLOBAL	3.371 ms [3.322 ms, 3.42 ms]	2.205 ms (189.2%)
profiling	2.093 ms [2.074 ms, 2.112 ms]	927.107 µs (79.5%)
tracing	1.806 ms [1.791 ms, 1.821 ms]	640.107 µs (54.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/junit-dynamic-tests
git_commit_date	1771808874	1771843497
git_commit_sha	`d7515c8`	`1efe6a6`
release_version	1.60.0-SNAPSHOT~d7515c8b3c	1.60.0-SNAPSHOT~1efe6a6641

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1771845293	1771845293
ci_job_id	1446913140	1446913140
ci_pipeline_id	98187086	98187086
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-730241s8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-730241s8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
appsec (14.889 s) : 14889000, 14889000
.   : milestone, 14889000,
iast (18.306 s) : 18306000, 18306000
.   : milestone, 18306000,
iast_GLOBAL (18.032 s) : 18032000, 18032000
.   : milestone, 18032000,
profiling (14.878 s) : 14878000, 14878000
.   : milestone, 14878000,
tracing (14.56 s) : 14560000, 14560000
.   : milestone, 14560000,
section candidate
no_agent (15.316 s) : 15316000, 15316000
.   : milestone, 15316000,
appsec (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
iast (18.258 s) : 18258000, 18258000
.   : milestone, 18258000,
iast_GLOBAL (17.702 s) : 17702000, 17702000
.   : milestone, 17702000,
profiling (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
tracing (14.75 s) : 14750000, 14750000
.   : milestone, 14750000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.847 s [14.847 s, 14.847 s]	-
appsec	14.889 s [14.889 s, 14.889 s]	42.0 ms (0.3%)
iast	18.306 s [18.306 s, 18.306 s]	3.459 s (23.3%)
iast_GLOBAL	18.032 s [18.032 s, 18.032 s]	3.185 s (21.5%)
profiling	14.878 s [14.878 s, 14.878 s]	31.0 ms (0.2%)
tracing	14.56 s [14.56 s, 14.56 s]	-287.0 ms (-1.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.316 s [15.316 s, 15.316 s]	-
appsec	14.87 s [14.87 s, 14.87 s]	-446.0 ms (-2.9%)
iast	18.258 s [18.258 s, 18.258 s]	2.942 s (19.2%)
iast_GLOBAL	17.702 s [17.702 s, 17.702 s]	2.386 s (15.6%)
profiling	14.843 s [14.843 s, 14.843 s]	-473.0 ms (-3.1%)
tracing	14.75 s [14.75 s, 14.75 s]	-566.0 ms (-3.7%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~1efe6a6641, baseline=1.60.0-SNAPSHOT~d7515c8b3c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.5 ms) : 2445, 2554
.   : milestone, 2500,
iast (2.241 ms) : 2172, 2310
.   : milestone, 2241,
iast_GLOBAL (2.284 ms) : 2215, 2353
.   : milestone, 2284,
profiling (2.066 ms) : 2011, 2120
.   : milestone, 2066,
tracing (2.045 ms) : 1993, 2098
.   : milestone, 2045,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.753 ms) : 3532, 3973
.   : milestone, 3753,
iast (2.246 ms) : 2178, 2315
.   : milestone, 2246,
iast_GLOBAL (2.288 ms) : 2218, 2357
.   : milestone, 2288,
profiling (2.099 ms) : 2043, 2155
.   : milestone, 2099,
tracing (2.052 ms) : 1999, 2105
.   : milestone, 2052,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.469 ms [1.458 ms, 1.481 ms]	-
appsec	2.5 ms [2.445 ms, 2.554 ms]	1.031 ms (70.2%)
iast	2.241 ms [2.172 ms, 2.31 ms]	771.984 µs (52.5%)
iast_GLOBAL	2.284 ms [2.215 ms, 2.353 ms]	814.84 µs (55.5%)
profiling	2.066 ms [2.011 ms, 2.12 ms]	596.421 µs (40.6%)
tracing	2.045 ms [1.993 ms, 2.098 ms]	576.152 µs (39.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.459 ms, 1.482 ms]	-
appsec	3.753 ms [3.532 ms, 3.973 ms]	2.282 ms (155.2%)
iast	2.246 ms [2.178 ms, 2.315 ms]	776.163 µs (52.8%)
iast_GLOBAL	2.288 ms [2.218 ms, 2.357 ms]	817.281 µs (55.6%)
profiling	2.099 ms [2.043 ms, 2.155 ms]	628.95 µs (42.8%)
tracing	2.052 ms [1.999 ms, 2.105 ms]	581.729 µs (39.6%)

dd-octo-sts · 2026-02-23T10:03:18Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-02-23T10:03:23Z

View all feedbacks in Devflow UI.

2026-02-23 10:03:23 UTC ℹ️ Start processing command /merge

2026-02-23 10:03:28 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-02-23 10:09:17 UTC ℹ️ MergeQueue: Readding this merge request to the queue because another merge request processed with yours failed. No action is needed from your side.

2026-02-23 10:45:05 UTC ❌ MergeQueue: This merge request was updated

This PR is rejected because it was updated

dd-octo-sts · 2026-02-23T12:19:50Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-02-23T12:19:55Z

View all feedbacks in Devflow UI.

2026-02-23 12:19:55 UTC ℹ️ Start processing command /merge

2026-02-23 12:19:59 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-02-23 13:20:13 UTC ℹ️ MergeQueue: This merge request was merged

feat: add display name as parameter for dynamic tests

721ab9a

daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Feb 20, 2026

chore: lint

c0271a7

daniel-mohedano marked this pull request as ready for review February 20, 2026 13:20

daniel-mohedano requested review from a team as code owners February 20, 2026 13:20

daniel-mohedano requested review from mhlidd and removed request for a team February 20, 2026 13:20

nikita-tkachenko-datadog approved these changes Feb 20, 2026

View reviewed changes

fix: tag name

1e40a01

daniel-mohedano added this pull request to the merge queue Feb 23, 2026

github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 23, 2026

Merge branch 'master' into daniel.mohedano/junit-dynamic-tests

1efe6a6

daniel-mohedano added this pull request to the merge queue Feb 23, 2026

github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 23, 2026

gh-worker-dd-mergequeue-cf854d bot merged commit 8d2b769 into master Feb 23, 2026
580 checks passed

gh-worker-dd-mergequeue-cf854d bot deleted the daniel.mohedano/junit-dynamic-tests branch February 23, 2026 13:20

github-actions bot added this to the 1.60.0 milestone Feb 23, 2026

Comments

Conversation

daniel-mohedano commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Contributor Checklist

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sbt-scalatest

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - netflix-zuul

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - nebula-release-plugin

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - reactive-streams-jvm

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - pass4s

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sonar-kotlin

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - jolokia

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - okhttp

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - spring_boot

Uh oh!

cit-pr-commenter-54b7da bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sonar-java

Uh oh!

pr-commenter bot commented Feb 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

dd-octo-sts bot commented Feb 23, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

dd-octo-sts bot commented Feb 23, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

daniel-mohedano commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Feb 20, 2026 •

edited

Loading

pr-commenter bot commented Feb 20, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Feb 23, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Feb 23, 2026 •

edited

Loading