Skip to content

Comments

Unskip mule versions for muzzle#10661

Open
sarahchen6 wants to merge 1 commit intomasterfrom
sarahchen6/unskip-mule
Open

Unskip mule versions for muzzle#10661
sarahchen6 wants to merge 1 commit intomasterfrom
sarahchen6/unskip-mule

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Feb 23, 2026 •
edited
Loading

What Does This Do

Unskip mule versions for muzzle tests

Motivation

Looks like the missing dependencies have been uploaded (mule-runtime-bom-parent:4.6.27, mule-artifact-ast:1.5.1)!

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@sarahchen6 sarahchen6 added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Feb 23, 2026
@sarahchen6 sarahchen6 marked this pull request as ready for review February 23, 2026 16:56
@sarahchen6 sarahchen6 requested a review from a team as a code owner February 23, 2026 16:56
@pr-commenter
Copy link

pr-commenter bot commented Feb 23, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/unskip-mule
git_commit_date 1771860523 1771864026
git_commit_sha 6b1e694 5bd0eba
release_version 1.60.0-SNAPSHOT~6b1e694a3e 1.60.0-SNAPSHOT~5bd0ebaaac
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771865837 1771865837
ci_job_id 1448327554 1448327554
ci_pipeline_id 98292720 98292720
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-mlizysic 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-mlizysic 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063963
Total [baseline] (8.768 s) : 0, 8768421
Agent [candidate] (1.072 s) : 0, 1071814
Total [candidate] (8.734 s) : 0, 8734371
section iast
Agent [baseline] (1.242 s) : 0, 1242190
Total [baseline] (9.444 s) : 0, 9444373
Agent [candidate] (1.238 s) : 0, 1238255
Total [candidate] (9.364 s) : 0, 9364051
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.242 s 178.227 ms (16.8%)
Total tracing 8.768 s -
Total iast 9.444 s 675.952 ms (7.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent iast 1.238 s 166.441 ms (15.5%)
Total tracing 8.734 s -
Total iast 9.364 s 629.68 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (628.057 ms) : 0, 628057
BytebuddyAgent [candidate] (632.32 ms) : 0, 632320
AgentMeter [baseline] (29.115 ms) : 0, 29115
AgentMeter [candidate] (29.331 ms) : 0, 29331
GlobalTracer [baseline] (257.502 ms) : 0, 257502
GlobalTracer [candidate] (259.241 ms) : 0, 259241
AppSec [baseline] (32.966 ms) : 0, 32966
AppSec [candidate] (33.136 ms) : 0, 33136
Debugger [baseline] (64.02 ms) : 0, 64020
Debugger [candidate] (63.833 ms) : 0, 63833
Remote Config [baseline] (620.345 µs) : 0, 620
Remote Config [candidate] (600.257 µs) : 0, 600
Telemetry [baseline] (10.651 ms) : 0, 10651
Telemetry [candidate] (11.327 ms) : 0, 11327
Flare Poller [baseline] (3.763 ms) : 0, 3763
Flare Poller [candidate] (4.526 ms) : 0, 4526
section iast
crashtracking [baseline] (1.243 ms) : 0, 1243
crashtracking [candidate] (1.211 ms) : 0, 1211
BytebuddyAgent [baseline] (803.072 ms) : 0, 803072
BytebuddyAgent [candidate] (800.782 ms) : 0, 800782
AgentMeter [baseline] (11.582 ms) : 0, 11582
AgentMeter [candidate] (11.522 ms) : 0, 11522
GlobalTracer [baseline] (249.517 ms) : 0, 249517
GlobalTracer [candidate] (248.426 ms) : 0, 248426
IAST [baseline] (27.229 ms) : 0, 27229
IAST [candidate] (27.422 ms) : 0, 27422
AppSec [baseline] (33.511 ms) : 0, 33511
AppSec [candidate] (34.914 ms) : 0, 34914
Debugger [baseline] (67.042 ms) : 0, 67042
Debugger [candidate] (65.157 ms) : 0, 65157
Remote Config [baseline] (554.41 µs) : 0, 554
Remote Config [candidate] (542.646 µs) : 0, 543
Telemetry [baseline] (8.708 ms) : 0, 8708
Telemetry [candidate] (8.684 ms) : 0, 8684
Flare Poller [baseline] (3.535 ms) : 0, 3535
Flare Poller [candidate] (3.459 ms) : 0, 3459
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067431
Total [baseline] (10.865 s) : 0, 10864604
Agent [candidate] (1.074 s) : 0, 1073733
Total [candidate] (10.958 s) : 0, 10957712
section appsec
Agent [baseline] (1.239 s) : 0, 1239037
Total [baseline] (11.048 s) : 0, 11048223
Agent [candidate] (1.235 s) : 0, 1235218
Total [candidate] (11.02 s) : 0, 11020370
section iast
Agent [baseline] (1.236 s) : 0, 1236026
Total [baseline] (11.15 s) : 0, 11150449
Agent [candidate] (1.241 s) : 0, 1240607
Total [candidate] (11.209 s) : 0, 11209048
section profiling
Agent [baseline] (1.199 s) : 0, 1198582
Total [baseline] (11.006 s) : 0, 11005863
Agent [candidate] (1.189 s) : 0, 1189184
Total [candidate] (10.879 s) : 0, 10878530
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.239 s 171.606 ms (16.1%)
Agent iast 1.236 s 168.595 ms (15.8%)
Agent profiling 1.199 s 131.151 ms (12.3%)
Total tracing 10.865 s -
Total appsec 11.048 s 183.62 ms (1.7%)
Total iast 11.15 s 285.846 ms (2.6%)
Total profiling 11.006 s 141.26 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.235 s 161.484 ms (15.0%)
Agent iast 1.241 s 166.874 ms (15.5%)
Agent profiling 1.189 s 115.45 ms (10.8%)
Total tracing 10.958 s -
Total appsec 11.02 s 62.658 ms (0.6%)
Total iast 11.209 s 251.336 ms (2.3%)
Total profiling 10.879 s -79.182 ms (-0.7%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (630.847 ms) : 0, 630847
BytebuddyAgent [candidate] (632.702 ms) : 0, 632702
AgentMeter [baseline] (29.056 ms) : 0, 29056
AgentMeter [candidate] (29.2 ms) : 0, 29200
GlobalTracer [baseline] (257.231 ms) : 0, 257231
GlobalTracer [candidate] (259.352 ms) : 0, 259352
AppSec [baseline] (32.912 ms) : 0, 32912
AppSec [candidate] (33.183 ms) : 0, 33183
Debugger [baseline] (64.857 ms) : 0, 64857
Debugger [candidate] (66.256 ms) : 0, 66256
Remote Config [baseline] (610.642 µs) : 0, 611
Remote Config [candidate] (640.297 µs) : 0, 640
Telemetry [baseline] (10.738 ms) : 0, 10738
Telemetry [candidate] (9.857 ms) : 0, 9857
Flare Poller [baseline] (3.734 ms) : 0, 3734
Flare Poller [candidate] (5.271 ms) : 0, 5271
section appsec
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (658.352 ms) : 0, 658352
BytebuddyAgent [candidate] (656.808 ms) : 0, 656808
AgentMeter [baseline] (11.999 ms) : 0, 11999
AgentMeter [candidate] (11.901 ms) : 0, 11901
GlobalTracer [baseline] (258.463 ms) : 0, 258463
GlobalTracer [candidate] (256.945 ms) : 0, 256945
AppSec [baseline] (167.078 ms) : 0, 167078
AppSec [candidate] (167.6 ms) : 0, 167600
Debugger [baseline] (66.856 ms) : 0, 66856
Debugger [candidate] (66.051 ms) : 0, 66051
Remote Config [baseline] (645.415 µs) : 0, 645
Remote Config [candidate] (633.148 µs) : 0, 633
Telemetry [baseline] (9.482 ms) : 0, 9482
Telemetry [candidate] (9.24 ms) : 0, 9240
Flare Poller [baseline] (3.708 ms) : 0, 3708
Flare Poller [candidate] (3.694 ms) : 0, 3694
IAST [baseline] (25.368 ms) : 0, 25368
IAST [candidate] (25.292 ms) : 0, 25292
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (797.727 ms) : 0, 797727
BytebuddyAgent [candidate] (802.446 ms) : 0, 802446
AgentMeter [baseline] (11.332 ms) : 0, 11332
AgentMeter [candidate] (11.549 ms) : 0, 11549
GlobalTracer [baseline] (248.503 ms) : 0, 248503
GlobalTracer [candidate] (248.988 ms) : 0, 248988
AppSec [baseline] (33.224 ms) : 0, 33224
AppSec [candidate] (33.193 ms) : 0, 33193
Debugger [baseline] (68.23 ms) : 0, 68230
Debugger [candidate] (67.258 ms) : 0, 67258
Remote Config [baseline] (538.489 µs) : 0, 538
Remote Config [candidate] (514.652 µs) : 0, 515
Telemetry [baseline] (8.668 ms) : 0, 8668
Telemetry [candidate] (8.517 ms) : 0, 8517
Flare Poller [baseline] (3.467 ms) : 0, 3467
Flare Poller [candidate] (3.453 ms) : 0, 3453
IAST [baseline] (27.13 ms) : 0, 27130
IAST [candidate] (27.38 ms) : 0, 27380
section profiling
ProfilingAgent [baseline] (100.479 ms) : 0, 100479
ProfilingAgent [candidate] (99.364 ms) : 0, 99364
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (686.426 ms) : 0, 686426
BytebuddyAgent [candidate] (680.719 ms) : 0, 680719
AgentMeter [baseline] (8.571 ms) : 0, 8571
AgentMeter [candidate] (8.508 ms) : 0, 8508
GlobalTracer [baseline] (217.305 ms) : 0, 217305
GlobalTracer [candidate] (215.83 ms) : 0, 215830
AppSec [baseline] (32.809 ms) : 0, 32809
AppSec [candidate] (32.583 ms) : 0, 32583
Debugger [baseline] (67.349 ms) : 0, 67349
Debugger [candidate] (67.223 ms) : 0, 67223
Remote Config [baseline] (650.532 µs) : 0, 651
Remote Config [candidate] (621.557 µs) : 0, 622
Telemetry [baseline] (8.951 ms) : 0, 8951
Telemetry [candidate] (9.007 ms) : 0, 9007
Flare Poller [baseline] (3.78 ms) : 0, 3780
Flare Poller [candidate] (3.726 ms) : 0, 3726
Profiling [baseline] (101.079 ms) : 0, 101079
Profiling [candidate] (99.937 ms) : 0, 99937
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/unskip-mule
git_commit_date 1771860523 1771864026
git_commit_sha 6b1e694 5bd0eba
release_version 1.60.0-SNAPSHOT~6b1e694a3e 1.60.0-SNAPSHOT~5bd0ebaaac
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771866333 1771866333
ci_job_id 1448327555 1448327555
ci_pipeline_id 98292720 98292720
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-dh6mtd19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-dh6mtd19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+51.000µs; +148.338µs] or [+3.213%; +9.344%]		 unstable
[+265.216µs; +1099.484µs] or [+5.955%; +24.687%]		 unstable
[-499.635op/s; +27.510op/s] or [-21.354%; +1.176%]		 1.687ms 5.136ms 2103.750op/s 1.587ms 4.454ms 2339.812op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+76.559µs; +225.923µs] or [+2.969%; +8.760%]		 same
[-6.765µs; +592.722µs] or [-0.089%; +7.837%]		 unstable
[-215.672op/s; +73.359op/s] or [-15.625%; +5.315%]		 2.730ms 7.856ms 1309.125op/s 2.579ms 7.563ms 1380.281op/s
scenario:load:petclinic:iast:high_load better
[-2.132ms; -0.987ms] or [-11.389%; -5.270%]		 better
[-2.322ms; -0.916ms] or [-7.731%; -3.049%]		 unstable
[-6.442op/s; +44.879op/s] or [-2.618%; +18.239%]		 17.160ms 28.422ms 265.281op/s 18.720ms 30.041ms 246.062op/s
scenario:load:petclinic:profiling:high_load worse
[+0.894ms; +1.696ms] or [+4.922%; +9.333%]		 worse
[+0.716ms; +2.249ms] or [+2.429%; +7.630%]		 unstable
[-38.908op/s; +9.033op/s] or [-15.424%; +3.581%]		 19.467ms 30.951ms 237.312op/s 18.172ms 29.469ms 252.250op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1174, 1197
.   : milestone, 1186,
iast (3.105 ms) : 3064, 3146
.   : milestone, 3105,
iast_FULL (5.77 ms) : 5713, 5827
.   : milestone, 5770,
iast_GLOBAL (3.317 ms) : 3270, 3364
.   : milestone, 3317,
profiling (1.926 ms) : 1909, 1944
.   : milestone, 1926,
tracing (1.743 ms) : 1729, 1756
.   : milestone, 1743,
section candidate
no_agent (1.187 ms) : 1176, 1199
.   : milestone, 1187,
iast (3.117 ms) : 3073, 3161
.   : milestone, 3117,
iast_FULL (5.871 ms) : 5812, 5930
.   : milestone, 5871,
iast_GLOBAL (3.503 ms) : 3443, 3562
.   : milestone, 3503,
profiling (2.15 ms) : 2129, 2172
.   : milestone, 2150,
tracing (1.796 ms) : 1781, 1811
.   : milestone, 1796,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.197 ms] -
iast 3.105 ms [3.064 ms, 3.146 ms] 1.919 ms (161.9%)
iast_FULL 5.77 ms [5.713 ms, 5.827 ms] 4.585 ms (386.7%)
iast_GLOBAL 3.317 ms [3.27 ms, 3.364 ms] 2.131 ms (179.7%)
profiling 1.926 ms [1.909 ms, 1.944 ms] 740.702 µs (62.5%)
tracing 1.743 ms [1.729 ms, 1.756 ms] 557.106 µs (47.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.187 ms [1.176 ms, 1.199 ms] -
iast 3.117 ms [3.073 ms, 3.161 ms] 1.93 ms (162.6%)
iast_FULL 5.871 ms [5.812 ms, 5.93 ms] 4.684 ms (394.6%)
iast_GLOBAL 3.503 ms [3.443 ms, 3.562 ms] 2.316 ms (195.1%)
profiling 2.15 ms [2.129 ms, 2.172 ms] 963.157 µs (81.1%)
tracing 1.796 ms [1.781 ms, 1.811 ms] 608.6 µs (51.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.411 ms) : 18222, 18601
.   : milestone, 18411,
appsec (18.588 ms) : 18404, 18772
.   : milestone, 18588,
code_origins (18.519 ms) : 18334, 18705
.   : milestone, 18519,
iast (18.969 ms) : 18775, 19162
.   : milestone, 18969,
profiling (18.502 ms) : 18317, 18686
.   : milestone, 18502,
tracing (17.775 ms) : 17600, 17951
.   : milestone, 17775,
section candidate
no_agent (17.434 ms) : 17256, 17613
.   : milestone, 17434,
appsec (18.625 ms) : 18438, 18812
.   : milestone, 18625,
code_origins (18.445 ms) : 18263, 18628
.   : milestone, 18445,
iast (17.59 ms) : 17414, 17765
.   : milestone, 17590,
profiling (19.672 ms) : 19476, 19869
.   : milestone, 19672,
tracing (17.714 ms) : 17537, 17891
.   : milestone, 17714,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.411 ms [18.222 ms, 18.601 ms] -
appsec 18.588 ms [18.404 ms, 18.772 ms] 176.982 µs (1.0%)
code_origins 18.519 ms [18.334 ms, 18.705 ms] 108.043 µs (0.6%)
iast 18.969 ms [18.775 ms, 19.162 ms] 557.388 µs (3.0%)
profiling 18.502 ms [18.317 ms, 18.686 ms] 90.555 µs (0.5%)
tracing 17.775 ms [17.6 ms, 17.951 ms] -635.841 µs (-3.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.434 ms [17.256 ms, 17.613 ms] -
appsec 18.625 ms [18.438 ms, 18.812 ms] 1.191 ms (6.8%)
code_origins 18.445 ms [18.263 ms, 18.628 ms] 1.011 ms (5.8%)
iast 17.59 ms [17.414 ms, 17.765 ms] 155.345 µs (0.9%)
profiling 19.672 ms [19.476 ms, 19.869 ms] 2.238 ms (12.8%)
tracing 17.714 ms [17.537 ms, 17.891 ms] 279.816 µs (1.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/unskip-mule
git_commit_date 1771860523 1771864026
git_commit_sha 6b1e694 5bd0eba
release_version 1.60.0-SNAPSHOT~6b1e694a3e 1.60.0-SNAPSHOT~5bd0ebaaac
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771866144 1771866144
ci_job_id 1448327557 1448327557
ci_pipeline_id 98292720 98292720
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-zjdhvrzz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-zjdhvrzz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (3.712 ms) : 3496, 3928
.   : milestone, 3712,
iast (2.238 ms) : 2170, 2307
.   : milestone, 2238,
iast_GLOBAL (2.295 ms) : 2226, 2365
.   : milestone, 2295,
profiling (2.501 ms) : 2337, 2665
.   : milestone, 2501,
tracing (2.046 ms) : 1993, 2099
.   : milestone, 2046,
section candidate
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (3.762 ms) : 3542, 3982
.   : milestone, 3762,
iast (2.241 ms) : 2173, 2310
.   : milestone, 2241,
iast_GLOBAL (2.288 ms) : 2219, 2357
.   : milestone, 2288,
profiling (2.088 ms) : 2032, 2144
.   : milestone, 2088,
tracing (2.051 ms) : 1997, 2104
.   : milestone, 2051,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 3.712 ms [3.496 ms, 3.928 ms] 2.243 ms (152.7%)
iast 2.238 ms [2.17 ms, 2.307 ms] 769.596 µs (52.4%)
iast_GLOBAL 2.295 ms [2.226 ms, 2.365 ms] 826.414 µs (56.3%)
profiling 2.501 ms [2.337 ms, 2.665 ms] 1.032 ms (70.3%)
tracing 2.046 ms [1.993 ms, 2.099 ms] 576.991 µs (39.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.455 ms, 1.478 ms] -
appsec 3.762 ms [3.542 ms, 3.982 ms] 2.295 ms (156.6%)
iast 2.241 ms [2.173 ms, 2.31 ms] 774.772 µs (52.8%)
iast_GLOBAL 2.288 ms [2.219 ms, 2.357 ms] 821.43 µs (56.0%)
profiling 2.088 ms [2.032 ms, 2.144 ms] 621.584 µs (42.4%)
tracing 2.051 ms [1.997 ms, 2.104 ms] 584.462 µs (39.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~5bd0ebaaac, baseline=1.60.0-SNAPSHOT~6b1e694a3e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.476 s) : 15476000, 15476000
.   : milestone, 15476000,
appsec (14.885 s) : 14885000, 14885000
.   : milestone, 14885000,
iast (18.072 s) : 18072000, 18072000
.   : milestone, 18072000,
iast_GLOBAL (17.945 s) : 17945000, 17945000
.   : milestone, 17945000,
profiling (15.068 s) : 15068000, 15068000
.   : milestone, 15068000,
tracing (14.718 s) : 14718000, 14718000
.   : milestone, 14718000,
section candidate
no_agent (15.294 s) : 15294000, 15294000
.   : milestone, 15294000,
appsec (14.791 s) : 14791000, 14791000
.   : milestone, 14791000,
iast (18.114 s) : 18114000, 18114000
.   : milestone, 18114000,
iast_GLOBAL (17.845 s) : 17845000, 17845000
.   : milestone, 17845000,
profiling (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
tracing (14.939 s) : 14939000, 14939000
.   : milestone, 14939000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.476 s [15.476 s, 15.476 s] -
appsec 14.885 s [14.885 s, 14.885 s] -591.0 ms (-3.8%)
iast 18.072 s [18.072 s, 18.072 s] 2.596 s (16.8%)
iast_GLOBAL 17.945 s [17.945 s, 17.945 s] 2.469 s (16.0%)
profiling 15.068 s [15.068 s, 15.068 s] -408.0 ms (-2.6%)
tracing 14.718 s [14.718 s, 14.718 s] -758.0 ms (-4.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.294 s [15.294 s, 15.294 s] -
appsec 14.791 s [14.791 s, 14.791 s] -503.0 ms (-3.3%)
iast 18.114 s [18.114 s, 18.114 s] 2.82 s (18.4%)
iast_GLOBAL 17.845 s [17.845 s, 17.845 s] 2.551 s (16.7%)
profiling 14.98 s [14.98 s, 14.98 s] -314.0 ms (-2.1%)
tracing 14.939 s [14.939 s, 14.939 s] -355.0 ms (-2.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@sarahchen6