Skip to content

Conversation

@sarahchen6
Copy link
Contributor

What Does This Do

Update gradle compile tasks written in list format to use lazy API formatting. Also add types to compile tasks.

Motivation

Build improvements

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Sep 25, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Sep 25, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 57.96% (-0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 0d747e0 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 25, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazyfy-compile-tasks
git_commit_date 1759259900 1759305607
git_commit_sha ffc2be9 0d747e0
See matching parameters
Baseline Candidate
ci_job_date 1759306605 1759306605
ci_job_id 1156586447 1156586447
ci_pipeline_id 78036025 78036025
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Sep 25, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazyfy-compile-tasks
git_commit_date 1759259900 1759305607
git_commit_sha ffc2be9 0d747e0
release_version 1.54.0-SNAPSHOT~ffc2be9352 1.54.0-SNAPSHOT~0d747e0678
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759307377 1759307377
ci_job_id 1156586442 1156586442
ci_pipeline_id 78036025 78036025
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-7-u2r9wqkx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-7-u2r9wqkx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.013 s) : 0, 1012873
Total [baseline] (8.668 s) : 0, 8668110
Agent [candidate] (1.016 s) : 0, 1015798
Total [candidate] (8.67 s) : 0, 8669836
section iast
Agent [baseline] (1.143 s) : 0, 1143374
Total [baseline] (9.212 s) : 0, 9211702
Agent [candidate] (1.149 s) : 0, 1149190
Total [candidate] (9.23 s) : 0, 9229783
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.013 s -
Agent iast 1.143 s 130.501 ms (12.9%)
Total tracing 8.668 s -
Total iast 9.212 s 543.592 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.016 s -
Agent iast 1.149 s 133.391 ms (13.1%)
Total tracing 8.67 s -
Total iast 9.23 s 559.947 ms (6.5%)
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (689.12 ms) : 0, 689120
BytebuddyAgent [candidate] (691.882 ms) : 0, 691882
GlobalTracer [baseline] (242.377 ms) : 0, 242377
GlobalTracer [candidate] (243.524 ms) : 0, 243524
AppSec [baseline] (31.094 ms) : 0, 31094
AppSec [candidate] (31.092 ms) : 0, 31092
Debugger [baseline] (6.311 ms) : 0, 6311
Debugger [candidate] (6.292 ms) : 0, 6292
Remote Config [baseline] (673.857 µs) : 0, 674
Remote Config [candidate] (665.889 µs) : 0, 666
Telemetry [baseline] (9.026 ms) : 0, 9026
Telemetry [candidate] (8.901 ms) : 0, 8901
Flare Poller [baseline] (11.62 ms) : 0, 11620
Flare Poller [candidate] (10.889 ms) : 0, 10889
section iast
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (809.264 ms) : 0, 809264
BytebuddyAgent [candidate] (813.756 ms) : 0, 813756
GlobalTracer [baseline] (232.25 ms) : 0, 232250
GlobalTracer [candidate] (233.239 ms) : 0, 233239
AppSec [baseline] (34.0 ms) : 0, 34000
AppSec [candidate] (33.794 ms) : 0, 33794
Debugger [baseline] (6.011 ms) : 0, 6011
Debugger [candidate] (6.023 ms) : 0, 6023
Remote Config [baseline] (590.722 µs) : 0, 591
Remote Config [candidate] (605.859 µs) : 0, 606
Telemetry [baseline] (8.072 ms) : 0, 8072
Telemetry [candidate] (8.158 ms) : 0, 8158
Flare Poller [baseline] (4.253 ms) : 0, 4253
Flare Poller [candidate] (4.18 ms) : 0, 4180
IAST [baseline] (26.075 ms) : 0, 26075
IAST [candidate] (26.493 ms) : 0, 26493
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.014 s) : 0, 1013962
Total [baseline] (10.717 s) : 0, 10717004
Agent [candidate] (1.017 s) : 0, 1016811
Total [candidate] (10.761 s) : 0, 10760743
section appsec
Agent [baseline] (1.196 s) : 0, 1196436
Total [baseline] (11.061 s) : 0, 11061064
Agent [candidate] (1.198 s) : 0, 1198404
Total [candidate] (11.041 s) : 0, 11041121
section iast
Agent [baseline] (1.148 s) : 0, 1147814
Total [baseline] (10.873 s) : 0, 10873034
Agent [candidate] (1.148 s) : 0, 1148141
Total [candidate] (10.967 s) : 0, 10966846
section profiling
Agent [baseline] (1.159 s) : 0, 1158814
Total [baseline] (11.044 s) : 0, 11044165
Agent [candidate] (1.171 s) : 0, 1171340
Total [candidate] (11.185 s) : 0, 11184602
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.014 s -
Agent appsec 1.196 s 182.474 ms (18.0%)
Agent iast 1.148 s 133.851 ms (13.2%)
Agent profiling 1.159 s 144.852 ms (14.3%)
Total tracing 10.717 s -
Total appsec 11.061 s 344.06 ms (3.2%)
Total iast 10.873 s 156.03 ms (1.5%)
Total profiling 11.044 s 327.161 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent appsec 1.198 s 181.592 ms (17.9%)
Agent iast 1.148 s 131.33 ms (12.9%)
Agent profiling 1.171 s 154.529 ms (15.2%)
Total tracing 10.761 s -
Total appsec 11.041 s 280.377 ms (2.6%)
Total iast 10.967 s 206.103 ms (1.9%)
Total profiling 11.185 s 423.859 ms (3.9%)
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (688.649 ms) : 0, 688649
BytebuddyAgent [candidate] (691.427 ms) : 0, 691427
GlobalTracer [baseline] (243.989 ms) : 0, 243989
GlobalTracer [candidate] (243.621 ms) : 0, 243621
AppSec [baseline] (31.564 ms) : 0, 31564
AppSec [candidate] (31.182 ms) : 0, 31182
Debugger [baseline] (6.396 ms) : 0, 6396
Debugger [candidate] (6.352 ms) : 0, 6352
Remote Config [baseline] (682.979 µs) : 0, 683
Remote Config [candidate] (678.928 µs) : 0, 679
Telemetry [baseline] (9.137 ms) : 0, 9137
Telemetry [candidate] (8.976 ms) : 0, 8976
Flare Poller [baseline] (10.905 ms) : 0, 10905
Flare Poller [candidate] (11.871 ms) : 0, 11871
section appsec
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (719.486 ms) : 0, 719486
BytebuddyAgent [candidate] (720.9 ms) : 0, 720900
GlobalTracer [baseline] (236.092 ms) : 0, 236092
GlobalTracer [candidate] (236.412 ms) : 0, 236412
IAST [baseline] (25.183 ms) : 0, 25183
IAST [candidate] (25.239 ms) : 0, 25239
AppSec [baseline] (172.986 ms) : 0, 172986
AppSec [candidate] (172.297 ms) : 0, 172297
Debugger [baseline] (6.069 ms) : 0, 6069
Debugger [candidate] (6.14 ms) : 0, 6140
Remote Config [baseline] (633.619 µs) : 0, 634
Remote Config [candidate] (641.165 µs) : 0, 641
Telemetry [baseline] (8.394 ms) : 0, 8394
Telemetry [candidate] (8.378 ms) : 0, 8378
Flare Poller [baseline] (4.902 ms) : 0, 4902
Flare Poller [candidate] (5.677 ms) : 0, 5677
section iast
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (812.399 ms) : 0, 812399
BytebuddyAgent [candidate] (812.541 ms) : 0, 812541
GlobalTracer [baseline] (233.008 ms) : 0, 233008
GlobalTracer [candidate] (233.101 ms) : 0, 233101
IAST [baseline] (26.272 ms) : 0, 26272
IAST [candidate] (26.356 ms) : 0, 26356
AppSec [baseline] (34.245 ms) : 0, 34245
AppSec [candidate] (34.14 ms) : 0, 34140
Debugger [baseline] (6.026 ms) : 0, 6026
Debugger [candidate] (6.041 ms) : 0, 6041
Remote Config [baseline] (575.838 µs) : 0, 576
Remote Config [candidate] (586.339 µs) : 0, 586
Telemetry [baseline] (8.11 ms) : 0, 8110
Telemetry [candidate] (8.192 ms) : 0, 8192
Flare Poller [baseline] (4.263 ms) : 0, 4263
Flare Poller [candidate] (4.2 ms) : 0, 4200
section profiling
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (723.035 ms) : 0, 723035
BytebuddyAgent [candidate] (729.99 ms) : 0, 729990
GlobalTracer [baseline] (219.127 ms) : 0, 219127
GlobalTracer [candidate] (220.546 ms) : 0, 220546
AppSec [baseline] (31.517 ms) : 0, 31517
AppSec [candidate] (31.897 ms) : 0, 31897
Debugger [baseline] (7.423 ms) : 0, 7423
Debugger [candidate] (6.648 ms) : 0, 6648
Remote Config [baseline] (718.467 µs) : 0, 718
Remote Config [candidate] (1.456 ms) : 0, 1456
Telemetry [baseline] (15.622 ms) : 0, 15622
Telemetry [candidate] (14.908 ms) : 0, 14908
Flare Poller [baseline] (4.229 ms) : 0, 4229
Flare Poller [candidate] (5.121 ms) : 0, 5121
ProfilingAgent [baseline] (102.4 ms) : 0, 102400
ProfilingAgent [candidate] (105.449 ms) : 0, 105449
Profiling [baseline] (103.597 ms) : 0, 103597
Profiling [candidate] (106.754 ms) : 0, 106754
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazyfy-compile-tasks
git_commit_date 1759259900 1759305607
git_commit_sha ffc2be9 0d747e0
release_version 1.54.0-SNAPSHOT~ffc2be9352 1.54.0-SNAPSHOT~0d747e0678
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759307046 1759307046
ci_job_id 1156586443 1156586443
ci_pipeline_id 78036025 78036025
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-6-xbdaw3oc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-6-xbdaw3oc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-1113.951µs; -755.048µs] or [-10.776%; -7.304%]
unstable
[-11.155op/s; +99.655op/s] or [-2.482%; +22.169%]
9.403ms 493.781op/s 10.338ms 449.531op/s
scenario:load:insecure-bank:profiling:high_load better
[-526.707µs; -221.705µs] or [-5.762%; -2.425%]
unstable
[-43.051op/s; +85.989op/s] or [-8.480%; +16.938%]
8.767ms 529.125op/s 9.141ms 507.656op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+447.326µs; +1049.425µs] or [+3.238%; +7.595%]
unstable
[-53.768op/s; +19.080op/s] or [-15.940%; +5.657%]
14.565ms 319.969op/s 13.817ms 337.312op/s
scenario:load:petclinic:profiling:high_load better
[-2.087ms; -1.096ms] or [-4.241%; -2.228%]
unstable
[-4.214op/s; +10.689op/s] or [-4.431%; +11.239%]
47.617ms 98.338op/s 49.208ms 95.100op/s
scenario:load:petclinic:appsec:high_load worse
[+1.122ms; +2.039ms] or [+2.314%; +4.205%]
unstable
[-10.062op/s; +3.987op/s] or [-10.424%; +4.130%]
50.069ms 93.487op/s 48.489ms 96.525op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.014 ms) : 36712, 37316
.   : milestone, 37014,
appsec (48.489 ms) : 48064, 48913
.   : milestone, 48489,
code_origins (43.992 ms) : 43620, 44363
.   : milestone, 43992,
iast (45.158 ms) : 44756, 45559
.   : milestone, 45158,
profiling (49.208 ms) : 48745, 49671
.   : milestone, 49208,
tracing (45.989 ms) : 45603, 46375
.   : milestone, 45989,
section candidate
no_agent (36.357 ms) : 36059, 36655
.   : milestone, 36357,
appsec (50.069 ms) : 49641, 50497
.   : milestone, 50069,
code_origins (43.546 ms) : 43163, 43928
.   : milestone, 43546,
iast (45.481 ms) : 45091, 45871
.   : milestone, 45481,
profiling (47.617 ms) : 47158, 48075
.   : milestone, 47617,
tracing (44.667 ms) : 44294, 45040
.   : milestone, 44667,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.014 ms [36.712 ms, 37.316 ms] -
appsec 48.489 ms [48.064 ms, 48.913 ms] 11.474 ms (31.0%)
code_origins 43.992 ms [43.62 ms, 44.363 ms] 6.978 ms (18.9%)
iast 45.158 ms [44.756 ms, 45.559 ms] 8.144 ms (22.0%)
profiling 49.208 ms [48.745 ms, 49.671 ms] 12.194 ms (32.9%)
tracing 45.989 ms [45.603 ms, 46.375 ms] 8.975 ms (24.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.357 ms [36.059 ms, 36.655 ms] -
appsec 50.069 ms [49.641 ms, 50.497 ms] 13.712 ms (37.7%)
code_origins 43.546 ms [43.163 ms, 43.928 ms] 7.188 ms (19.8%)
iast 45.481 ms [45.091 ms, 45.871 ms] 9.124 ms (25.1%)
profiling 47.617 ms [47.158 ms, 48.075 ms] 11.259 ms (31.0%)
tracing 44.667 ms [44.294 ms, 45.04 ms] 8.309 ms (22.9%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.449 ms) : 4398, 4500
.   : milestone, 4449,
iast (10.338 ms) : 10161, 10514
.   : milestone, 10338,
iast_FULL (13.817 ms) : 13547, 14087
.   : milestone, 13817,
iast_GLOBAL (11.234 ms) : 11033, 11435
.   : milestone, 11234,
profiling (9.141 ms) : 8999, 9283
.   : milestone, 9141,
tracing (7.889 ms) : 7775, 8003
.   : milestone, 7889,
section candidate
no_agent (4.331 ms) : 4283, 4378
.   : milestone, 4331,
iast (9.403 ms) : 9247, 9559
.   : milestone, 9403,
iast_FULL (14.565 ms) : 14276, 14855
.   : milestone, 14565,
iast_GLOBAL (11.153 ms) : 10953, 11354
.   : milestone, 11153,
profiling (8.767 ms) : 8625, 8909
.   : milestone, 8767,
tracing (8.053 ms) : 7939, 8168
.   : milestone, 8053,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.449 ms [4.398 ms, 4.5 ms] -
iast 10.338 ms [10.161 ms, 10.514 ms] 5.888 ms (132.4%)
iast_FULL 13.817 ms [13.547 ms, 14.087 ms] 9.368 ms (210.6%)
iast_GLOBAL 11.234 ms [11.033 ms, 11.435 ms] 6.785 ms (152.5%)
profiling 9.141 ms [8.999 ms, 9.283 ms] 4.692 ms (105.5%)
tracing 7.889 ms [7.775 ms, 8.003 ms] 3.44 ms (77.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.331 ms [4.283 ms, 4.378 ms] -
iast 9.403 ms [9.247 ms, 9.559 ms] 5.072 ms (117.1%)
iast_FULL 14.565 ms [14.276 ms, 14.855 ms] 10.235 ms (236.3%)
iast_GLOBAL 11.153 ms [10.953 ms, 11.354 ms] 6.823 ms (157.5%)
profiling 8.767 ms [8.625 ms, 8.909 ms] 4.436 ms (102.4%)
tracing 8.053 ms [7.939 ms, 8.168 ms] 3.723 ms (86.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazyfy-compile-tasks
git_commit_date 1759259900 1759305607
git_commit_sha ffc2be9 0d747e0
release_version 1.54.0-SNAPSHOT~ffc2be9352 1.54.0-SNAPSHOT~0d747e0678
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759307591 1759307591
ci_job_id 1156586444 1156586444
ci_pipeline_id 78036025 78036025
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-6-4h0s4nq1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-6-4h0s4nq1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.652 ms) : 3437, 3866
.   : milestone, 3652,
iast (2.199 ms) : 2136, 2261
.   : milestone, 2199,
iast_GLOBAL (2.246 ms) : 2182, 2310
.   : milestone, 2246,
profiling (2.036 ms) : 1985, 2086
.   : milestone, 2036,
tracing (2.022 ms) : 1973, 2072
.   : milestone, 2022,
section candidate
no_agent (1.478 ms) : 1466, 1490
.   : milestone, 1478,
appsec (3.69 ms) : 3472, 3909
.   : milestone, 3690,
iast (2.198 ms) : 2135, 2261
.   : milestone, 2198,
iast_GLOBAL (2.233 ms) : 2170, 2297
.   : milestone, 2233,
profiling (2.037 ms) : 1986, 2087
.   : milestone, 2037,
tracing (2.011 ms) : 1961, 2060
.   : milestone, 2011,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.652 ms [3.437 ms, 3.866 ms] 2.178 ms (147.9%)
iast 2.199 ms [2.136 ms, 2.261 ms] 725.597 µs (49.3%)
iast_GLOBAL 2.246 ms [2.182 ms, 2.31 ms] 773.059 µs (52.5%)
profiling 2.036 ms [1.985 ms, 2.086 ms] 562.543 µs (38.2%)
tracing 2.022 ms [1.973 ms, 2.072 ms] 549.341 µs (37.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.49 ms] -
appsec 3.69 ms [3.472 ms, 3.909 ms] 2.212 ms (149.7%)
iast 2.198 ms [2.135 ms, 2.261 ms] 719.836 µs (48.7%)
iast_GLOBAL 2.233 ms [2.17 ms, 2.297 ms] 755.395 µs (51.1%)
profiling 2.037 ms [1.986 ms, 2.087 ms] 558.511 µs (37.8%)
tracing 2.011 ms [1.961 ms, 2.06 ms] 532.675 µs (36.0%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~0d747e0678, baseline=1.54.0-SNAPSHOT~ffc2be9352
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.461 s) : 15461000, 15461000
.   : milestone, 15461000,
appsec (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
iast (18.385 s) : 18385000, 18385000
.   : milestone, 18385000,
iast_GLOBAL (17.939 s) : 17939000, 17939000
.   : milestone, 17939000,
profiling (15.344 s) : 15344000, 15344000
.   : milestone, 15344000,
tracing (14.921 s) : 14921000, 14921000
.   : milestone, 14921000,
section candidate
no_agent (15.488 s) : 15488000, 15488000
.   : milestone, 15488000,
appsec (15.201 s) : 15201000, 15201000
.   : milestone, 15201000,
iast (18.531 s) : 18531000, 18531000
.   : milestone, 18531000,
iast_GLOBAL (18.196 s) : 18196000, 18196000
.   : milestone, 18196000,
profiling (15.37 s) : 15370000, 15370000
.   : milestone, 15370000,
tracing (15.142 s) : 15142000, 15142000
.   : milestone, 15142000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.461 s [15.461 s, 15.461 s] -
appsec 15.06 s [15.06 s, 15.06 s] -401.0 ms (-2.6%)
iast 18.385 s [18.385 s, 18.385 s] 2.924 s (18.9%)
iast_GLOBAL 17.939 s [17.939 s, 17.939 s] 2.478 s (16.0%)
profiling 15.344 s [15.344 s, 15.344 s] -117.0 ms (-0.8%)
tracing 14.921 s [14.921 s, 14.921 s] -540.0 ms (-3.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.488 s [15.488 s, 15.488 s] -
appsec 15.201 s [15.201 s, 15.201 s] -287.0 ms (-1.9%)
iast 18.531 s [18.531 s, 18.531 s] 3.043 s (19.6%)
iast_GLOBAL 18.196 s [18.196 s, 18.196 s] 2.708 s (17.5%)
profiling 15.37 s [15.37 s, 15.37 s] -118.0 ms (-0.8%)
tracing 15.142 s [15.142 s, 15.142 s] -346.0 ms (-2.2%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 25, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazyfy-compile-tasks
git_commit_date 1759259900 1759305607
git_commit_sha ffc2be9 0d747e0
See matching parameters
Baseline Candidate
ci_job_date 1759306651 1759306651
ci_job_id 1156586448 1156586448
ci_pipeline_id 78036025 78036025
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@sarahchen6 sarahchen6 marked this pull request as ready for review September 25, 2025 19:39
@sarahchen6 sarahchen6 requested review from a team as code owners September 25, 2025 19:39
@sarahchen6 sarahchen6 requested review from AlexeyKuznetsov-DD, PerfectSlayer, bric3 and daniel-mohedano and removed request for a team September 25, 2025 19:39
Copy link
Contributor

@bric3 bric3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd rather hold on compile tasks as it will conflict with #9514 🙏

@bric3
Copy link
Contributor

bric3 commented Sep 29, 2025

@sarahchen6 Actually go ahead, as I found it was easy to rebase #9514

@sarahchen6 sarahchen6 merged commit bf9b90e into master Oct 1, 2025
537 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/lazyfy-compile-tasks branch October 1, 2025 13:37
@github-actions github-actions bot added this to the 1.54.0 milestone Oct 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants