Skip to content

Add workflow to prevent new Groovy test files#10730

Open
sarahchen6 wants to merge 4 commits intomasterfrom
sarahchen6/workflow-to-enforce-no-groovy
Open

Add workflow to prevent new Groovy test files#10730
sarahchen6 wants to merge 4 commits intomasterfrom
sarahchen6/workflow-to-enforce-no-groovy

Conversation

@sarahchen6
Copy link
Contributor

What Does This Do

Add a new Github Action workflow that prevents new Groovy test files from creation. Specifically, this workflow:

  • Fails and adds a PR comment if a new Groovy test file was created in a module that is listed in .github/migrated-modules.txt. The expectation is that all fully-migrated modules are listed in .github/migrated-modules.txt.
  • Passes and adds a warning PR comment if a new Groovy test file was added in a module that has not been fully migrated. dd-smoke-tests and dd-java-agent/instrumentations are excluded from this.
  • Can be skipped by adding the override-groovy-enforcement label to this PR.

Motivation

During our broader effort to migrate Groovy test files to Java, we should not introduce further regressions. Since dd-smoke-tests and dd-java-agent/instrumentations are latter priorities, we excluded them from these checks for now.

Additional Notes

The workflow needs to be merged to master before testing.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@sarahchen6 sarahchen6 force-pushed the sarahchen6/workflow-to-enforce-no-groovy branch from b77de38 to 8164b95 Compare March 3, 2026 20:43
@sarahchen6 sarahchen6 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Mar 3, 2026
@sarahchen6 sarahchen6 marked this pull request as ready for review March 3, 2026 21:09
@sarahchen6 sarahchen6 requested a review from a team as a code owner March 3, 2026 21:09
@sarahchen6 sarahchen6 requested review from PerfectSlayer and removed request for a team March 3, 2026 21:09
@sarahchen6 sarahchen6 added tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check and removed tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check labels Mar 3, 2026
@sarahchen6
Copy link
Contributor Author

sarahchen6 commented Mar 3, 2026

We can confirm that adding the override-groovy-enforcement label skips the check; however, the rest of the workflow depends on .github/migrated-modules.txt being on master.

@sarahchen6 sarahchen6 added the tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check label Mar 3, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 3, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/workflow-to-enforce-no-groovy
git_commit_date 1772641975 1772645832
git_commit_sha 77900be 9c781e1
release_version 1.61.0-SNAPSHOT~77900be502 1.61.0-SNAPSHOT~9c781e1d5e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772647526 1772647526
ci_job_id 1476038218 1476038218
ci_pipeline_id 100384421 100384421
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-c4df8nw1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-c4df8nw1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060726
Total [baseline] (8.855 s) : 0, 8854595
Agent [candidate] (1.061 s) : 0, 1060778
Total [candidate] (8.838 s) : 0, 8837765
section iast
Agent [baseline] (1.231 s) : 0, 1231044
Total [baseline] (9.541 s) : 0, 9541204
Agent [candidate] (1.227 s) : 0, 1227299
Total [candidate] (9.581 s) : 0, 9581266
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.231 s 170.318 ms (16.1%)
Total tracing 8.855 s -
Total iast 9.541 s 686.609 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.227 s 166.521 ms (15.7%)
Total tracing 8.838 s -
Total iast 9.581 s 743.502 ms (8.4%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (628.872 ms) : 0, 628872
BytebuddyAgent [candidate] (630.076 ms) : 0, 630076
AgentMeter [baseline] (29.163 ms) : 0, 29163
AgentMeter [candidate] (29.147 ms) : 0, 29147
GlobalTracer [baseline] (257.152 ms) : 0, 257152
GlobalTracer [candidate] (257.547 ms) : 0, 257547
AppSec [baseline] (31.472 ms) : 0, 31472
AppSec [candidate] (31.52 ms) : 0, 31520
Debugger [baseline] (58.776 ms) : 0, 58776
Debugger [candidate] (58.659 ms) : 0, 58659
Remote Config [baseline] (595.308 µs) : 0, 595
Remote Config [candidate] (591.057 µs) : 0, 591
Telemetry [baseline] (8.739 ms) : 0, 8739
Telemetry [candidate] (8.712 ms) : 0, 8712
Flare Poller [baseline] (8.684 ms) : 0, 8684
Flare Poller [candidate] (7.225 ms) : 0, 7225
section iast
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (800.113 ms) : 0, 800113
BytebuddyAgent [candidate] (796.891 ms) : 0, 796891
AgentMeter [baseline] (11.304 ms) : 0, 11304
AgentMeter [candidate] (11.327 ms) : 0, 11327
GlobalTracer [baseline] (247.383 ms) : 0, 247383
GlobalTracer [candidate] (247.586 ms) : 0, 247586
IAST [baseline] (25.234 ms) : 0, 25234
IAST [candidate] (25.151 ms) : 0, 25151
AppSec [baseline] (26.359 ms) : 0, 26359
AppSec [candidate] (26.329 ms) : 0, 26329
Debugger [baseline] (62.743 ms) : 0, 62743
Debugger [candidate] (62.375 ms) : 0, 62375
Remote Config [baseline] (528.225 µs) : 0, 528
Remote Config [candidate] (524.158 µs) : 0, 524
Telemetry [baseline] (15.134 ms) : 0, 15134
Telemetry [candidate] (14.969 ms) : 0, 14969
Flare Poller [baseline] (4.895 ms) : 0, 4895
Flare Poller [candidate] (4.898 ms) : 0, 4898
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067439
Total [baseline] (11.099 s) : 0, 11098819
Agent [candidate] (1.069 s) : 0, 1068634
Total [candidate] (11.079 s) : 0, 11079431
section appsec
Agent [baseline] (1.255 s) : 0, 1254724
Total [baseline] (11.163 s) : 0, 11163163
Agent [candidate] (1.248 s) : 0, 1248066
Total [candidate] (11.253 s) : 0, 11252859
section iast
Agent [baseline] (1.23 s) : 0, 1229560
Total [baseline] (11.405 s) : 0, 11405179
Agent [candidate] (1.229 s) : 0, 1228512
Total [candidate] (11.336 s) : 0, 11335746
section profiling
Agent [baseline] (1.185 s) : 0, 1184505
Total [baseline] (11.067 s) : 0, 11066504
Agent [candidate] (1.183 s) : 0, 1182685
Total [candidate] (11.123 s) : 0, 11122674
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.255 s 187.285 ms (17.5%)
Agent iast 1.23 s 162.121 ms (15.2%)
Agent profiling 1.185 s 117.066 ms (11.0%)
Total tracing 11.099 s -
Total appsec 11.163 s 64.345 ms (0.6%)
Total iast 11.405 s 306.36 ms (2.8%)
Total profiling 11.067 s -32.315 ms (-0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.248 s 179.431 ms (16.8%)
Agent iast 1.229 s 159.877 ms (15.0%)
Agent profiling 1.183 s 114.05 ms (10.7%)
Total tracing 11.079 s -
Total appsec 11.253 s 173.428 ms (1.6%)
Total iast 11.336 s 256.315 ms (2.3%)
Total profiling 11.123 s 43.243 ms (0.4%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (632.557 ms) : 0, 632557
BytebuddyAgent [candidate] (634.666 ms) : 0, 634666
AgentMeter [baseline] (29.321 ms) : 0, 29321
AgentMeter [candidate] (29.424 ms) : 0, 29424
GlobalTracer [baseline] (258.561 ms) : 0, 258561
GlobalTracer [candidate] (259.12 ms) : 0, 259120
AppSec [baseline] (32.014 ms) : 0, 32014
AppSec [candidate] (31.666 ms) : 0, 31666
Debugger [baseline] (60.154 ms) : 0, 60154
Debugger [candidate] (59.702 ms) : 0, 59702
Remote Config [baseline] (598.234 µs) : 0, 598
Remote Config [candidate] (604.696 µs) : 0, 605
Telemetry [baseline] (8.764 ms) : 0, 8764
Telemetry [candidate] (8.759 ms) : 0, 8759
Flare Poller [baseline] (8.132 ms) : 0, 8132
Flare Poller [candidate] (7.34 ms) : 0, 7340
section appsec
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (663.764 ms) : 0, 663764
BytebuddyAgent [candidate] (659.319 ms) : 0, 659319
AgentMeter [baseline] (12.108 ms) : 0, 12108
AgentMeter [candidate] (12.003 ms) : 0, 12003
GlobalTracer [baseline] (259.737 ms) : 0, 259737
GlobalTracer [candidate] (258.789 ms) : 0, 258789
IAST [baseline] (24.14 ms) : 0, 24140
IAST [candidate] (24.044 ms) : 0, 24044
AppSec [baseline] (178.393 ms) : 0, 178393
AppSec [candidate] (177.815 ms) : 0, 177815
Debugger [baseline] (65.696 ms) : 0, 65696
Debugger [candidate] (65.475 ms) : 0, 65475
Remote Config [baseline] (578.876 µs) : 0, 579
Remote Config [candidate] (579.098 µs) : 0, 579
Telemetry [baseline] (9.049 ms) : 0, 9049
Telemetry [candidate] (9.059 ms) : 0, 9059
Flare Poller [baseline] (3.641 ms) : 0, 3641
Flare Poller [candidate] (3.564 ms) : 0, 3564
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (798.038 ms) : 0, 798038
BytebuddyAgent [candidate] (796.959 ms) : 0, 796959
AgentMeter [baseline] (11.342 ms) : 0, 11342
AgentMeter [candidate] (11.299 ms) : 0, 11299
GlobalTracer [baseline] (247.683 ms) : 0, 247683
GlobalTracer [candidate] (247.684 ms) : 0, 247684
IAST [baseline] (25.175 ms) : 0, 25175
IAST [candidate] (25.235 ms) : 0, 25235
AppSec [baseline] (26.348 ms) : 0, 26348
AppSec [candidate] (27.252 ms) : 0, 27252
Debugger [baseline] (63.53 ms) : 0, 63530
Debugger [candidate] (62.66 ms) : 0, 62660
Remote Config [baseline] (535.438 µs) : 0, 535
Remote Config [candidate] (541.223 µs) : 0, 541
Telemetry [baseline] (14.83 ms) : 0, 14830
Telemetry [candidate] (14.813 ms) : 0, 14813
Flare Poller [baseline] (4.853 ms) : 0, 4853
Flare Poller [candidate] (4.896 ms) : 0, 4896
section profiling
crashtracking [baseline] (1.167 ms) : 0, 1167
crashtracking [candidate] (1.164 ms) : 0, 1164
BytebuddyAgent [baseline] (684.995 ms) : 0, 684995
BytebuddyAgent [candidate] (682.836 ms) : 0, 682836
AgentMeter [baseline] (8.571 ms) : 0, 8571
AgentMeter [candidate] (8.532 ms) : 0, 8532
GlobalTracer [baseline] (215.273 ms) : 0, 215273
GlobalTracer [candidate] (215.343 ms) : 0, 215343
AppSec [baseline] (31.95 ms) : 0, 31950
AppSec [candidate] (31.896 ms) : 0, 31896
Debugger [baseline] (63.514 ms) : 0, 63514
Debugger [candidate] (63.586 ms) : 0, 63586
Remote Config [baseline] (584.307 µs) : 0, 584
Remote Config [candidate] (580.104 µs) : 0, 580
Telemetry [baseline] (9.836 ms) : 0, 9836
Telemetry [candidate] (9.051 ms) : 0, 9051
Flare Poller [baseline] (3.52 ms) : 0, 3520
Flare Poller [candidate] (4.301 ms) : 0, 4301
ProfilingAgent [baseline] (94.299 ms) : 0, 94299
ProfilingAgent [candidate] (94.65 ms) : 0, 94650
Profiling [baseline] (94.873 ms) : 0, 94873
Profiling [candidate] (95.222 ms) : 0, 95222
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/workflow-to-enforce-no-groovy
git_commit_date 1772641975 1772645832
git_commit_sha 77900be 9c781e1
release_version 1.61.0-SNAPSHOT~77900be502 1.61.0-SNAPSHOT~9c781e1d5e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772648089 1772648089
ci_job_id 1476038220 1476038220
ci_pipeline_id 100384421 100384421
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-lyacdk4k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-lyacdk4k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-260.430µs; -147.204µs] or [-10.043%; -5.677%]
same
[-564.386µs; +10.022µs] or [-7.561%; +0.134%]
unstable
[-66.419op/s; +261.231op/s] or [-4.790%; +18.840%]
2.389ms 7.187ms 1483.969op/s 2.593ms 7.464ms 1386.562op/s
scenario:load:insecure-bank:profiling:high_load better
[-201.626µs; -93.795µs] or [-11.542%; -5.369%]
unstable
[-1.575ms; -0.793ms] or [-28.665%; -14.430%]
unstable
[+82.026op/s; +613.786op/s] or [+4.089%; +30.595%]
1.599ms 4.310ms 2354.062op/s 1.747ms 5.494ms 2006.156op/s
scenario:load:petclinic:iast:high_load worse
[+381.093µs; +855.714µs] or [+2.193%; +4.925%]
unsure
[+11.950µs; +1191.769µs] or [+0.041%; +4.132%]
unstable
[-31.149op/s; +16.087op/s] or [-11.865%; +6.127%]
17.993ms 29.442ms 255.000op/s 17.374ms 28.840ms 262.531op/s
scenario:load:petclinic:appsec:high_load worse
[+0.565ms; +1.505ms] or [+3.092%; +8.244%]
unsure
[+0.555ms; +2.138ms] or [+1.860%; +7.169%]
unstable
[-35.317op/s; +10.067op/s] or [-14.095%; +4.018%]
19.294ms 31.173ms 237.938op/s 18.259ms 29.827ms 250.562op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.55 ms) : 19347, 19752
.   : milestone, 19550,
appsec (18.631 ms) : 18443, 18819
.   : milestone, 18631,
code_origins (17.968 ms) : 17790, 18147
.   : milestone, 17968,
iast (17.771 ms) : 17594, 17948
.   : milestone, 17771,
profiling (19.414 ms) : 19218, 19610
.   : milestone, 19414,
tracing (17.926 ms) : 17750, 18103
.   : milestone, 17926,
section candidate
no_agent (19.532 ms) : 19332, 19733
.   : milestone, 19532,
appsec (19.617 ms) : 19413, 19821
.   : milestone, 19617,
code_origins (17.651 ms) : 17476, 17826
.   : milestone, 17651,
iast (18.298 ms) : 18114, 18482
.   : milestone, 18298,
profiling (18.925 ms) : 18737, 19114
.   : milestone, 18925,
tracing (17.83 ms) : 17650, 18009
.   : milestone, 17830,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.55 ms [19.347 ms, 19.752 ms] -
appsec 18.631 ms [18.443 ms, 18.819 ms] -918.922 µs (-4.7%)
code_origins 17.968 ms [17.79 ms, 18.147 ms] -1.581 ms (-8.1%)
iast 17.771 ms [17.594 ms, 17.948 ms] -1.779 ms (-9.1%)
profiling 19.414 ms [19.218 ms, 19.61 ms] -135.907 µs (-0.7%)
tracing 17.926 ms [17.75 ms, 18.103 ms] -1.624 ms (-8.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.532 ms [19.332 ms, 19.733 ms] -
appsec 19.617 ms [19.413 ms, 19.821 ms] 84.392 µs (0.4%)
code_origins 17.651 ms [17.476 ms, 17.826 ms] -1.882 ms (-9.6%)
iast 18.298 ms [18.114 ms, 18.482 ms] -1.234 ms (-6.3%)
profiling 18.925 ms [18.737 ms, 19.114 ms] -607.126 µs (-3.1%)
tracing 17.83 ms [17.65 ms, 18.009 ms] -1.703 ms (-8.7%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.19 ms) : 1178, 1202
.   : milestone, 1190,
iast (3.301 ms) : 3259, 3343
.   : milestone, 3301,
iast_FULL (6.056 ms) : 5994, 6118
.   : milestone, 6056,
iast_GLOBAL (3.532 ms) : 3481, 3584
.   : milestone, 3532,
profiling (2.259 ms) : 2236, 2281
.   : milestone, 2259,
tracing (1.788 ms) : 1772, 1803
.   : milestone, 1788,
section candidate
no_agent (1.181 ms) : 1170, 1193
.   : milestone, 1181,
iast (3.078 ms) : 3040, 3117
.   : milestone, 3078,
iast_FULL (5.905 ms) : 5846, 5964
.   : milestone, 5905,
iast_GLOBAL (3.637 ms) : 3581, 3693
.   : milestone, 3637,
profiling (1.914 ms) : 1898, 1930
.   : milestone, 1914,
tracing (1.875 ms) : 1859, 1891
.   : milestone, 1875,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.19 ms [1.178 ms, 1.202 ms] -
iast 3.301 ms [3.259 ms, 3.343 ms] 2.111 ms (177.4%)
iast_FULL 6.056 ms [5.994 ms, 6.118 ms] 4.866 ms (408.9%)
iast_GLOBAL 3.532 ms [3.481 ms, 3.584 ms] 2.342 ms (196.8%)
profiling 2.259 ms [2.236 ms, 2.281 ms] 1.069 ms (89.8%)
tracing 1.788 ms [1.772 ms, 1.803 ms] 597.673 µs (50.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.17 ms, 1.193 ms] -
iast 3.078 ms [3.04 ms, 3.117 ms] 1.897 ms (160.6%)
iast_FULL 5.905 ms [5.846 ms, 5.964 ms] 4.724 ms (399.9%)
iast_GLOBAL 3.637 ms [3.581 ms, 3.693 ms] 2.456 ms (207.9%)
profiling 1.914 ms [1.898 ms, 1.93 ms] 732.622 µs (62.0%)
tracing 1.875 ms [1.859 ms, 1.891 ms] 693.652 µs (58.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/workflow-to-enforce-no-groovy
git_commit_date 1772641975 1772645832
git_commit_sha 77900be 9c781e1
release_version 1.61.0-SNAPSHOT~77900be502 1.61.0-SNAPSHOT~9c781e1d5e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772647775 1772647775
ci_job_id 1476038223 1476038223
ci_pipeline_id 100384421 100384421
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-shs44at0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-shs44at0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.61 s) : 15610000, 15610000
.   : milestone, 15610000,
appsec (14.905 s) : 14905000, 14905000
.   : milestone, 14905000,
iast (17.993 s) : 17993000, 17993000
.   : milestone, 17993000,
iast_GLOBAL (17.735 s) : 17735000, 17735000
.   : milestone, 17735000,
profiling (14.961 s) : 14961000, 14961000
.   : milestone, 14961000,
tracing (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
section candidate
no_agent (15.444 s) : 15444000, 15444000
.   : milestone, 15444000,
appsec (14.838 s) : 14838000, 14838000
.   : milestone, 14838000,
iast (18.411 s) : 18411000, 18411000
.   : milestone, 18411000,
iast_GLOBAL (17.661 s) : 17661000, 17661000
.   : milestone, 17661000,
profiling (14.775 s) : 14775000, 14775000
.   : milestone, 14775000,
tracing (15.26 s) : 15260000, 15260000
.   : milestone, 15260000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.61 s [15.61 s, 15.61 s] -
appsec 14.905 s [14.905 s, 14.905 s] -705.0 ms (-4.5%)
iast 17.993 s [17.993 s, 17.993 s] 2.383 s (15.3%)
iast_GLOBAL 17.735 s [17.735 s, 17.735 s] 2.125 s (13.6%)
profiling 14.961 s [14.961 s, 14.961 s] -649.0 ms (-4.2%)
tracing 14.968 s [14.968 s, 14.968 s] -642.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.444 s [15.444 s, 15.444 s] -
appsec 14.838 s [14.838 s, 14.838 s] -606.0 ms (-3.9%)
iast 18.411 s [18.411 s, 18.411 s] 2.967 s (19.2%)
iast_GLOBAL 17.661 s [17.661 s, 17.661 s] 2.217 s (14.4%)
profiling 14.775 s [14.775 s, 14.775 s] -669.0 ms (-4.3%)
tracing 15.26 s [15.26 s, 15.26 s] -184.0 ms (-1.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~9c781e1d5e, baseline=1.61.0-SNAPSHOT~77900be502
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (3.802 ms) : 3581, 4023
.   : milestone, 3802,
iast (2.257 ms) : 2187, 2326
.   : milestone, 2257,
iast_GLOBAL (2.299 ms) : 2230, 2369
.   : milestone, 2299,
profiling (2.073 ms) : 2019, 2128
.   : milestone, 2073,
tracing (2.055 ms) : 2001, 2108
.   : milestone, 2055,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (3.798 ms) : 3577, 4018
.   : milestone, 3798,
iast (2.248 ms) : 2179, 2318
.   : milestone, 2248,
iast_GLOBAL (2.298 ms) : 2228, 2368
.   : milestone, 2298,
profiling (2.518 ms) : 2300, 2735
.   : milestone, 2518,
tracing (2.077 ms) : 2023, 2132
.   : milestone, 2077,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 3.802 ms [3.581 ms, 4.023 ms] 2.332 ms (158.7%)
iast 2.257 ms [2.187 ms, 2.326 ms] 786.887 µs (53.5%)
iast_GLOBAL 2.299 ms [2.23 ms, 2.369 ms] 829.401 µs (56.4%)
profiling 2.073 ms [2.019 ms, 2.128 ms] 603.303 µs (41.0%)
tracing 2.055 ms [2.001 ms, 2.108 ms] 584.643 µs (39.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 3.798 ms [3.577 ms, 4.018 ms] 2.328 ms (158.4%)
iast 2.248 ms [2.179 ms, 2.318 ms] 778.978 µs (53.0%)
iast_GLOBAL 2.298 ms [2.228 ms, 2.368 ms] 828.588 µs (56.4%)
profiling 2.518 ms [2.3 ms, 2.735 ms] 1.048 ms (71.3%)
tracing 2.077 ms [2.023 ms, 2.132 ms] 607.912 µs (41.4%)

Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👏 praise: ‏Thanks for taking care of it!
I left few comments, especially around the migrated-modules.txt on master.

❔ question: ‏I saw there was 2 comments, one for warnings, one for regressions.
I wonder if it would not be easier to have a single one? You can generate its content (both warnings and regression) and:

  • add/update the unique comment if there is one or the other + fail the check
  • delete the unique comment if present otherwise

How does it sound?

🎯 suggestion: Additionally, you can update the skill to ask to update the migrated-modules.txt file once module migration is complete.

@PerfectSlayer
Copy link
Contributor

@codex review

@PerfectSlayer
Copy link
Contributor

PerfectSlayer commented Mar 4, 2026

I asked additional review from Codex as I'm not well versed in reviewing Node JS code from Yaml files 😅

Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 8164b95343

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@sarahchen6
Copy link
Contributor Author

❔ question: ‏I saw there was 2 comments, one for warnings, one for regressions.
I wonder if it would not be easier to have a single one?

It makes more sense IMO to separate the logic of the comments -- in particular, the regressions comment fails the workflow and needs to be addressed / deleted, whereas the warnings comment is just a recommendation. With separation, each comment can be individually updated instead of having to check the combined content.

This may make the PR initially more cluttered with two comments, but at least one of them will be deleted eventually. 🤔

@sarahchen6 sarahchen6 requested a review from a team as a code owner March 4, 2026 16:33
@sarahchen6 sarahchen6 requested a review from PerfectSlayer March 4, 2026 16:33
@sarahchen6 sarahchen6 added tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check and removed tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check labels Mar 4, 2026
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good!  Thanks for the follow up changes

This may make the PR initially more cluttered with two comments, but at least one of them will be deleted eventually. 🤔

Alright, let’s keep it that way then!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants