Fix runtime reporting of "tip" jobs#10842
Open
daniel-mohedano wants to merge 2 commits intomasterfrom
Open
Conversation
tip job
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1064173
Total [baseline] (8.836 s) : 0, 8835779
Agent [candidate] (1.056 s) : 0, 1055679
Total [candidate] (8.781 s) : 0, 8780623
section iast
Agent [baseline] (1.228 s) : 0, 1227504
Total [baseline] (9.561 s) : 0, 9560646
Agent [candidate] (1.228 s) : 0, 1228183
Total [candidate] (9.583 s) : 0, 9582575
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (630.211 ms) : 0, 630211
BytebuddyAgent [candidate] (626.471 ms) : 0, 626471
AgentMeter [baseline] (29.327 ms) : 0, 29327
AgentMeter [candidate] (28.998 ms) : 0, 28998
GlobalTracer [baseline] (257.716 ms) : 0, 257716
GlobalTracer [candidate] (256.452 ms) : 0, 256452
AppSec [baseline] (31.742 ms) : 0, 31742
AppSec [candidate] (31.621 ms) : 0, 31621
Debugger [baseline] (59.019 ms) : 0, 59019
Debugger [candidate] (58.429 ms) : 0, 58429
Remote Config [baseline] (607.526 µs) : 0, 608
Remote Config [candidate] (604.999 µs) : 0, 605
Telemetry [baseline] (8.741 ms) : 0, 8741
Telemetry [candidate] (8.634 ms) : 0, 8634
Flare Poller [baseline] (9.436 ms) : 0, 9436
Flare Poller [candidate] (7.219 ms) : 0, 7219
section iast
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (796.587 ms) : 0, 796587
BytebuddyAgent [candidate] (796.929 ms) : 0, 796929
AgentMeter [baseline] (11.347 ms) : 0, 11347
AgentMeter [candidate] (11.318 ms) : 0, 11318
GlobalTracer [baseline] (247.476 ms) : 0, 247476
GlobalTracer [candidate] (247.786 ms) : 0, 247786
IAST [baseline] (25.224 ms) : 0, 25224
IAST [candidate] (25.186 ms) : 0, 25186
AppSec [baseline] (26.497 ms) : 0, 26497
AppSec [candidate] (26.419 ms) : 0, 26419
Debugger [baseline] (62.802 ms) : 0, 62802
Debugger [candidate] (62.936 ms) : 0, 62936
Remote Config [baseline] (526.038 µs) : 0, 526
Remote Config [candidate] (516.751 µs) : 0, 517
Telemetry [baseline] (14.893 ms) : 0, 14893
Telemetry [candidate] (14.952 ms) : 0, 14952
Flare Poller [baseline] (4.864 ms) : 0, 4864
Flare Poller [candidate] (4.896 ms) : 0, 4896
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071355
Total [baseline] (11.046 s) : 0, 11045724
Agent [candidate] (1.067 s) : 0, 1067015
Total [candidate] (11.091 s) : 0, 11091044
section appsec
Agent [baseline] (1.242 s) : 0, 1242018
Total [baseline] (11.19 s) : 0, 11189791
Agent [candidate] (1.249 s) : 0, 1249382
Total [candidate] (11.162 s) : 0, 11161728
section iast
Agent [baseline] (1.223 s) : 0, 1222651
Total [baseline] (11.23 s) : 0, 11229583
Agent [candidate] (1.233 s) : 0, 1233428
Total [candidate] (11.371 s) : 0, 11371083
section profiling
Agent [baseline] (1.179 s) : 0, 1179114
Total [baseline] (11.042 s) : 0, 11041894
Agent [candidate] (1.181 s) : 0, 1180695
Total [candidate] (11.095 s) : 0, 11094959
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (635.292 ms) : 0, 635292
BytebuddyAgent [candidate] (632.03 ms) : 0, 632030
AgentMeter [baseline] (29.52 ms) : 0, 29520
AgentMeter [candidate] (29.339 ms) : 0, 29339
GlobalTracer [baseline] (259.593 ms) : 0, 259593
GlobalTracer [candidate] (258.208 ms) : 0, 258208
AppSec [baseline] (31.905 ms) : 0, 31905
AppSec [candidate] (31.67 ms) : 0, 31670
Debugger [baseline] (60.215 ms) : 0, 60215
Debugger [candidate] (59.728 ms) : 0, 59728
Remote Config [baseline] (629.364 µs) : 0, 629
Remote Config [candidate] (649.038 µs) : 0, 649
Telemetry [baseline] (8.782 ms) : 0, 8782
Telemetry [candidate] (8.691 ms) : 0, 8691
Flare Poller [baseline] (7.945 ms) : 0, 7945
Flare Poller [candidate] (9.416 ms) : 0, 9416
section appsec
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (656.151 ms) : 0, 656151
BytebuddyAgent [candidate] (659.836 ms) : 0, 659836
AgentMeter [baseline] (12.014 ms) : 0, 12014
AgentMeter [candidate] (12.088 ms) : 0, 12088
GlobalTracer [baseline] (257.044 ms) : 0, 257044
GlobalTracer [candidate] (258.624 ms) : 0, 258624
IAST [baseline] (23.917 ms) : 0, 23917
IAST [candidate] (24.093 ms) : 0, 24093
AppSec [baseline] (176.91 ms) : 0, 176910
AppSec [candidate] (178.09 ms) : 0, 178090
Debugger [baseline] (65.637 ms) : 0, 65637
Debugger [candidate] (66.029 ms) : 0, 66029
Remote Config [baseline] (561.177 µs) : 0, 561
Remote Config [candidate] (572.217 µs) : 0, 572
Telemetry [baseline] (8.873 ms) : 0, 8873
Telemetry [candidate] (8.945 ms) : 0, 8945
Flare Poller [baseline] (3.588 ms) : 0, 3588
Flare Poller [candidate] (3.656 ms) : 0, 3656
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (792.503 ms) : 0, 792503
BytebuddyAgent [candidate] (800.347 ms) : 0, 800347
AgentMeter [baseline] (11.299 ms) : 0, 11299
AgentMeter [candidate] (11.558 ms) : 0, 11558
GlobalTracer [baseline] (246.29 ms) : 0, 246290
GlobalTracer [candidate] (248.029 ms) : 0, 248029
IAST [baseline] (25.103 ms) : 0, 25103
IAST [candidate] (25.306 ms) : 0, 25306
AppSec [baseline] (26.398 ms) : 0, 26398
AppSec [candidate] (26.644 ms) : 0, 26644
Debugger [baseline] (65.795 ms) : 0, 65795
Debugger [candidate] (64.019 ms) : 0, 64019
Remote Config [baseline] (516.777 µs) : 0, 517
Remote Config [candidate] (509.424 µs) : 0, 509
Telemetry [baseline] (13.206 ms) : 0, 13206
Telemetry [candidate] (14.803 ms) : 0, 14803
Flare Poller [baseline] (4.413 ms) : 0, 4413
Flare Poller [candidate] (4.932 ms) : 0, 4932
section profiling
crashtracking [baseline] (1.17 ms) : 0, 1170
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (680.791 ms) : 0, 680791
BytebuddyAgent [candidate] (682.273 ms) : 0, 682273
AgentMeter [baseline] (8.597 ms) : 0, 8597
AgentMeter [candidate] (8.624 ms) : 0, 8624
GlobalTracer [baseline] (215.085 ms) : 0, 215085
GlobalTracer [candidate] (215.129 ms) : 0, 215129
AppSec [baseline] (31.894 ms) : 0, 31894
AppSec [candidate] (32.015 ms) : 0, 32015
Debugger [baseline] (64.322 ms) : 0, 64322
Debugger [candidate] (64.285 ms) : 0, 64285
Remote Config [baseline] (582.836 µs) : 0, 583
Remote Config [candidate] (581.979 µs) : 0, 582
Telemetry [baseline] (8.918 ms) : 0, 8918
Telemetry [candidate] (8.94 ms) : 0, 8940
Flare Poller [baseline] (3.503 ms) : 0, 3503
Flare Poller [candidate] (3.448 ms) : 0, 3448
ProfilingAgent [baseline] (93.433 ms) : 0, 93433
ProfilingAgent [candidate] (93.666 ms) : 0, 93666
Profiling [baseline] (94.003 ms) : 0, 94003
Profiling [candidate] (94.24 ms) : 0, 94240
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 17 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section baseline
no_agent (1.186 ms) : 1174, 1197
. : milestone, 1186,
iast (3.19 ms) : 3145, 3235
. : milestone, 3190,
iast_FULL (5.737 ms) : 5680, 5794
. : milestone, 5737,
iast_GLOBAL (3.474 ms) : 3425, 3524
. : milestone, 3474,
profiling (2.271 ms) : 2250, 2293
. : milestone, 2271,
tracing (1.9 ms) : 1884, 1916
. : milestone, 1900,
section candidate
no_agent (1.196 ms) : 1184, 1208
. : milestone, 1196,
iast (3.22 ms) : 3175, 3265
. : milestone, 3220,
iast_FULL (5.793 ms) : 5735, 5852
. : milestone, 5793,
iast_GLOBAL (3.589 ms) : 3528, 3649
. : milestone, 3589,
profiling (2.059 ms) : 2040, 2078
. : milestone, 2059,
tracing (1.783 ms) : 1768, 1798
. : milestone, 1783,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section baseline
no_agent (18.99 ms) : 18797, 19183
. : milestone, 18990,
appsec (19.627 ms) : 19430, 19824
. : milestone, 19627,
code_origins (17.748 ms) : 17572, 17924
. : milestone, 17748,
iast (17.702 ms) : 17525, 17880
. : milestone, 17702,
profiling (19.015 ms) : 18823, 19207
. : milestone, 19015,
tracing (17.631 ms) : 17458, 17805
. : milestone, 17631,
section candidate
no_agent (19.29 ms) : 19092, 19488
. : milestone, 19290,
appsec (18.888 ms) : 18694, 19082
. : milestone, 18888,
code_origins (17.58 ms) : 17405, 17755
. : milestone, 17580,
iast (17.724 ms) : 17549, 17899
. : milestone, 17724,
profiling (19.742 ms) : 19544, 19939
. : milestone, 19742,
tracing (17.745 ms) : 17570, 17921
. : milestone, 17745,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
. : milestone, 1479,
appsec (2.535 ms) : 2480, 2591
. : milestone, 2535,
iast (2.266 ms) : 2196, 2336
. : milestone, 2266,
iast_GLOBAL (2.314 ms) : 2244, 2384
. : milestone, 2314,
profiling (2.12 ms) : 2063, 2177
. : milestone, 2120,
tracing (2.069 ms) : 2015, 2123
. : milestone, 2069,
section candidate
no_agent (1.474 ms) : 1462, 1485
. : milestone, 1474,
appsec (3.821 ms) : 3599, 4042
. : milestone, 3821,
iast (2.263 ms) : 2194, 2333
. : milestone, 2263,
iast_GLOBAL (2.309 ms) : 2239, 2379
. : milestone, 2309,
profiling (2.103 ms) : 2047, 2158
. : milestone, 2103,
tracing (2.072 ms) : 2019, 2126
. : milestone, 2072,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~ecf7238415, baseline=1.61.0-SNAPSHOT~7cff99444b
dateFormat X
axisFormat %s
section baseline
no_agent (15.486 s) : 15486000, 15486000
. : milestone, 15486000,
appsec (15.037 s) : 15037000, 15037000
. : milestone, 15037000,
iast (18.062 s) : 18062000, 18062000
. : milestone, 18062000,
iast_GLOBAL (17.729 s) : 17729000, 17729000
. : milestone, 17729000,
profiling (14.754 s) : 14754000, 14754000
. : milestone, 14754000,
tracing (15.127 s) : 15127000, 15127000
. : milestone, 15127000,
section candidate
no_agent (15.681 s) : 15681000, 15681000
. : milestone, 15681000,
appsec (15.115 s) : 15115000, 15115000
. : milestone, 15115000,
iast (18.143 s) : 18143000, 18143000
. : milestone, 18143000,
iast_GLOBAL (17.874 s) : 17874000, 17874000
. : milestone, 17874000,
profiling (15.2 s) : 15200000, 15200000
. : milestone, 15200000,
tracing (15.259 s) : 15259000, 15259000
. : milestone, 15259000,
|
Contributor
|
System tests are failing due to a recent |
Contributor
Author
|
Nice, thanks! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
tipjobs, as it was incorrectly reporting the runtime as:Updated runtime with the fixes:
Contributor Checklist
type:and (comp:orinst:) labels in addition to any other useful labelsclose,fix, or any linking keywords when referencing an issueUse
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]
Note: Once your PR is ready to merge, add it to the merge queue by commenting
/merge./merge -ccancels the queue request./merge -f --reason "reason"skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.