Document latest A&C CTT follow-up results#4024
Closed
marcschier wants to merge 1 commit into
Closed
Conversation
Contributor
There was a problem hiding this comment.
Pull request overview
Note
Copilot couldn't run its full agentic review because it didn't start before the timeout. Make sure your repository has a runner available, or add a copilot-code-review.yml file specifying one with the runs-on attribute. See the docs for more details.
Documents results of the latest A&C-only CTT run and explains why remaining Alarm/Enable/Confirm failures are not new server regressions.
Changes:
- Added a new section summarizing the latest A&C-only CTT artifacts and error breakdown.
- Documented explanations for Alarm
Test_004.js/Test_002.js, EnableTest_002.js, and ConfirmTest_001.jsoutcomes, including standards context (Part 9 §5.5.2) and tooling/script limitations.
Comment on lines
+421
to
+423
| ### Latest A&C-only run confirms no new Alarm, Enable, or Confirm server regression | ||
|
|
||
| The latest artifact (`NewCTT2.results 23.xml`, paired with `ctt output 10.txt`) has 140 errors: 64 from Alarm `Test_004.js`, 28 from Alarm `Test_002.js`, 45 from Enable `Test_002.js`, and three Confirm `Test_001.js` summaries. The prior model-map, ModellingRule, invalid configured Object Value, Refresh2 cascade, and cross-Session Confirm `Err_004.js` failures are absent. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Document the latest A&C-only CTT run (
NewCTT2.results 23.xmlwithctt output 10.txt) and reconcile the apparent Alarm, Enable, and Confirm regressions.The 140 remaining errors do not identify a new server regression:
Test_004.jsperforms re-entrant reads from the alarm callback and receives client-sideBadInvalidState; the higher count reflects corrected project mappings reaching more valid InputNodes.Test_002.jsand ConfirmTest_001.jsevaluate Retain without accounting for outstanding ConditionBranches, contrary to Part 9 section 5.5.2.Test_002.jsstill discards its detailed failure reason by passing four arguments to the three-argumentAddMessagefunction.The previous model-map, ModellingRule, invalid configured Object Value, Refresh2 cascade, and cross-Session Confirm failures are absent.
Related Issues
Checklist
Focused Alarm, Enable, and Confirm tests passed on .NET 10 and .NET Framework 4.8. The combined net48 run took the existing inconclusive timeout path for one Enable cycle; its isolated rerun passed.