Skip to content

NO-JIRA: Add test configuration scenarios overview#745

Open
DavidRajnoha wants to merge 1 commit intoopenshift:mainfrom
DavidRajnoha:cypress-readme-configuration-scenarios
Open

NO-JIRA: Add test configuration scenarios overview#745
DavidRajnoha wants to merge 1 commit intoopenshift:mainfrom
DavidRajnoha:cypress-readme-configuration-scenarios

Conversation

@DavidRajnoha
Copy link
Contributor

@DavidRajnoha DavidRajnoha commented Jan 29, 2026

Add high-level scenarios table showing common testing configurations (Released Version, Pre-provisioned, Local Dev, Custom Images, FBC, Konflux) and test areas (Monitoring, COO, Incidents, Virtualization).

Remove redundant Configuration Examples section. Simplify Incidents documentation to reference COO section.

Summary by CodeRabbit

  • Documentation
    • Reorganized test configuration documentation with a new "Test Configuration Scenarios" section for clarity.
    • Added "Test Areas" subsection describing monitoring, COO, incidents, and virtualization test scopes with corresponding run commands.
    • Elevated Incident Documentation to a top-level section, added cross-references to COO tests, and introduced incident-specific variables with defaults.
    • Removed legacy configuration examples and refined wording/formatting throughout test docs.

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Jan 29, 2026
@openshift-ci-robot
Copy link

@DavidRajnoha: This pull request explicitly references no jira issue.

Details

In response to this:

Add high-level scenarios table showing common testing configurations (Released Version, Pre-provisioned, Local Dev, Custom Images, FBC, Konflux) and test areas (Monitoring, COO, Incidents, Virtualization).

Remove redundant Configuration Examples section. Simplify Incidents documentation to reference COO section.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jan 29, 2026
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jan 29, 2026

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@DavidRajnoha DavidRajnoha marked this pull request as ready for review February 27, 2026 10:59
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Feb 27, 2026
@coderabbitai
Copy link

coderabbitai bot commented Feb 27, 2026

📝 Walkthrough

Walkthrough

Reworks the Cypress README: adds a "Test Configuration Scenarios" section and "Test Areas" subsection; removes legacy configuration examples; elevates and reorganizes incident documentation with an "Incidents-Specific Variables" table (CYPRESS_TIMEZONE, CYPRESS_MOCK_NEW_METRICS); updates cross-references and minor wording/formatting.

Changes

Cohort / File(s) Summary
Cypress Test Documentation
web/cypress/README.md
Added "Test Configuration Scenarios" and "Test Areas" subsections; removed historical "Configuration Examples" block; promoted and reorganized incident documentation to top-level; added "Incidents-Specific Variables" (CYPRESS_TIMEZONE, CYPRESS_MOCK_NEW_METRICS) and updated test-doc cross-references; minor wording/formatting edits.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~8 minutes

Poem

🐇 I nibble on README lines today,

I sort the scenarios, then hop away.
Tables tidy, incidents set free,
A carrot of clarity for all to see.

🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title directly reflects the main change: adding a test configuration scenarios overview section to the README.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
web/cypress/README.md (1)

399-404: Consolidate duplicate variable documentation.

The variables CYPRESS_TIMEZONE and CYPRESS_MOCK_NEW_METRICS are already documented in the "Incidents Testing Configuration" section (lines 140-153). Duplicating this information creates a maintenance burden and risks inconsistency.

♻️ Recommended consolidation approach

Remove the duplicate table and reference the existing section:

 ## Incident Detection Test Documentation
 
 For configuration scenarios, see [Test Areas](`#test-areas`) above.
 
-### Incidents-Specific Variables
-
-| Variable | Default | Description |
-|----------|---------|-------------|
-| `CYPRESS_TIMEZONE` | `UTC` | Cluster timezone for incident timeline calculations |
-| `CYPRESS_MOCK_NEW_METRICS` | `false` | Transform old metric names to new format in mocks |
-
 ### Test Case Documentation
 
 Detailed test documentation: [`docs/incident_detection/tests/`](../../docs/incident_detection/tests/)

Then optionally add a forward reference in the "Incident Detection Test Documentation" section:

For incidents-specific variables, see [Incidents Testing Configuration](`#incidents-testing-configuration`).
🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@web/cypress/README.md` around lines 399 - 404, Remove the duplicated
"Incidents-Specific Variables" table that documents CYPRESS_TIMEZONE and
CYPRESS_MOCK_NEW_METRICS and instead reference the existing "Incidents Testing
Configuration" section; update the "Incident Detection Test Documentation" (or
the current section containing the duplicate) to include a forward reference
like "For incidents-specific variables, see Incidents Testing Configuration" so
all variable docs live only in that canonical section.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@web/cypress/README.md`:
- Line 397: The link fragment "#coo-tests-perses-dashboards-incidents" is
invalid; update the line containing "For configuration scenarios, see [COO
Tests](`#coo-tests-perses-dashboards-incidents`) above." to point to an existing
heading anchor instead—either change the target fragment to the "Test Areas"
section anchor or to the "Test Configuration Scenarios" section anchor; keep the
link text "[COO Tests]" intact and ensure the chosen heading exists (or convert
the table cell "COO (Perses, Dashboards, Incidents)" into a real heading and use
its generated anchor).

---

Nitpick comments:
In `@web/cypress/README.md`:
- Around line 399-404: Remove the duplicated "Incidents-Specific Variables"
table that documents CYPRESS_TIMEZONE and CYPRESS_MOCK_NEW_METRICS and instead
reference the existing "Incidents Testing Configuration" section; update the
"Incident Detection Test Documentation" (or the current section containing the
duplicate) to include a forward reference like "For incidents-specific
variables, see Incidents Testing Configuration" so all variable docs live only
in that canonical section.

ℹ️ Review info

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Cache: Disabled due to data retention organization setting

Knowledge base: Disabled due to data retention organization setting

📥 Commits

Reviewing files that changed from the base of the PR and between edce6c4 and d268bc3.

📒 Files selected for processing (1)
  • web/cypress/README.md

Add high-level scenarios table showing common testing configurations
(Released Version, Pre-provisioned, Local Dev, Custom Images, FBC,
Konflux) and test areas (Monitoring, COO, Incidents, Virtualization).

Remove redundant Configuration Examples section. Simplify Incidents
documentation to reference COO section.
@DavidRajnoha DavidRajnoha force-pushed the cypress-readme-configuration-scenarios branch from d268bc3 to 6a75bb4 Compare February 27, 2026 12:57
Copy link

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
web/cypress/README.md (1)

399-405: Consolidate duplicate incident variable documentation.

The variables CYPRESS_TIMEZONE and CYPRESS_MOCK_NEW_METRICS are documented twice:

  1. Lines 140-148: "Incidents Testing Configuration" section
  2. Lines 399-405: "Incidents-Specific Variables" section

Additionally, the description at line 147 provides more context ("temporary workaround for testing against locally built instances") than line 404.

Consider consolidating these into a single authoritative section to reduce maintenance burden and prevent documentation drift.

📝 Suggested consolidation approach

Option 1: Keep only the earlier section (lines 140-148) and reference it from line 395:

 ## Incident Detection Test Documentation
 
-For configuration scenarios, see [COO Tests](`#test-configuration-scenarios`) above.
+For configuration scenarios, see [Test Areas](`#test-areas`) above.
+For incident-specific variables, see [Incidents Testing Configuration](`#incidents-testing-configuration`) above.
 
-### Incidents-Specific Variables
-
-| Variable | Default | Description |
-|----------|---------|-------------|
-| `CYPRESS_TIMEZONE` | `UTC` | Cluster timezone for incident timeline calculations |
-| `CYPRESS_MOCK_NEW_METRICS` | `false` | Transform old metric names to new format in mocks |
-
 ### Test Case Documentation

Option 2: Keep only the later section (lines 399-405) with the fuller description and remove lines 140-148, updating line 197 to reference the new location.

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@web/cypress/README.md` around lines 399 - 405, The docs duplicate the
incident env vars CYPRESS_TIMEZONE and CYPRESS_MOCK_NEW_METRICS in two sections
("Incidents Testing Configuration" and "Incidents-Specific Variables"); remove
one duplicate and consolidate into a single authoritative location so
descriptions don't drift—either keep the earlier "Incidents Testing
Configuration" and update the later reference to point to it, or keep the later
"Incidents-Specific Variables" (which has the fuller description including the
"temporary workaround for testing against locally built instances") and update
the earlier reference to point to the new section; ensure the kept entry
contains both variable names and the fuller description for
CYPRESS_MOCK_NEW_METRICS and update any cross-references in the README
accordingly.
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Nitpick comments:
In `@web/cypress/README.md`:
- Around line 399-405: The docs duplicate the incident env vars CYPRESS_TIMEZONE
and CYPRESS_MOCK_NEW_METRICS in two sections ("Incidents Testing Configuration"
and "Incidents-Specific Variables"); remove one duplicate and consolidate into a
single authoritative location so descriptions don't drift—either keep the
earlier "Incidents Testing Configuration" and update the later reference to
point to it, or keep the later "Incidents-Specific Variables" (which has the
fuller description including the "temporary workaround for testing against
locally built instances") and update the earlier reference to point to the new
section; ensure the kept entry contains both variable names and the fuller
description for CYPRESS_MOCK_NEW_METRICS and update any cross-references in the
README accordingly.

ℹ️ Review info

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Cache: Disabled due to data retention organization setting

Knowledge base: Disabled due to data retention organization setting

📥 Commits

Reviewing files that changed from the base of the PR and between d268bc3 and 6a75bb4.

📒 Files selected for processing (1)
  • web/cypress/README.md

@etmurasaki
Copy link
Contributor

/label qe-approved

@openshift-ci openshift-ci bot added the qe-approved Signifies that QE has signed off on this PR label Feb 27, 2026
@etmurasaki
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Feb 27, 2026
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 27, 2026

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: DavidRajnoha, etmurasaki

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 27, 2026
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 27, 2026

@DavidRajnoha: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn 6a75bb4 link unknown /test e2e-aws-ovn

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. qe-approved Signifies that QE has signed off on this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants