Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 7 additions & 4 deletions ci-operator/config/RedHatQE/interop-testing/.config.prowgen
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
slack_reporter:
- channel: '#cnv-release-4-18-z'
- channel: '#cnv-release-4-19-z'
job_states_to_report:
- success
- failure
Expand All @@ -9,10 +9,13 @@ slack_reporter:
Job *{{.Spec.Job}}* ended with *{{.Status.State}}*. <{{.Status.URL}}|View
logs> {{end}}'
job_names:
- cnv-odf-tests-aws-ipi-ocp419
- cnv-odf-tests-aws-ipi-ocp419-fips
- cnv-odf-tests-aws-ipi-ocp420
- cnv-odf-tests-aws-ipi-ocp420-fips
- cnv-component-readiness-aws-ipi-ocp421
- gs-baremetal-localnet-ocp419
- cnv-odf-tests-aws-ipi-ocp419-gs-baremetal
- cnv-odf-tests-aws-ipi-ocp419
- cnv-odf-tests-aws-ipi-ocp419-fips
- channel: '#team-ecoeng-fusion-access'
job_states_to_report:
- success
Expand All @@ -23,4 +26,4 @@ slack_reporter:
Job *{{.Spec.Job}}* ended with *{{.Status.State}}*. <{{.Status.URL}}|View
logs> {{end}}'
job_names:
- fusion-access-operator-ipi-ocp420
- fusion-access-operator-ipi-ocp420
93 changes: 55 additions & 38 deletions ci-operator/config/RedHatQE/interop-testing/README.md
Original file line number Diff line number Diff line change
@@ -1,71 +1,88 @@
# Openshift CNV+ODF Interop Interoperability Tests<!-- omit from toc -->
# OpenShift Virtualization Interoperability Tests<!-- omit from toc -->

## Table of Contents<!-- omit from toc -->
gi## Table of Contents<!-- omit from toc -->
- [General Information](#general-information)
- [Purpose](#purpose)
- [Test Scenarios](#test-scenarios)
- [CNV+ODF Interop Tests](#cnvodf-interop-tests)
- [IBM Fusion Access Operator Interop Tests](#ibm-fusion-access-operator-interop-tests)
- [Goldman Sachs Configured Bare-Metal Cluster OpenShift Virtualization Tests](#goldman-sachs-configured-bare-metal-cluster-openshift-virtualization-tests)
- [Process](#process)
- [Cluster Provisioning and Deprovisioning: `firewatch-ipi-aws`](#cluster-provisioning-and-deprovisioning-firewatch-ipi-aws)
- [Test Setup, Execution, and Reporting Results - Openshift GitOps-interop-aws](#test-setup-execution-and-reporting-results---openshift-gitops-interop-aws)
- [Prerequisite(s)](#prerequisites)
- [Environment Variables](#environment-variables)
- [IBM Fusion Access Operator Interop Tests](#ibm-fusion-access-operator-interop-tests)
- [Test Configurations](#test-configurations)
- [Test Chains](#test-chains)
- [CNV+ODF Test Execution](#cnvodf-test-execution)
- [Prerequisites](#prerequisites)
- [Test Configurations](#test-configurations)
- [CNV+ODF Configurations](#cnvodf-configurations)
- [IBM Fusion Access Operator Interop Tests](#ibm-fusion-access-operator-interop-tests-1)
- [Test Chains](#test-chains)
- [GS Bare-Metal Configurations](#gs-bare-metal-configurations)

## General Information

- **Repository**: [RedHatQE/interop-testing](https://github.com/RedHatQE/interop-testing)
- **Repositories:**
- [RedHatQE/interop-testing](https://github.com/RedHatQE/interop-testing)
- [RedHatQE/openshift-virtualization-tests](https://github.com/RedHatQE/openshift-virtualization-tests)

## Purpose

To provision the necessary infrastructure and using that infrastructure to execute Openshift CNV_ODF interop tests.
The results of these tests will be reported to the appropriate sources following execution.
To provision the necessary infrastructure and execute OpenShift Virtualization interoperability tests for various operator combinations, configurations, and scenarios. The results of these tests will be reported to appropriate sources following execution.

## Process
## Test Scenarios

### CNV+ODF Interop Tests

The Openshift CNV+ODF Interop scenario can be broken into the following basic steps:
The CNV+ODF Interop Tests verify the interoperability between OpenShift Virtualization (CNV) and OpenShift Data Foundation (ODF) operators.

1. Provision a test cluster on AWS
2. Install the ODF and CNV Operators
3. Setup ODF StorageSystem and used it a the default StorageClass for CNV
3. Execute tests and archive results
4. Deprovision a test cluster.
### IBM Fusion Access Operator Interop Tests

### Cluster Provisioning and Deprovisioning: `firewatch-ipi-aws`
The IBM Fusion Access Operator tests the integration of the Fusion Access Operator with OpenShift, including IBM Storage Scale deployment and AWS EBS filesystem integration.

Please see the [`firewatch-ipi-aws`](https://steps.ci.openshift.org/workflow/firewatch-ipi-aws) documentation for more information on this workflow. This workflow is not maintained by the Interop QE team.
### Goldman Sachs Configured Bare-Metal Cluster OpenShift Virtualization Tests

### Test Setup, Execution, and Reporting Results - `Openshift GitOps-interop-aws`
Refer to [`gs-baremetal-localnet-test`](../../../step-registry/gs-baremetal/localnet-test/gs-baremetal-localnet-test-ref.yaml) and [`README`](../../../step-registry/gs-baremetal/localnet-test/README.md) to execute OpenShift Virtualization Networking tests on bare-metal cluster configured for Goldman Sachs

## Process

Following the test cluster being provisioned, the following steps are executed in this order:
#### CNV+ODF Test Execution

1. [`deploy-odf`](../../../step-registry/interop-tests/deploy-odf/README.md)
1. [`ocs-tests`](../../../step-registry/interop-tests/ocs-tests/README.md)
1. [`deploy-cnv`](../../../step-registry/interop-tests/deploy-cnv/README.md)
1. [`cnv-tests-e2e-deploy`](../../../step-registry/interop-tests/cnv-tests-e2e-deploy/README.md)
For cluster provisioning and de-provisioning, see the [`firewatch-ipi-aws`](https://steps.ci.openshift.org/workflow/firewatch-ipi-aws) documentation for more information on this workflow. This workflow is not maintained by the Interop QE team.

## Prerequisite(s)
Following cluster provisioning, the following steps are executed in order:

### Environment Variables
1. [`deploy-odf`](../../../step-registry/interop-tests/deploy-odf/README.md) ([ref](../../../step-registry/interop-tests/deploy-odf/interop-tests-deploy-odf-ref.yaml)) - Deploy ODF operator and storage system
2. [`ocs-tests`](../../../step-registry/interop-tests/ocs-tests/README.md) ([ref](../../../step-registry/interop-tests/ocs-tests/interop-tests-ocs-tests-ref.yaml)) - Execute ODF storage tests
3. [`deploy-cnv`](../../../step-registry/interop-tests/deploy-cnv/README.md) ([ref](../../../step-registry/interop-tests/deploy-cnv/interop-tests-deploy-cnv-ref.yaml)) - Deploy CNV operator
4. [`cnv-tests-e2e-deploy`](../../../step-registry/interop-tests/cnv-tests-e2e-deploy/README.md) ([ref](../../../step-registry/interop-tests/cnv-tests-e2e-deploy/interop-tests-cnv-tests-e2e-deploy-ref.yaml)) - Execute CNV e2e tests
5. [`openshift-virtualization-tests`](../../../step-registry/interop-tests/openshift-virtualization-tests/README.md) ([ref](../../../step-registry/interop-tests/openshift-virtualization-tests/interop-tests-openshift-virtualization-tests-ref.yaml)) - Execute OpenShift Virtualization tests

- `BASE_DOMAIN`
- **Definition**: A fully-qualified domain or subdomain name. The base domain of the cloud provider is used for setting baseDomain variable of the install configuration of the cluster.
- **If left empty**: The [`firewatch-ipi-aws` workflow](../../../step-registry/ipi/aws/firewatch-ipi-aws-workflow.yaml) will fail.
## Prerequisites

## IBM Fusion Access Operator Interop Tests

The IBM Fusion Access Operator tests verify the integration of the Fusion Access Operator with OpenShift, including IBM Storage Scale deployment and AWS EBS filesystem integration.
## Test Configurations

### Test Configurations
### CNV+ODF Configurations

- **fusion-access-operator-ocp4.20-lp-interop**: Tests Fusion Access Operator with IBM Storage Scale on OpenShift 4.20
- **fusion-access-cnv-ocp4.20-lp-interop**: Tests Fusion Access Operator with CNV (OpenShift Virtualization) integration on OpenShift 4.20
- **OCP 4.20**:
- `RedHatQE-interop-testing-master__cnv-odf-ocp-4.20-lp-interop.yaml`
- `RedHatQE-interop-testing-master__cnv-odf-ocp-4.20-lp-interop-cr.yaml` (Component Readiness)
- **OCP 4.21**: `RedHatQE-interop-testing-master__cnv-odf-ocp-4.21-lp-interop-cr.yaml` (Component Readiness)

### Test Chains
### IBM Fusion Access Operator Interop Tests

- `fusion-access-operator-ocp4.20-lp-interop`: Tests Fusion Access Operator with IBM Storage Scale on OpenShift 4.20
- `fusion-access-cnv-ocp4.20-lp-interop`: Tests Fusion Access Operator with CNV (OpenShift Virtualization) integration on OpenShift 4.20

#### Test Chains

The tests use modular chains for different testing scenarios:

1. **Environment Setup Chain** ([`interop-tests-ibm-fusion-access-environment-setup-chain`](../../../step-registry/interop-tests/ibm-fusion-access/environment-setup-chain/)) - Sets up namespaces, operators, and IBM Storage Scale cluster
2. **EBS Integration Chain** ([`interop-tests-ibm-fusion-access-ebs-integration-chain`](../../../step-registry/interop-tests/ibm-fusion-access/ebs-integration-chain/)) - Creates and tests EBS-backed IBM Storage Scale filesystems

For detailed documentation on individual steps and configuration options, see the [ibm-fusion-access step registry](../../../step-registry/ibm-fusion-access/).

### GS Bare-Metal Configurations

- **OCP 4.19**: `RedHatQE-interop-testing-master__gs-baremetal-localnet-ocp4.19-lp-gs.yaml`
- Runs on existing Goldman Sachs bare-metal cluster
- Uses `external-cluster` workflow
- Tests OpenShift Virtualization localnet networking with single NIC configuration
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
base_images:
cli:
name: "4.19"
namespace: ocp
tag: cli
openshift-virtualization-tests:
name: openshift-virtualization-tests
namespace: ci
tag: cnv-4.19
releases:
latest:
candidate:
product: ocp
stream: nightly
version: "4.19"
resources:
'*':
requests:
cpu: 200m
memory: 400Mi
tests:
- as: gs-baremetal-localnet-ocp419
capabilities:
- intranet
cron: 0 23 31 2 *
steps:
cluster_profile: metal-redhat-gs
env:
OCP_VERSION: "4.19"
test:
- ref: gs-baremetal-localnet-test
workflow: external-cluster
timeout: 4h0m0s
zz_generated_metadata:
branch: master
org: RedHatQE
repo: interop-testing
variant: gs-baremetal-localnet-ocp4.19-lp-gs
Original file line number Diff line number Diff line change
Expand Up @@ -17,17 +17,6 @@ periodics:
job-release: "4.18"
pj-rehearse.openshift.io/can-be-rehearsed: "true"
name: periodic-ci-RedHatQE-interop-testing-cnv-4.18-cnv-odf-ocp4.18-lp-interop-cnv-odf-tests-aws-ipi-ocp418
reporter_config:
slack:
channel: '#cnv-release-4-18-z'
job_states_to_report:
- success
- failure
- error
report_template: '{{if eq .Status.State "success"}} :slack-green: Job *{{.Spec.Job}}*
ended with *{{.Status.State}}*. <{{.Status.URL}}|View logs> {{else}} :failed:
Job *{{.Spec.Job}}* ended with *{{.Status.State}}*. <{{.Status.URL}}|View
logs> {{end}}'
spec:
containers:
- args:
Expand Down Expand Up @@ -103,17 +92,6 @@ periodics:
job-release: "4.18"
pj-rehearse.openshift.io/can-be-rehearsed: "true"
name: periodic-ci-RedHatQE-interop-testing-cnv-4.18-cnv-odf-ocp4.18-lp-interop-cnv-odf-tests-aws-ipi-ocp418-fips
reporter_config:
slack:
channel: '#cnv-release-4-18-z'
job_states_to_report:
- success
- failure
- error
report_template: '{{if eq .Status.State "success"}} :slack-green: Job *{{.Spec.Job}}*
ended with *{{.Status.State}}*. <{{.Status.URL}}|View logs> {{else}} :failed:
Job *{{.Spec.Job}}* ended with *{{.Status.State}}*. <{{.Status.URL}}|View
logs> {{end}}'
spec:
containers:
- args:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,7 @@ periodics:
name: periodic-ci-RedHatQE-interop-testing-master-cnv-odf-ocp-4.20-lp-interop-cnv-odf-tests-aws-ipi-ocp420
reporter_config:
slack:
channel: '#cnv-release-4-18-z'
channel: '#cnv-release-4-19-z'
job_states_to_report:
- success
- failure
Expand Down Expand Up @@ -267,7 +267,7 @@ periodics:
name: periodic-ci-RedHatQE-interop-testing-master-cnv-odf-ocp-4.20-lp-interop-cnv-odf-tests-aws-ipi-ocp420-fips
reporter_config:
slack:
channel: '#cnv-release-4-18-z'
channel: '#cnv-release-4-19-z'
job_states_to_report:
- success
- failure
Expand Down Expand Up @@ -426,6 +426,17 @@ periodics:
job-release: "4.21"
pj-rehearse.openshift.io/can-be-rehearsed: "true"
name: periodic-ci-RedHatQE-interop-testing-master-cnv-odf-ocp-4.21-lp-interop-cr-cnv-component-readiness-aws-ipi-ocp421
reporter_config:
slack:
channel: '#cnv-release-4-19-z'
job_states_to_report:
- success
- failure
- error
report_template: '{{if eq .Status.State "success"}} :slack-green: Job *{{.Spec.Job}}*
ended with *{{.Status.State}}*. <{{.Status.URL}}|View logs> {{else}} :failed:
Job *{{.Spec.Job}}* ended with *{{.Status.State}}*. <{{.Status.URL}}|View
logs> {{end}}'
spec:
containers:
- args:
Expand Down Expand Up @@ -503,7 +514,7 @@ periodics:
name: periodic-ci-RedHatQE-interop-testing-master-cnv-odf-ocp4.19-lp-interop-cnv-odf-tests-aws-ipi-ocp419
reporter_config:
slack:
channel: '#cnv-release-4-18-z'
channel: '#cnv-release-4-19-z'
job_states_to_report:
- success
- failure
Expand Down Expand Up @@ -589,7 +600,7 @@ periodics:
name: periodic-ci-RedHatQE-interop-testing-master-cnv-odf-ocp4.19-lp-interop-cnv-odf-tests-aws-ipi-ocp419-fips
reporter_config:
slack:
channel: '#cnv-release-4-18-z'
channel: '#cnv-release-4-19-z'
job_states_to_report:
- success
- failure
Expand Down Expand Up @@ -655,6 +666,94 @@ periodics:
- name: result-aggregator
secret:
secretName: result-aggregator
- agent: kubernetes
cluster: build06
cron: 0 23 31 2 *
decorate: true
decoration_config:
skip_cloning: true
timeout: 4h0m0s
extra_refs:
- base_ref: master
org: RedHatQE
repo: interop-testing
labels:
capability/intranet: intranet
ci-operator.openshift.io/cloud: metal-redhat-gs
ci-operator.openshift.io/cloud-cluster-profile: metal-redhat-gs
ci-operator.openshift.io/variant: gs-baremetal-localnet-ocp4.19-lp-gs
ci.openshift.io/generator: prowgen
job-release: "4.19"
pj-rehearse.openshift.io/can-be-rehearsed: "true"
name: periodic-ci-RedHatQE-interop-testing-master-gs-baremetal-localnet-ocp4.19-lp-gs-gs-baremetal-localnet-ocp419
reporter_config:
slack:
channel: '#cnv-release-4-19-z'
job_states_to_report:
- success
- failure
- error
report_template: '{{if eq .Status.State "success"}} :slack-green: Job *{{.Spec.Job}}*
ended with *{{.Status.State}}*. <{{.Status.URL}}|View logs> {{else}} :failed:
Job *{{.Spec.Job}}* ended with *{{.Status.State}}*. <{{.Status.URL}}|View
logs> {{end}}'
spec:
containers:
- args:
- --gcs-upload-secret=/secrets/gcs/service-account.json
- --image-import-pull-secret=/etc/pull-secret/.dockerconfigjson
- --lease-server-credentials-file=/etc/boskos/credentials
- --report-credentials-file=/etc/report/credentials
- --secret-dir=/secrets/ci-pull-credentials
- --target=gs-baremetal-localnet-ocp419
- --variant=gs-baremetal-localnet-ocp4.19-lp-gs
command:
- ci-operator
image: quay-proxy.ci.openshift.org/openshift/ci:ci_ci-operator_latest
imagePullPolicy: Always
name: ""
resources:
requests:
cpu: 10m
volumeMounts:
- mountPath: /etc/boskos
name: boskos
readOnly: true
- mountPath: /secrets/ci-pull-credentials
name: ci-pull-credentials
readOnly: true
- mountPath: /secrets/gcs
name: gcs-credentials
readOnly: true
- mountPath: /secrets/manifest-tool
name: manifest-tool-local-pusher
readOnly: true
- mountPath: /etc/pull-secret
name: pull-secret
readOnly: true
- mountPath: /etc/report
name: result-aggregator
readOnly: true
serviceAccountName: ci-operator
volumes:
- name: boskos
secret:
items:
- key: credentials
path: credentials
secretName: boskos-credentials
- name: ci-pull-credentials
secret:
secretName: ci-pull-credentials
- name: manifest-tool-local-pusher
secret:
secretName: manifest-tool-local-pusher
- name: pull-secret
secret:
secretName: registry-pull-credentials
- name: result-aggregator
secret:
secretName: result-aggregator
- agent: kubernetes
cluster: build09
cron: 0 3,15 * * *
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,10 @@
# Logins who are not members of 'openshift' organization were filtered out
# See the OWNERS docs: https://git.k8s.io/community/contributors/guide/owners.md

approvers:
- dbasunag
approvers: &owner
- cspi-qe-ocp-lp
- dshchedr
- myakove
- rabin-io
options: {}
reviewers:
- dbasunag
- dshchedr
- myakove
- rabin-io
reviewers: *owner
Loading