Skip to content

CMP-4225: Check no TargetDown alert is raised after operator upgrade#1144

Open
Anna-Koudelkova wants to merge 1 commit intoComplianceAsCode:masterfrom
Anna-Koudelkova:CMP-4225
Open

CMP-4225: Check no TargetDown alert is raised after operator upgrade#1144
Anna-Koudelkova wants to merge 1 commit intoComplianceAsCode:masterfrom
Anna-Koudelkova:CMP-4225

Conversation

@Anna-Koudelkova
Copy link
Copy Markdown
Collaborator

@Anna-Koudelkova Anna-Koudelkova commented Apr 2, 2026

This testcase needs CO installed from OLM and a catalogsource compliance-operator with the newer version of the operator available in the catalogsources in openshift-marketplace to be able to upgrade.

It should work once PR #1001 is merged and it is partly using the logic I have already used to query the metrics in this PR #1083 - if it merges first, this PR needs to be rebased and slimmed.

@openshift-ci-robot
Copy link
Copy Markdown
Collaborator

@Anna-Koudelkova: This pull request references CMP-4225 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

…(56353)

Currently passing on 4.21, but need some more work

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci
Copy link
Copy Markdown

openshift-ci bot commented Apr 2, 2026

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: Anna-Koudelkova

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved label Apr 2, 2026
@openshift-ci
Copy link
Copy Markdown

openshift-ci bot commented Apr 2, 2026

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 2, 2026

🤖 To deploy this PR, run the following command:

make catalog-deploy CATALOG_IMG=ghcr.io/complianceascode/compliance-operator-catalog:1144-57c85823a5de70156da28afadebaf41ca0c29a8d

@Anna-Koudelkova Anna-Koudelkova changed the title CMP-4225: WIP Check no TargetDown alert is raised after operator upgrade … CMP-4225: Check no TargetDown alert is raised after operator upgrade Apr 7, 2026
@Anna-Koudelkova
Copy link
Copy Markdown
Collaborator Author

Anna-Koudelkova commented Apr 7, 2026

It is passing now on OCP 4.21 cluster with couple of modifications. My test steps:

  1. Prepare the environment. I have created icsp, catalogsource and installed older version of CO in openshift-compliance ns. The installplan needs to be manually approved after. The yaml files used:
$ cat catsource_upgrade_konflux.yaml 
apiVersion: operators.coreos.com/v1alpha1
kind: CatalogSource
metadata:
  name: compliance-operator
  namespace: openshift-marketplace
spec:
  displayName: Konflux
  image: quay.io/redhat-user-workloads/ocp-isc-tenant/compliance-operator-fbc-4-21@sha256:aa74fbf80ffd4d3743161a7c4722806586359a11ce09ce37e80459ffa7b21cb6 
  publisher: OpenShift QE
  sourceType: grpc
  updateStrategy:
    registryPoll:
      interval: 15m

$ cat icsp.yaml 
apiVersion: operator.openshift.io/v1alpha1
kind: ImageContentSourcePolicy
metadata:
  name: custom-icsp-isc
spec:
  repositoryDigestMirrors: 
  - mirrors:
    - quay.io/redhat-user-workloads/ocp-isc-tenant/file-integrity-operator-bundle-release
    source: registry.redhat.io/compliance/openshift-file-integrity-operator-bundle
  - mirrors:
    - quay.io/redhat-user-workloads/ocp-isc-tenant/file-integrity-operator-release
    source: registry.redhat.io/compliance/openshift-file-integrity-rhel8-operator
  - mirrors:
    - quay.io/redhat-user-workloads/ocp-isc-tenant/compliance-operator-bundle-release
    source: registry.redhat.io/compliance/openshift-compliance-operator-bundle
  - mirrors:
    - quay.io/redhat-user-workloads/ocp-isc-tenant/compliance-operator-release
    source: registry.redhat.io/compliance/openshift-compliance-rhel8-operator
  - mirrors:
    - quay.io/redhat-user-workloads/ocp-isc-tenant/compliance-operator-content-release
    source: registry.redhat.io/compliance/openshift-compliance-content-rhel8
  - mirrors:
    - quay.io/redhat-user-workloads/ocp-isc-tenant/compliance-operator-openscap-release
    source: registry.redhat.io/compliance/openshift-compliance-openscap-rhel8
  - mirrors:
    - quay.io/redhat-user-workloads/ocp-isc-tenant/compliance-operator-must-gather-release
    source: registry.redhat.io/compliance/openshift-compliance-must-gather-rhel8

$ cat upgrade_test_starting_CO.yaml 
apiVersion: v1
kind: Namespace
metadata:
metadata:
  labels:
    openshift.io/cluster-monitoring: "true"
    pod-security.kubernetes.io/enforce: privileged
    pod-security.kubernetes.io/audit: privileged
    pod-security.kubernetes.io/warn: privileged
  name: openshift-compliance
---
apiVersion: operators.coreos.com/v1
kind: OperatorGroup
metadata:
  name: compliance-operator
  namespace: openshift-compliance
spec:
  targetNamespaces:
  - openshift-compliance
---
apiVersion: operators.coreos.com/v1alpha1
kind: Subscription
metadata:
  name: compliance-operator
  namespace: openshift-compliance
spec:
  name: compliance-operator
  channel: stable
  startingCSV: compliance-operator.v1.6.2 
  installPlanApproval: Manual
  source: redhat-operators
  sourceNamespace: openshift-marketplace
  1. I have added two temporary steps in the main test case that would patch the subscription so that the instalplann switch to automatic and aprove pending installplans, so that the testcase would be able to upgrade (this is due to the original CO installed on my cluster - in order for it to prevent updating immediatelly, I needed to block these at first and unblock it later in the test, just after the complianceoperator subscription source is patched to be compliance-operator). The functions used in the testcase:
func (f *Framework) PatchComplianceOperatorSubscriptionInstallPlanAutomatic() error {
	_, err := runOCandGetOutput([]string{
		"patch", "subscription", "compliance-operator", "-n", f.OperatorNamespace,
		"--type", "merge", "-p", `{"spec":{"installPlanApproval":"Automatic"}}`,
	})
	return err
}

func (f *Framework) ApprovePendingInstallPlans() error {
	out, err := runOCandGetOutput([]string{
		"get", "installplan", "-n", f.OperatorNamespace, "-o", "json",
	})
	if err != nil {
		return err
	}
	var list struct {
		Items []struct {
			Metadata struct {
				Name string `json:"name"`
			} `json:"metadata"`
			Spec struct {
				Approved *bool `json:"approved"`
			} `json:"spec"`
		} `json:"items"`
	}
	if err := json.Unmarshal([]byte(out), &list); err != nil {
		return fmt.Errorf("parse installplans: %w", err)
	}
	for _, ip := range list.Items {
		if ip.Spec.Approved != nil && *ip.Spec.Approved {
			continue
		}
		_, err := runOCandGetOutput([]string{
			"patch", "installplan", ip.Metadata.Name, "-n", f.OperatorNamespace,
			"--type", "merge", "--patch", `{"spec":{"approved":true}}`,
		})
		if err != nil {
			return fmt.Errorf("approve installplan %s: %w", ip.Metadata.Name, err)
		}
		log.Printf("approved installplan %s in namespace %s", ip.Metadata.Name, f.OperatorNamespace)
	}
	return nil
}
...
(implementation in the test body)
if err := f.PatchComplianceOperatorSubscriptionInstallPlanAutomatic(); err != nil {
	t.Fatalf("patch subscription installPlanApproval Automatic: %v", err)
}
if err := f.ApprovePendingInstallPlans(); err != nil {
	t.Fatalf("approve pending installplans: %v", err)
}
  1. The testcase then passes on OCP 4.21 when run from the root of the compliance-operator repo with this command:
export TEST_OPERATOR_NAMESPACE=openshift-compliance
export E2E_SKIP_FRAMEWORK_SETUP=true
GOFLAGS=-mod=vendor go test ./tests/e2e/upgrade -v \
  -test.timeout=120m \
  -run TestUpgradeTargetDownNotRaised \
  -args \
    -root="$(pwd)" \
    -globalMan=tests/_setup/crd.yaml \
    -namespacedMan=tests/_setup/deploy_rbac.yaml \
    -cleanupOnError=false \
    -testType=all

Test log:

=== RUN   TestUpgradeTargetDownNotRaised
    main_test.go:68: Old CSV version: compliance-operator.v1.6.2
2026/04/07 12:12:54 approved installplan install-whdbb in namespace openshift-compliance
2026/04/07 12:13:23 waiting ProfileBundle ocp4 to become VALID (PENDING)
2026/04/07 12:13:28 waiting ProfileBundle ocp4 to become VALID (PENDING)
2026/04/07 12:13:33 waiting ProfileBundle ocp4 to become VALID (PENDING)
2026/04/07 12:13:38 waiting ProfileBundle ocp4 to become VALID (PENDING)
2026/04/07 12:13:43 waiting ProfileBundle ocp4 to become VALID (PENDING)
2026/04/07 12:13:48 waiting ProfileBundle ocp4 to become VALID (PENDING)
2026/04/07 12:13:53 waiting ProfileBundle ocp4 to become VALID (PENDING)
2026/04/07 12:13:58 ProfileBundle ready (VALID)
2026/04/07 12:14:03 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:08 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:13 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:18 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:23 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:28 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:33 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:38 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:43 waiting ProfileBundle rhcos4 to become VALID (PENDING)
2026/04/07 12:14:48 ProfileBundle ready (VALID)
2026/04/07 12:14:57 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:02 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:07 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:12 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:17 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:22 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:27 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:32 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: RUNNING
2026/04/07 12:15:37 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: AGGREGATING
2026/04/07 12:15:42 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: AGGREGATING
2026/04/07 12:15:47 waiting until suite test-upgrade-target-down-not-raised-upg-metrics reaches target status 'DONE'. Current status: AGGREGATING
2026/04/07 12:15:57 ComplianceScan ready (DONE)
2026/04/07 12:15:57 All scans in ComplianceSuite have finished (test-upgrade-target-down-not-raised-upg-metrics)
2026/04/07 12:16:04 metrics output:
# HELP compliance_operator_compliance_remediation_status_total A counter for the total number of updates to the status of a ComplianceRemediation
# TYPE compliance_operator_compliance_remediation_status_total counter
compliance_operator_compliance_remediation_status_total{name="ocp4-cis-api-server-encryption-provider-cipher-1",state="NotApplied"} 2
compliance_operator_compliance_remediation_status_total{name="ocp4-cis-api-server-encryption-provider-cipher-1",state="Pending"} 1
compliance_operator_compliance_remediation_status_total{name="ocp4-cis-audit-profile-set",state="NotApplied"} 2
compliance_operator_compliance_remediation_status_total{name="ocp4-cis-audit-profile-set",state="Pending"} 1
compliance_operator_compliance_remediation_status_total{name="ocp4-cis-ingress-controller-tls-cipher-suites",state="NotApplied"} 2
compliance_operator_compliance_remediation_status_total{name="ocp4-cis-ingress-controller-tls-cipher-suites",state="Pending"} 1
# HELP compliance_operator_compliance_scan_status_total A counter for the total number of updates to the status of a ComplianceScan
# TYPE compliance_operator_compliance_scan_status_total counter
compliance_operator_compliance_scan_status_total{name="ocp4-cis",phase="AGGREGATING",result="NOT-AVAILABLE"} 2
compliance_operator_compliance_scan_status_total{name="ocp4-cis",phase="DONE",result="NON-COMPLIANT"} 1
compliance_operator_compliance_scan_status_total{name="ocp4-cis",phase="LAUNCHING",result="NOT-AVAILABLE"} 1
compliance_operator_compliance_scan_status_total{name="ocp4-cis",phase="PENDING",result=""} 1
compliance_operator_compliance_scan_status_total{name="ocp4-cis",phase="RUNNING",result="NOT-AVAILABLE"} 1
# HELP compliance_operator_compliance_state A gauge for the compliance state of a ComplianceSuite. Set to 0 when COMPLIANT, 1 when NON-COMPLIANT, 2 when INCONSISTENT, and 3 when ERROR
# TYPE compliance_operator_compliance_state gauge
compliance_operator_compliance_state{name="test-upgrade-target-down-not-raised-upg-metrics"} 1
# HELP go_gc_duration_seconds A summary of the wall-time pause (stop-the-world) duration in garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 3.5441e-05
go_gc_duration_seconds{quantile="0.25"} 5.1802e-05
go_gc_duration_seconds{quantile="0.5"} 6.5906e-05
go_gc_duration_seconds{quantile="0.75"} 0.000104592
go_gc_duration_seconds{quantile="1"} 0.004710485
go_gc_duration_seconds_sum 0.006501359
go_gc_duration_seconds_count 21
# HELP go_gc_gogc_percent Heap size target percentage configured by the user, otherwise 100. This value is set by the GOGC environment variable, and the runtime/debug.SetGCPercent function. Sourced from /gc/gogc:percent
# TYPE go_gc_gogc_percent gauge
go_gc_gogc_percent 100
# HELP go_gc_gomemlimit_bytes Go runtime memory limit configured by the user, otherwise math.MaxInt64. This value is set by the GOMEMLIMIT environment variable, and the runtime/debug.SetMemoryLimit function. Sourced from /gc/gomemlimit:bytes
# TYPE go_gc_gomemlimit_bytes gauge
go_gc_gomemlimit_bytes 9.223372036854776e+18
# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge
go_goroutines 238
# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.23.10 (Red Hat 1.23.10-1.el9_6)"} 1
# HELP go_memstats_alloc_bytes Number of bytes allocated in heap and currently in use. Equals to /memory/classes/heap/objects:bytes.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 2.6873e+07
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated in heap until now, even if released already. Equals to /gc/heap/allocs:bytes.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 2.1011404e+08
# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table. Equals to /memory/classes/profiling/buckets:bytes.
# TYPE go_memstats_buck_hash_sys_bytes gauge
go_memstats_buck_hash_sys_bytes 1.508391e+06
# HELP go_memstats_frees_total Total number of heap objects frees. Equals to /gc/heap/frees:objects + /gc/heap/tiny/allocs:objects.
# TYPE go_memstats_frees_total counter
go_memstats_frees_total 1.569821e+06
# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata. Equals to /memory/classes/metadata/other:bytes.
# TYPE go_memstats_gc_sys_bytes gauge
go_memstats_gc_sys_bytes 4.3942e+06
# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and currently in use, same as go_memstats_alloc_bytes. Equals to /memory/classes/heap/objects:bytes.
# TYPE go_memstats_heap_alloc_bytes gauge
go_memstats_heap_alloc_bytes 2.6873e+07
# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used. Equals to /memory/classes/heap/released:bytes + /memory/classes/heap/free:bytes.
# TYPE go_memstats_heap_idle_bytes gauge
go_memstats_heap_idle_bytes 1.069056e+07
# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use. Equals to /memory/classes/heap/objects:bytes + /memory/classes/heap/unused:bytes
# TYPE go_memstats_heap_inuse_bytes gauge
go_memstats_heap_inuse_bytes 3.3726464e+07
# HELP go_memstats_heap_objects Number of currently allocated objects. Equals to /gc/heap/objects:objects.
# TYPE go_memstats_heap_objects gauge
go_memstats_heap_objects 181298
# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS. Equals to /memory/classes/heap/released:bytes.
# TYPE go_memstats_heap_released_bytes gauge
go_memstats_heap_released_bytes 2.670592e+06
# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system. Equals to /memory/classes/heap/objects:bytes + /memory/classes/heap/unused:bytes + /memory/classes/heap/released:bytes + /memory/classes/heap/free:bytes.
# TYPE go_memstats_heap_sys_bytes gauge
go_memstats_heap_sys_bytes 4.4417024e+07
# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE go_memstats_last_gc_time_seconds gauge
go_memstats_last_gc_time_seconds 1.775556936587476e+09
# HELP go_memstats_mallocs_total Total number of heap objects allocated, both live and gc-ed. Semantically a counter version for go_memstats_heap_objects gauge. Equals to /gc/heap/allocs:objects + /gc/heap/tiny/allocs:objects.
# TYPE go_memstats_mallocs_total counter
go_memstats_mallocs_total 1.751119e+06
# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures. Equals to /memory/classes/metadata/mcache/inuse:bytes.
# TYPE go_memstats_mcache_inuse_bytes gauge
go_memstats_mcache_inuse_bytes 4800
# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system. Equals to /memory/classes/metadata/mcache/inuse:bytes + /memory/classes/metadata/mcache/free:bytes.
# TYPE go_memstats_mcache_sys_bytes gauge
go_memstats_mcache_sys_bytes 15600
# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures. Equals to /memory/classes/metadata/mspan/inuse:bytes.
# TYPE go_memstats_mspan_inuse_bytes gauge
go_memstats_mspan_inuse_bytes 515360
# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system. Equals to /memory/classes/metadata/mspan/inuse:bytes + /memory/classes/metadata/mspan/free:bytes.
# TYPE go_memstats_mspan_sys_bytes gauge
go_memstats_mspan_sys_bytes 734400
# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place. Equals to /gc/heap/goal:bytes.
# TYPE go_memstats_next_gc_bytes gauge
go_memstats_next_gc_bytes 4.2464472e+07
# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations. Equals to /memory/classes/other:bytes.
# TYPE go_memstats_other_sys_bytes gauge
go_memstats_other_sys_bytes 1.020505e+06
# HELP go_memstats_stack_inuse_bytes Number of bytes obtained from system for stack allocator in non-CGO environments. Equals to /memory/classes/heap/stacks:bytes.
# TYPE go_memstats_stack_inuse_bytes gauge
go_memstats_stack_inuse_bytes 1.671168e+06
# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator. Equals to /memory/classes/heap/stacks:bytes + /memory/classes/os-stacks:bytes.
# TYPE go_memstats_stack_sys_bytes gauge
go_memstats_stack_sys_bytes 1.671168e+06
# HELP go_memstats_sys_bytes Number of bytes obtained from system. Equals to /memory/classes/total:byte.
# TYPE go_memstats_sys_bytes gauge
go_memstats_sys_bytes 5.3761288e+07
# HELP go_sched_gomaxprocs_threads The current runtime.GOMAXPROCS setting, or the number of operating system threads that can execute user-level Go code simultaneously. Sourced from /sched/gomaxprocs:threads
# TYPE go_sched_gomaxprocs_threads gauge
go_sched_gomaxprocs_threads 4
# HELP go_threads Number of OS threads created.
# TYPE go_threads gauge
go_threads 10
# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds.
# TYPE process_cpu_seconds_total counter
process_cpu_seconds_total 1.79
# HELP process_max_fds Maximum number of open file descriptors.
# TYPE process_max_fds gauge
process_max_fds 524288
# HELP process_network_receive_bytes_total Number of bytes received by the process over the network.
# TYPE process_network_receive_bytes_total counter
process_network_receive_bytes_total 7.700938e+06
# HELP process_network_transmit_bytes_total Number of bytes sent by the process over the network.
# TYPE process_network_transmit_bytes_total counter
process_network_transmit_bytes_total 555384
# HELP process_open_fds Number of open file descriptors.
# TYPE process_open_fds gauge
process_open_fds 14
# HELP process_resident_memory_bytes Resident memory size in bytes.
# TYPE process_resident_memory_bytes gauge
process_resident_memory_bytes 1.00573184e+08
# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1.77555679553e+09
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 1.937485824e+09
# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE process_virtual_memory_max_bytes gauge
process_virtual_memory_max_bytes 1.8446744073709552e+19
# HELP promhttp_metric_handler_requests_in_flight Current number of scrapes being served.
# TYPE promhttp_metric_handler_requests_in_flight gauge
promhttp_metric_handler_requests_in_flight 1
# HELP promhttp_metric_handler_requests_total Total number of scrapes by HTTP status code.
# TYPE promhttp_metric_handler_requests_total counter
promhttp_metric_handler_requests_total{code="200"} 11
promhttp_metric_handler_requests_total{code="500"} 0
promhttp_metric_handler_requests_total{code="503"} 0
pod "metrics-test" deleted

2026/04/07 12:16:17 alert with label name=test-upgrade-target-down-not-raised-upg-metrics and description containing 'The compliance suite test-upgrade-target-down-not-raised-upg-metrics returned as NON-COMPLIANT, ERROR, or INCONSISTENT' not found in AlertManager... retrying
2026/04/07 12:16:25 alert with label name=test-upgrade-target-down-not-raised-upg-metrics and description containing 'The compliance suite test-upgrade-target-down-not-raised-upg-metrics returned as NON-COMPLIANT, ERROR, or INCONSISTENT' not found in AlertManager... retrying
2026/04/07 12:16:30 alert with label name=test-upgrade-target-down-not-raised-upg-metrics and description containing 'The compliance suite test-upgrade-target-down-not-raised-upg-metrics returned as NON-COMPLIANT, ERROR, or INCONSISTENT' not found in AlertManager... retrying
--- PASS: TestUpgradeTargetDownNotRaised (238.40s)
PASS
ok  	github.com/ComplianceAsCode/compliance-operator/tests/e2e/upgrade	245.809s

@Anna-Koudelkova Anna-Koudelkova marked this pull request as ready for review April 7, 2026 10:47
@openshift-ci openshift-ci bot requested review from rhmdnd and yuumasato April 7, 2026 10:47
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 7, 2026

🤖 To deploy this PR, run the following command:

make catalog-deploy CATALOG_IMG=ghcr.io/complianceascode/compliance-operator-catalog:1144-f62145419947c055011610f8fd5876a90c67d62f

@openshift-ci
Copy link
Copy Markdown

openshift-ci bot commented Apr 7, 2026

@Anna-Koudelkova: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-serial f621454 link true /test e2e-aws-serial
ci/prow/e2e-rosa f621454 link true /test e2e-rosa
ci/prow/e2e-aws-serial-arm f621454 link true /test e2e-aws-serial-arm

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants