Skip to content

[release-4.22] OCPBUGS-115161: Raise status polling timeout and write bound - #31582

Merged
openshift-merge-bot[bot] merged 1 commit into
openshift:release-4.22from
openshift-cherrypick-robot:cherry-pick-31559-to-release-4.22
Sep 1, 2026
Merged

[release-4.22] OCPBUGS-115161: Raise status polling timeout and write bound#31582
openshift-merge-bot[bot] merged 1 commit into
openshift:release-4.22from
openshift-cherrypick-robot:cherry-pick-31559-to-release-4.22

Conversation

@openshift-cherrypick-robot

Copy link
Copy Markdown

This is an automated cherry-pick of #31559

/assign openshift-cherrypick-robot

/cherrypick release-4.21 release-4.20 release-4.19

The 3-replica conflicting router stress test was intermittently failing
in two independent places.

1. Polling timeout 2m -> 5m: the leader election lease lasts 1 minute.
   Under normal conditions all route statuses are written within 1-2
   lease cycles, which fit in the previous 2-minute timeout. Under
   heavier contention a router replica may need to re-acquire the lease
   3 or more times until all routes are updated.

2. Write upper bound 50 -> 75: the per-route contention detector runs
   asynchronously and can lag behind update events, allowing a few extra
   writes before suppressing further updates. The previous limit of 50
   caused intermittent failures; 75 is a more conservative ceiling.

https://redhat.atlassian.net/browse/OCPBUGS-99536
@openshift-merge-bot

Copy link
Copy Markdown
Contributor

Pipeline controller notification
This repo is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: automatic mode

@openshift-ci openshift-ci Bot added the ready-for-human-review Indicates a PR has been reviewed by automated tools and is ready for human review label Sep 1, 2026
@openshift-ci
openshift-ci Bot requested review from Miciah and jcmoraisjr September 1, 2026 01:04
@openshift-ci-robot

Copy link
Copy Markdown

@openshift-cherrypick-robot: Jira Issue OCPBUGS-113994 has been cloned as Jira Issue OCPBUGS-115161. Will retitle bug to link to clone.
/retitle [release-4.22] OCPBUGS-115161: Raise status polling timeout and write bound

Details

In response to this:

This is an automated cherry-pick of #31559

/assign openshift-cherrypick-robot

/cherrypick release-4.21 release-4.20 release-4.19

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci Bot changed the title [release-4.22] OCPBUGS-113994: Raise status polling timeout and write bound [release-4.22] OCPBUGS-115161: Raise status polling timeout and write bound Sep 1, 2026
@openshift-ci-robot openshift-ci-robot added jira/severity-moderate Referenced Jira bug's severity is moderate for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. labels Sep 1, 2026
@openshift-ci-robot

Copy link
Copy Markdown

@openshift-cherrypick-robot: This pull request references Jira Issue OCPBUGS-115161, which is valid. The bug has been moved to the POST state.

7 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.22.0) matches configured target version for branch (4.22.0)
  • bug is in the state New, which is one of the valid states (NEW, ASSIGNED, POST)
  • release note type set to "Release Note Not Required"
  • dependent bug Jira Issue OCPBUGS-113994 is in the state MODIFIED, which is one of the valid states (MODIFIED, ON_QA, VERIFIED)
  • dependent Jira Issue OCPBUGS-113994 targets the "5.0.0" version, which is one of the valid target versions: 5.0.0
  • bug has dependents

Requesting review from QA contact:
/cc @melvinjoseph86

The bug has been updated to refer to the pull request using the external bug tracker.

Details

In response to this:

This is an automated cherry-pick of #31559

/assign openshift-cherrypick-robot

/cherrypick release-4.21 release-4.20 release-4.19

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@coderabbitai

coderabbitai Bot commented Sep 1, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository: openshift/coderabbit/.coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: acd38f8e-4d6c-4635-8ed1-7551aff3db0b

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Comment @coderabbitai help to get the list of available commands.

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

Scheduling required tests:
/test e2e-metal-ipi-ovn-ipv6
/test e2e-vsphere-ovn
/test e2e-vsphere-ovn-upi

@redhat-chai-bot

Copy link
Copy Markdown
Contributor

/override-sticky ci/prow/e2e-metal-ipi-ovn-ipv6

Automated triage: This failure appears unrelated to the PR changes.

Job classification: Eligible long-running presubmit e2e/integration job: metal IPI OVN IPv6 on equinix-ocp-metal; the run lasted 4h3m48s and executed the baremetalds-e2e-test step.
Revision check: run c3a555147d99327de8df2ad8e967988a675e32ae; current PR HEAD c3a555147d99327de8df2ad8e967988a675e32ae; match.
Execution status: Tests executed. The suite recorded 1 blocking failure, 1 informing failure, 1844 passes, 1 flaky result, and 2087 skips. The blocking failure was [sig-node] Pod InPlace Resize Container apply invalid resize patch requests Burstable pod - remove cpu requests; the pod event reported OutOfcpu: Node didn't have enough resource on worker-1.
Completed supporting jobs: ci/prow/e2e-vsphere-ovn, ci/prow/e2e-vsphere-ovn-upi, ci/prow/go-verify-deps, ci/prow/images, ci/prow/lint, ci/prow/okd-scos-images, ci/prow/unit, ci/prow/verify, and ci/prow/verify-deps succeeded. tide is still pending and is not treated as positive signal.
Overlap assessment: The PR changes only test/extended/router/stress.go, adjusting router-status polling and the write bound. The changed router convergence tests executed and passed in this run. The blocking failure is in upstream Kubernetes test/e2e/common/node/pod_resize.go and failed during pod scheduling/resource availability; there is no plausible direct or indirect overlap with the PR change.
Missing-coverage risk: Low for this override: the PR-modified router tests ran successfully, while the blocking result is an unrelated node resource-capacity failure. The informing network-segmentation failure remains non-blocking.
Rationale: The failure is a reproducible known flaky pattern for this test: the current test history reports 3 failures in 1783 runs (99.8317% pass), and this run contains the explicit OutOfcpu event rather than a router regression.

If you disagree with this assessment, rerun the current job with /test e2e-metal-ipi-ovn-ipv6.


AI-generated. Review for accuracy.

@openshift-ci

openshift-ci Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

@redhat-chai-bot: Overrode contexts on behalf of redhat-chai-bot: ci/prow/e2e-metal-ipi-ovn-ipv6

These overrides will persist across retests on the current HEAD SHA. Pushing a new commit will clear them. Use /override-cancel to remove them.

Details

In response to this:

/override-sticky ci/prow/e2e-metal-ipi-ovn-ipv6

Automated triage: This failure appears unrelated to the PR changes.

Job classification: Eligible long-running presubmit e2e/integration job: metal IPI OVN IPv6 on equinix-ocp-metal; the run lasted 4h3m48s and executed the baremetalds-e2e-test step.
Revision check: run c3a555147d99327de8df2ad8e967988a675e32ae; current PR HEAD c3a555147d99327de8df2ad8e967988a675e32ae; match.
Execution status: Tests executed. The suite recorded 1 blocking failure, 1 informing failure, 1844 passes, 1 flaky result, and 2087 skips. The blocking failure was [sig-node] Pod InPlace Resize Container apply invalid resize patch requests Burstable pod - remove cpu requests; the pod event reported OutOfcpu: Node didn't have enough resource on worker-1.
Completed supporting jobs: ci/prow/e2e-vsphere-ovn, ci/prow/e2e-vsphere-ovn-upi, ci/prow/go-verify-deps, ci/prow/images, ci/prow/lint, ci/prow/okd-scos-images, ci/prow/unit, ci/prow/verify, and ci/prow/verify-deps succeeded. tide is still pending and is not treated as positive signal.
Overlap assessment: The PR changes only test/extended/router/stress.go, adjusting router-status polling and the write bound. The changed router convergence tests executed and passed in this run. The blocking failure is in upstream Kubernetes test/e2e/common/node/pod_resize.go and failed during pod scheduling/resource availability; there is no plausible direct or indirect overlap with the PR change.
Missing-coverage risk: Low for this override: the PR-modified router tests ran successfully, while the blocking result is an unrelated node resource-capacity failure. The informing network-segmentation failure remains non-blocking.
Rationale: The failure is a reproducible known flaky pattern for this test: the current test history reports 3 failures in 1783 runs (99.8317% pass), and this run contains the explicit OutOfcpu event rather than a router regression.

If you disagree with this assessment, rerun the current job with /test e2e-metal-ipi-ovn-ipv6.


AI-generated. Review for accuracy.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@gcs278

gcs278 commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

/approve
/lgtm

@openshift-ci openshift-ci Bot added the lgtm Indicates that a PR is ready to be merged. label Sep 1, 2026
@openshift-ci

openshift-ci Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: gcs278, openshift-cherrypick-robot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci Bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 1, 2026
@gcs278

gcs278 commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

/test ?

@openshift-ci

openshift-ci Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

@gcs278: The following commands are available to trigger required jobs:

/test e2e-aws-csi
/test e2e-aws-jenkins
/test e2e-aws-ovn-fips
/test e2e-aws-ovn-image-registry
/test e2e-aws-ovn-microshift
/test e2e-aws-ovn-microshift-serial
/test e2e-aws-ovn-serial-1of2
/test e2e-aws-ovn-serial-2of2
/test e2e-gcp-csi
/test e2e-gcp-ovn
/test e2e-gcp-ovn-builds
/test e2e-gcp-ovn-image-ecosystem
/test e2e-gcp-ovn-upgrade
/test e2e-metal-ipi-ovn-ipv6
/test e2e-vsphere-ovn
/test e2e-vsphere-ovn-upi
/test go-verify-deps
/test images
/test lint
/test okd-scos-images
/test unit
/test verify
/test verify-deps
/test verify-image-manifest-lists

The following commands are available to trigger optional jobs:

/test e2e-agnostic-ovn-cmd
/test e2e-aws-disruptive
/test e2e-aws-etcd-certrotation
/test e2e-aws-etcd-recovery
/test e2e-aws-ovn
/test e2e-aws-ovn-cgroupsv2
/test e2e-aws-ovn-edge-zones
/test e2e-aws-ovn-etcd-scaling
/test e2e-aws-ovn-kube-apiserver-rollout
/test e2e-aws-ovn-kubevirt
/test e2e-aws-ovn-serial-fast
/test e2e-aws-ovn-serial-ipsec
/test e2e-aws-ovn-serial-publicnet-1of2
/test e2e-aws-ovn-serial-publicnet-2of2
/test e2e-aws-ovn-single-node
/test e2e-aws-ovn-single-node-serial
/test e2e-aws-ovn-single-node-techpreview
/test e2e-aws-ovn-single-node-techpreview-serial
/test e2e-aws-ovn-single-node-upgrade
/test e2e-aws-ovn-upgrade
/test e2e-aws-ovn-upgrade-rollback
/test e2e-aws-ovn-upi
/test e2e-aws-proxy
/test e2e-azure
/test e2e-azure-ovn-etcd-scaling
/test e2e-azure-ovn-upgrade
/test e2e-baremetalds-kubevirt
/test e2e-external-aws
/test e2e-external-aws-ccm
/test e2e-external-vsphere-ccm
/test e2e-gcp-disruptive
/test e2e-gcp-fips-serial-1of2
/test e2e-gcp-fips-serial-2of2
/test e2e-gcp-ovn-etcd-scaling
/test e2e-gcp-ovn-kube-apiserver-rollout
/test e2e-gcp-ovn-rt-upgrade
/test e2e-gcp-ovn-techpreview
/test e2e-gcp-ovn-techpreview-serial-1of2
/test e2e-gcp-ovn-techpreview-serial-2of2
/test e2e-gcp-ovn-usernamespace
/test e2e-hypershift-conformance
/test e2e-metal-ipi-ovn
/test e2e-metal-ipi-ovn-bgp-virt-dualstack
/test e2e-metal-ipi-ovn-bgp-virt-dualstack-techpreview
/test e2e-metal-ipi-ovn-dualstack
/test e2e-metal-ipi-ovn-dualstack-bgp
/test e2e-metal-ipi-ovn-dualstack-bgp-local-gw
/test e2e-metal-ipi-ovn-dualstack-local-gateway
/test e2e-metal-ipi-ovn-kube-apiserver-rollout
/test e2e-metal-ipi-serial-1of2
/test e2e-metal-ipi-serial-2of2
/test e2e-metal-ipi-serial-ovn-ipv6-1of2
/test e2e-metal-ipi-serial-ovn-ipv6-2of2
/test e2e-metal-ipi-virtualmedia
/test e2e-metal-ovn-single-node-live-iso
/test e2e-metal-ovn-single-node-with-worker-live-iso
/test e2e-metal-ovn-two-node-arbiter
/test e2e-metal-ovn-two-node-fencing
/test e2e-metal-ovn-two-node-fencing-recovery
/test e2e-openstack-dualstack-v6primary
/test e2e-openstack-ovn
/test e2e-openstack-serial
/test e2e-vsphere-ovn-etcd-scaling
/test okd-scos-e2e-aws-ovn

Use /test all to run the following jobs that were automatically triggered:

pull-ci-openshift-origin-release-4.22-go-verify-deps
pull-ci-openshift-origin-release-4.22-images
pull-ci-openshift-origin-release-4.22-lint
pull-ci-openshift-origin-release-4.22-okd-scos-images
pull-ci-openshift-origin-release-4.22-unit
pull-ci-openshift-origin-release-4.22-verify
pull-ci-openshift-origin-release-4.22-verify-deps
Details

In response to this:

/test ?

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@jcmoraisjr

Copy link
Copy Markdown
Member

/verified by CI

@openshift-ci-robot openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Sep 1, 2026
@openshift-ci-robot

Copy link
Copy Markdown

@jcmoraisjr: This PR has been marked as verified by CI.

Details

In response to this:

/verified by CI

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci

openshift-ci Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

@openshift-cherrypick-robot: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-metal-ipi-ovn-ipv6 c3a5551 link true /test e2e-metal-ipi-ovn-ipv6

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-bot
openshift-merge-bot Bot merged commit 191fe9c into openshift:release-4.22 Sep 1, 2026
12 checks passed
@openshift-ci-robot

Copy link
Copy Markdown

@openshift-cherrypick-robot: Jira Issue Verification Checks: Jira Issue OCPBUGS-115161
✔️ This pull request was pre-merge verified.
✔️ All associated pull requests have merged.
✔️ All associated, merged pull requests were pre-merge verified.

Jira Issue OCPBUGS-115161 has been moved to the MODIFIED state and will move to the VERIFIED state when the change is available in an accepted nightly payload. 🕓

Details

In response to this:

This is an automated cherry-pick of #31559

/assign openshift-cherrypick-robot

/cherrypick release-4.21 release-4.20 release-4.19

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-cherrypick-robot

Copy link
Copy Markdown
Author

@openshift-cherrypick-robot: new pull request created: #31587

Details

In response to this:

This is an automated cherry-pick of #31559

/assign openshift-cherrypick-robot

/cherrypick release-4.21 release-4.20 release-4.19

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/severity-moderate Referenced Jira bug's severity is moderate for the branch this PR is targeting. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. ready-for-human-review Indicates a PR has been reviewed by automated tools and is ready for human review verified Signifies that the PR passed pre-merge verification criteria

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants