Skip to content

[release-5.0] OCPBUGS-114738: E2E: Fix ovs dynamic pinning, kubelet and mustgather tests - #1621

Open
openshift-cherrypick-robot wants to merge 4 commits into
openshift:release-5.0from
openshift-cherrypick-robot:cherry-pick-1565-to-release-5.0
Open

[release-5.0] OCPBUGS-114738: E2E: Fix ovs dynamic pinning, kubelet and mustgather tests#1621
openshift-cherrypick-robot wants to merge 4 commits into
openshift:release-5.0from
openshift-cherrypick-robot:cherry-pick-1565-to-release-5.0

Conversation

@openshift-cherrypick-robot

Copy link
Copy Markdown

This is an automated cherry-pick of #1565

/assign mrniranjan

Earlier we used to modify performance profile to trigger reboot
i.e change the topology manager to best-effort. This is problem
when ran on ARM where changing topology manager to best-effort or
any other value other than none causes ARM worker node to get stuck

So instead we now use systemctl reboot to reboot the node

Signed-off-by: Niranjan M.R <mniranja@redhat.com>
Earlier when kubelet experimental annotions e2e tests ran , it used
to overwrite any existing annotations. When running on clusters deployed
using ztp, the existing annotations need to be honoured.

Modify the existing tests to honor the existing annotations.

Also skip the tests if architecture is ARM where the annotations
set kublet topology manager to any value other than none

Signed-off-by: Niranjan M.R <mniranja@redhat.com>
Instead of using hardcoded performance profile name, fetch
the performance profile name

Signed-off-by: Niranjan M.R <mniranja@redhat.com>
Test 45488 — Multiple kubelet settings

1. Removed broken ps -ef | grep kubelet block —
   systemReserved is in the drop-in config (/etc/openshift/kubelet.conf.d/20-auto-sizing.conf),
   not in kubelet CLI flags or kubelet.conf
2. Added check via drop-in config file —
   reads 20-auto-sizing.conf from the node and verifies it contains 300Mi

Test 45493 — Should not override PAO values

3. Changed annotation values to differ from PAO defaults —
   was setting cpuManagerPolicy: "static" and cpuManagerReconcilePeriod: "5s" (same as what PAO sets, proving nothing).
   Now sets "none" and "10s", and verifies PAO overrides them back to "static" and 5s

Test 45490 — Memory reservation changes

4. Re-fetch nodes after tuning update —
   workerRTNodes was populated in CustomBeforeAll
   with stale node.Status values. Now re-fetches nodes so
   Capacity and Allocatable reflect the updated reservations

5. Account for hugepages in allocatable calculation —
   pre-allocated hugepages are subtracted from allocatable
   memory by the kubelet but included in node capacity.
   Added loop to sum hugepages from node.Status.Capacity and
   subtract from calculated allocatable

Test 45489 — Verify settings are reverted

6. Use WaitForTuningUpdated instead of WaitForTuningUpdating —
   the revert may not trigger an MCP update when the only
   annotation difference is a PAO-overridden value (e.g.,
   topologyManagerPolicy set via annotation is always overridden
   by the profile spec, so removing it produces the same rendered
   KubeletConfig). WaitForTuningUpdated checks Updated=True which
   passes immediately if no MCP rollout was needed, or waits for
   completion if one was triggered. Applied same fix in AfterAll.

7. Replaced systemReserved check —
   same as 45488: removed ps -ef approach,
   added drop-in config file check verifying 300Mi is no longer present

8. Fixed nil vs empty slice assertion —
   changed Equal(nil) to BeEmpty() for AllowedUnsafeSysctls,
   since after reverting it's an empty slice ([]string{}), not nil

9. Replaced context.TODO() with ctx —
   all ExecCommand, GetKubeletConfig, and ControlPlaneClient.Get calls
   now use the existing ctx (context.Background()) variable for
   consistent context usage

10. Added non-emptiness checks for node slices —
    workerRTNodes and updatedNodes are now validated after
    MatchingOptionalSelector to prevent out-of-bounds panics

11. Use workerRTNodes for ARM check —
    replaced separate cnfNodes lookup with workerRTNodes[0] to
    ensure the ARM check targets the same filtered node set
    used by the tests

AI Attribution: AIA Human-AI blend, Content edits
Signed-off-by: Niranjan M.R <mniranja@redhat.com>
@openshift-merge-bot

Copy link
Copy Markdown
Contributor

Pipeline controller notification
This repo is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: LGTM mode

@coderabbitai

coderabbitai Bot commented Aug 28, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository: openshift/coderabbit/.coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 41ce4e39-6ffd-43f0-a292-408325fda698

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Comment @coderabbitai help to get the list of available commands.

@openshift-ci
openshift-ci Bot requested review from ffromani and swatisehgal August 28, 2026 02:47
@openshift-ci-robot

Copy link
Copy Markdown
Contributor

@openshift-cherrypick-robot: Jira Issue OCPBUGS-112537 has been cloned as Jira Issue OCPBUGS-114738. Will retitle bug to link to clone.
/retitle [release-5.0] OCPBUGS-114738: E2E: Fix ovs dynamic pinning, kubelet and mustgather tests

Details

In response to this:

This is an automated cherry-pick of #1565

/assign mrniranjan

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci Bot changed the title [release-5.0] OCPBUGS-112537: E2E: Fix ovs dynamic pinning, kubelet and mustgather tests [release-5.0] OCPBUGS-114738: E2E: Fix ovs dynamic pinning, kubelet and mustgather tests Aug 28, 2026
@openshift-ci-robot openshift-ci-robot added jira/severity-low Referenced Jira bug's severity is low for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. labels Aug 28, 2026
@openshift-ci-robot

Copy link
Copy Markdown
Contributor

@openshift-cherrypick-robot: This pull request references Jira Issue OCPBUGS-114738, which is valid. The bug has been moved to the POST state.

7 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (5.0.0) matches configured target version for branch (5.0.0)
  • bug is in the state New, which is one of the valid states (NEW, ASSIGNED, POST)
  • release note type set to "Release Note Not Required"
  • dependent bug Jira Issue OCPBUGS-112537 is in the state Verified, which is one of the valid states (MODIFIED, ON_QA, VERIFIED)
  • dependent Jira Issue OCPBUGS-112537 targets the "5.1.0" version, which is one of the valid target versions: 5.1.0
  • bug has dependents

The bug has been updated to refer to the pull request using the external bug tracker.

Details

In response to this:

This is an automated cherry-pick of #1565

/assign mrniranjan

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@mrniranjan

Copy link
Copy Markdown
Contributor

/verified by @mrniranjan

@openshift-ci-robot openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Sep 1, 2026
@openshift-ci-robot

Copy link
Copy Markdown
Contributor

@mrniranjan: This PR has been marked as verified by @mrniranjan.

Details

In response to this:

/verified by @mrniranjan

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@Tal-or Tal-or left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci Bot added the lgtm Indicates that a PR is ready to be merged. label Sep 3, 2026
@openshift-merge-bot

Copy link
Copy Markdown
Contributor

Scheduling required tests:
/test e2e-aws-operator
/test e2e-aws-ovn
/test e2e-aws-ovn-techpreview
/test e2e-gcp-pao
/test e2e-gcp-pao-updating-profile
/test e2e-gcp-pao-workloadhints
/test e2e-hypershift
/test e2e-hypershift-pao
/test e2e-no-cluster
/test e2e-upgrade

@openshift-ci

openshift-ci Bot commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: openshift-cherrypick-robot, Tal-or
Once this PR has been reviewed and has the lgtm label, please assign yanirq for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci

openshift-ci Bot commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

@openshift-cherrypick-robot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-hypershift-pao b51cfaa link true /test e2e-hypershift-pao
ci/prow/e2e-aws-ovn b51cfaa link true /test e2e-aws-ovn
ci/prow/e2e-gcp-pao-updating-profile b51cfaa link true /test e2e-gcp-pao-updating-profile

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

jira/severity-low Referenced Jira bug's severity is low for the branch this PR is targeting. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. verified Signifies that the PR passed pre-merge verification criteria

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants