Skip to content

Use localhost image reference in PodObservedGenerationTracking test#2600

Open
Chandan9112 wants to merge 1 commit intoopenshift:masterfrom
Chandan9112:fix-pod-observed-generation-downstream-master
Open

Use localhost image reference in PodObservedGenerationTracking test#2600
Chandan9112 wants to merge 1 commit intoopenshift:masterfrom
Chandan9112:fix-pod-observed-generation-downstream-master

Conversation

@Chandan9112
Copy link

Upstream PR: kubernetes#137252

This is the downstream counterpart to validate the fix on bare-metal environments.

What this PR does / why we need it:

The PodObservedGenerationTracking e2e test creates a pod with an invalid image
(some-image-that-doesnt-exist) to induce a pull error, then updates the image to a
valid one and verifies that the pod conditions' observedGeneration field increments
from 1 to 2.

On bare-metal, the kubelet/CRI-O spends too long trying to resolve the
non-existent image reference against external registries — DNS resolution and registry
lookups often exceed the test's 30-second timeout before the observedGeneration update
can be observed, causing flaky failures in
periodic-ci-openshift-release-main-nightly-4.22-e2e-metal-ipi-ovn-ipv6.

Changes:

Changed the invalid image reference from some-image-that-doesnt-exist to
localhost/some-image-that-doesnt-exist, which fails instantly because there is no
container registry running on localhost. This eliminates the dependency on external
DNS/registry resolution timing.

File changed: test/e2e/node/pods.go

Testing:

Tested against a live cluster — the test passed in ~8 seconds (previously timing out at 30s).
Triggering bare-metal test via /payload-aggregate to confirm the fix on metal.
Test output (from GCP cluster):
[sig-node] Pods Extended (pod generation) Pod Generation
pod observedGeneration field set in pod conditions
STEP: creating the pod
STEP: submitting the pod to kubernetes
STEP: verifying the pod conditions have observedGeneration values
STEP: updating pod to have a valid image
STEP: verifying the pod conditions have updated observedGeneration values
STEP: deleting the pod
[8.041 seconds]
Ran 1 of 7432 Specs in 11.278 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 7431 Skipped
--- PASS: TestE2E (11.37s)
PASS

cc: @bitoku

The test uses an invalid image to induce a pull error. The previous image
name causes slow DNS/registry resolution on bare-metal environments,
leading to 30s timeouts.

Using localhost makes the pull fail instantly, avoiding flaky timeouts.
@openshift-ci-robot openshift-ci-robot added the backports/unvalidated-commits Indicates that not all commits come to merged upstream PRs. label Feb 27, 2026
@openshift-ci-robot
Copy link

@Chandan9112: the contents of this pull request could not be automatically validated.

The following commits could not be validated and must be approved by a top-level approver:

Comment /validate-backports to re-evaluate validity of the upstream PRs, for example when they are merged upstream.

@openshift-ci openshift-ci bot requested review from benluddy and tkashem February 27, 2026 04:14
@openshift-ci
Copy link

openshift-ci bot commented Feb 27, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Chandan9112
Once this PR has been reviewed and has the lgtm label, please assign deads2k for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@Chandan9112
Copy link
Author

/payload-aggregate periodic-ci-openshift-release-main-nightly-4.22-e2e-metal-ipi-ovn-ipv6 10

@openshift-ci
Copy link

openshift-ci bot commented Feb 27, 2026

@Chandan9112: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-main-nightly-4.22-e2e-metal-ipi-ovn-ipv6

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/137040c0-1393-11f1-9f5a-64e05975c424-0

@openshift-ci
Copy link

openshift-ci bot commented Feb 27, 2026

@Chandan9112: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-gcp fffdb91 link true /test e2e-gcp
ci/prow/verify-commits fffdb91 link true /test verify-commits
ci/prow/e2e-aws-ovn-serial-1of2 fffdb91 link true /test e2e-aws-ovn-serial-1of2
ci/prow/e2e-aws-ovn-runc fffdb91 link true /test e2e-aws-ovn-runc
ci/prow/e2e-aws-ovn-techpreview-serial-1of2 fffdb91 link false /test e2e-aws-ovn-techpreview-serial-1of2

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backports/unvalidated-commits Indicates that not all commits come to merged upstream PRs.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants