Subscriptions of some operators are missing after 4.20 upgrade - quay not updated

[DanielFroehlich]

During the last upgrade window and 4.20 upgrade, we hade some strange issue with the Subscription of some operators not showing.
This continues - console for quay operator showing "No Operator Subscription",

Subscription is on stable-3.16 channel, but csv (and actual deployment) is still on 3.15

% oc get Subscription.operators.coreos.com -A | grep quay
openshift-operators      quay-operator           quay-operator                          redhat-operators     stable-3.16

% oc get csv  | grep quay 
quay-operator.v3.15.2                     Red Hat Quay                               3.15.2                quay-operator.v3.15.1                     Succeeded

[DanielFroehlich]

@rbo any idea? This is above my ocp admin level. Can you PTAL?

[rbo]

That's not above your admin level. For me it looks like a bug

I had the same issue during the upgrade #320 (comment)

This link worked for me: https://console-openshift-console.apps.isar.coe.muc.redhat.com/k8s/ns/openshift-operators/operators.coreos.com~v1alpha1~Subscription/quay-operator

[DanielFroehlich]

But that subscription object is in a weird state - i shows status "Upgrade" pointing to an install plan from november (probably the last Z stream upgrade), which is is status complete.
Something is really weird and inconsistent

[rbo]

I found a install plan install-jk9vr related to quay and wasn't approved..

[rbo]

Now some pods are restarting at the quay namespace.