Skip to content

Conversation

@maximsava12
Copy link
Contributor

This patch enhances the cifmw_ceph_client role to:

  • Automatically discover Ceph RGW (RADOS Gateway) endpoint and credentials
  • Create Glance secrets using the discovered RGW settings

This integration allows Glance to leverage Ceph RGW for secret storage when object store backends are enabled in the environment.

Changes:

  • Add RGW discovery tasks to the role
  • Add logic to create Glance secrets with RGW config

@maximsava12 maximsava12 requested a review from a team as a code owner July 30, 2025 08:37
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jul 30, 2025

Hi @maximsava12. Thanks for your PR.

I'm waiting for a openstack-k8s-operators member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/148eba965ca54ffcb1f99d5cd834ff75

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 48m 15s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 14m 32s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 10s
podified-multinode-hci-deployment-crc FAILURE in 54m 53s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 40s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 15s
✔️ build-push-container-cifmw-client SUCCESS in 20m 57s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 34s

@maximsava12 maximsava12 marked this pull request as draft July 30, 2025 13:33
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/61cc1357fe544e08a49db0a7898852f2

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 42m 25s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 13m 24s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 27m 50s
podified-multinode-hci-deployment-crc FAILURE in 51m 42s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 31s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 03s
✔️ build-push-container-cifmw-client SUCCESS in 20m 21s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 18s

@tosky
Copy link
Contributor

tosky commented Jul 31, 2025

Request for the future: if you keep your pull request "clean" as long as you develop it, you won't need to rebase and clean the pull request when it is ready. So if you update this, please ensure to always have a single commit (unless you want to have more commits, but the commits in this pull request are all updates to the same commit).

@maximsava12
Copy link
Contributor Author

Request for the future: if you keep your pull request "clean" as long as you develop it, you won't need to rebase and clean the pull request when it is ready. So if you update this, please ensure to always have a single commit (unless you want to have more commits, but the commits in this pull request are all updates to the same commit).

Ack

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/bbd2fe91fbfa4d28843e48791c3b0b10

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 44m 58s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 41s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 38s
podified-multinode-hci-deployment-crc FAILURE in 52m 54s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 21s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 55s
✔️ build-push-container-cifmw-client SUCCESS in 21m 02s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 17s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/b78f7c0247ad4884baa7e18744b0ea35

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 48m 05s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 11m 52s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 34m 07s
podified-multinode-hci-deployment-crc FAILURE in 52m 30s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 59s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 00s
✔️ build-push-container-cifmw-client SUCCESS in 16m 14s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 10s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 18fc8d2 to 31ba8bc Compare August 4, 2025 17:03
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/c6e28a41162640f3bf0ae19b627d1b5a

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 44m 15s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 06m 39s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 09s
podified-multinode-hci-deployment-crc FAILURE in 50m 41s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 33s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 44s
✔️ build-push-container-cifmw-client SUCCESS in 16m 19s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 15s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 31ba8bc to 1677da5 Compare August 5, 2025 07:22
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/2ac991835378471aa3b9ab475f753e13

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 37m 49s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 04m 54s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 21m 07s
podified-multinode-hci-deployment-crc FAILURE in 51m 34s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 04s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 47s
✔️ build-push-container-cifmw-client SUCCESS in 16m 50s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 13s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 1677da5 to 88fa5f4 Compare August 5, 2025 10:55
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/1d3f5d867f7d40eaa3ad3ec1cf166972

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 48m 56s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 07m 12s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 45s
podified-multinode-hci-deployment-crc FAILURE in 50m 23s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 57s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 56s
✔️ build-push-container-cifmw-client SUCCESS in 20m 08s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 07s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 88fa5f4 to 3907733 Compare August 10, 2025 10:51
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/f1619da0b1ea4e2083066012b26534c8

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 57m 17s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 07s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 36m 16s
podified-multinode-hci-deployment-crc FAILURE in 48m 55s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 33s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 00s
✔️ build-push-container-cifmw-client SUCCESS in 18m 45s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 15s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch 2 times, most recently from 5c487c6 to 4b8a24b Compare August 10, 2025 15:16
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/0b58377b5c1d44f08732f26e86a3b288

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 52m 57s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 11m 30s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 30m 02s
podified-multinode-hci-deployment-crc FAILURE in 50m 26s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 23s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 50s
✔️ build-push-container-cifmw-client SUCCESS in 22m 58s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 11s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 4b8a24b to 0e4c85c Compare August 10, 2025 19:08
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3e7b0388f2294c399c0f70c8320e9605

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 49m 48s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 10m 34s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 26m 32s
podified-multinode-hci-deployment-crc FAILURE in 50m 04s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 17s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 54s
✔️ build-push-container-cifmw-client SUCCESS in 15m 36s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 08s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 0e4c85c to de78135 Compare August 11, 2025 04:54
@softwarefactory-project-zuul
Copy link

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/ci-framework for 3169,4aded046f02a1b5cf66069431f8f90c142d3d900

@softwarefactory-project-zuul
Copy link

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/ci-framework for 3169,4aded046f02a1b5cf66069431f8f90c142d3d900

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 4aded04 to aa8f9eb Compare December 17, 2025 11:02
@softwarefactory-project-zuul
Copy link

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/ci-framework for 3169,aa8f9eb826262842339a5d4bc360fcf65e6923fd

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/18beaefd57554225b7aade549a5d8b8a

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 26m 19s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 35s
cifmw-crc-podified-edpm-baremetal FAILURE in 26m 26s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 10m 34s
✔️ podified-multinode-hci-deployment-crc SUCCESS in 1h 46m 13s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 52s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 17m 10s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 03s
build-push-container-cifmw-client FAILURE in 24m 08s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 22s
✔️ cifmw-molecule-cifmw_cephadm SUCCESS in 4m 43s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from 097bf6d to ad7a3cf Compare December 17, 2025 15:20
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/1e47746c03eb42deb1f1ae08629a4ce4

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 29m 16s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 29m 02s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 48m 13s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 13m 24s
podified-multinode-hci-deployment-crc FAILURE in 59m 51s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 29s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 27s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 43s
build-push-container-cifmw-client FAILURE in 24m 37s
cifmw-molecule-cifmw_ceph_client FAILURE in 4m 07s
✔️ cifmw-molecule-cifmw_cephadm SUCCESS in 4m 34s

@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from ad7a3cf to d744754 Compare December 17, 2025 19:39
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/486201c7f8a74c60a3629e505eeb0005

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 19m 59s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 25m 28s
cifmw-crc-podified-edpm-baremetal FAILURE in 1h 52m 02s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 05m 12s
podified-multinode-hci-deployment-crc FAILURE in 59m 50s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 36s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 21s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 07s
build-push-container-cifmw-client FAILURE in 25m 58s
✔️ cifmw-molecule-cifmw_ceph_client SUCCESS in 4m 39s
✔️ cifmw-molecule-cifmw_cephadm SUCCESS in 4m 29s

This patch enhances the cifmw_ceph_client/cifmw_cephadm roles to:
- Automatically discover Ceph RGW (RADOS Gateway) endpoint and credentials
- Create Glance secrets using the discovered RGW settings
- Configure glance with Ceph RGW secrets
- Creating a dedicated 'glance' S3 user in RGW (cifmw_cephadm role)

This integration configures Glance with Ceph RGW access credentials,
enabling it to use RGW as an Glance backend when object storage is enabled

Changes:
- Add RGW discovery playbook
- Add logic to create Glance secrets with RGW config

Signed-off-by: Maxim Sava <msava@redhat.com>
@maximsava12 maximsava12 force-pushed the glance-ceph-s3-backend branch from d744754 to f8da9f0 Compare December 18, 2025 08:26
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Dec 18, 2025

[APPROVALNOTIFIER] This PR is APPROVED

Approval requirements bypassed by manually added approval.

This pull-request has been approved by:

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/1ac61bd0392c4365bab869ea950acde3

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 23m 47s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 06m 01s
cifmw-crc-podified-edpm-baremetal NODE_FAILURE Node request 099-0008119615 failed in 0s
cifmw-crc-podified-edpm-baremetal-minor-update NODE_FAILURE Node request 099-0008119616 failed in 0s
podified-multinode-hci-deployment-crc FAILURE in 45m 59s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 40s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 03s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 46s
✔️ cifmw-molecule-cifmw_ceph_client SUCCESS in 4m 21s
✔️ cifmw-molecule-cifmw_cephadm SUCCESS in 4m 49s

@maximsava12
Copy link
Contributor Author

recheck

# under the License.

- name: Create glance S3 RGW user and fetch object-store endpoint
when: cifmw_cephadm_rgw_s3_glance | default(false) | bool
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: put the cifmw_cephadm_rgw_s3_glance into defaults.yml. Thanks!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we have cifmw_cephadm_rgw_s3_glance in roles/cifmw_cephadm/defaults/main.yaml

failed_when: false
until: >
rgw_daemon_status.rc == 0 and
(rgw_daemon_status.stdout | default('[]') | from_json | default([], true)) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: second default does not make sense.

--display-name="Glance S3 User"
become: true
when:
- cifmw_ceph_s3_glance_user_check is not skipped
Copy link
Contributor

@danpawlik danpawlik Dec 18, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the condition for that tasks are almost fine. What is missing: keep logic.
In previous task you check when: cifmw_cephadm_ceph_cli is defined.
Here you use that binary, so if previous task fails, it is skipped, rc != 0, then if cifmw_cephadm_ceph_cli is not defined, it would raise an error.
Do I understand correctly? I'm not familiar with "skipping" in condition and when it is ignore_errors.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes,cover two cases if cifmw_cephadm_ceph_cli is not defined means skipped and if user not exist we check with rc code

Copy link
Contributor

@fultonj fultonj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we're getting close to merging.

Just a few more things to fix before we can. I left a request for a small change. I think @danpawlik has some valid suggestions so please reply in the review when you have addressed them.

ansible.builtin.import_role:
name: cifmw_cephadm
tasks_from: glance_s3_info

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add the following to this call

when: cifmw_cephadm_rgw_s3_glance | default(false) | bool

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can't use when: cifmw_cephadm_rgw_s3_glance | default(false) | bool when we import role .Added when: cifmw_cephadm_rgw_s3_glance | default(false) | bool at begining of glance_s3_info task

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants