shutdown phys servers during holiday season for energy consumption

[DanielFroehlich]

Drain and Poweroff:

• storm2
• storm3
• storm6
• ucs56
• ucs57

Power on again:

• storm2
• storm3
• storm6
• ucs56
• ucs57

[rbo]

Temp. Power on all Machines to cleanup all alerts.

[rbo]

Check power state

ansible-navigator run ./baremetal-mgmt/check-powerstate-off.yaml -l storm2-mgmt,storm3-mgmt,storm6-mgmt,ucs56-mgmt,ucs57-mgmt  --vault-password-file=.vault_pass
[WARNING]: Invalid characters were found in group names but not replaced, use
-vvvv to see details

PLAY [BaerMetal Server] ********************************************************

TASK [Check PowerState] ********************************************************
Tuesday 23 December 2025  10:32:51 +0000 (0:00:00.139)       0:00:00.139 ******
changed: [ucs57-mgmt]
changed: [storm6-mgmt]
changed: [storm3-mgmt]
changed: [ucs56-mgmt]
changed: [storm2-mgmt]

TASK [Transform JSON to YAML] **************************************************
Tuesday 23 December 2025  10:33:02 +0000 (0:00:11.066)       0:00:11.205 ******
ok: [ucs56-mgmt]
ok: [ucs57-mgmt]
ok: [storm2-mgmt]
ok: [storm3-mgmt]
ok: [storm6-mgmt]

TASK [PowerState] **************************************************************
Tuesday 23 December 2025  10:33:03 +0000 (0:00:00.172)       0:00:11.378 ******
fatal: [ucs56-mgmt]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'PowerState'. 'dict object' has no attribute 'PowerState'\n\nThe error appears to be in '/Volumes/Development/github.com/stormshift/automation/baremetal-mgmt/check-powerstate-off.yaml': line 22, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n    - name: PowerState\n      ^ here\n"}
fatal: [ucs57-mgmt]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'PowerState'. 'dict object' has no attribute 'PowerState'\n\nThe error appears to be in '/Volumes/Development/github.com/stormshift/automation/baremetal-mgmt/check-powerstate-off.yaml': line 22, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n    - name: PowerState\n      ^ here\n"}
ok: [storm2-mgmt] => {
    "msg": "PowerState of 10.32.104.91 is Off"
}
ok: [storm3-mgmt] => {
    "msg": "PowerState of 10.32.104.92 is Off"
}
ok: [storm6-mgmt] => {
    "msg": "PowerState of 10.32.104.72 is Off"
}

TASK [Check PowerState] ********************************************************
Tuesday 23 December 2025  10:33:03 +0000 (0:00:00.130)       0:00:11.509 ******
skipping: [storm2-mgmt]
skipping: [storm3-mgmt]
skipping: [storm6-mgmt]

PLAY RECAP *********************************************************************
storm2-mgmt                : ok=3    changed=1    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
storm3-mgmt                : ok=3    changed=1    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
storm6-mgmt                : ok=3    changed=1    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
ucs56-mgmt                 : ok=2    changed=1    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
ucs57-mgmt                 : ok=2    changed=1    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
Tuesday 23 December 2025  10:33:03 +0000 (0:00:00.180)       0:00:11.689 ******
===============================================================================
Check PowerState ------------------------------------------------------- 11.07s
Check PowerState -------------------------------------------------------- 0.18s
Transform JSON to YAML -------------------------------------------------- 0.17s
PowerState -------------------------------------------------------------- 0.13s
Please review the log for errors.

[rbo]

Power ON

ansible-navigator run ./baremetal-mgmt/power-on.yaml -l storm2-mgmt,storm3-mgmt,storm6-mgmt,ucs56-mgmt,ucs57-mgmt  --vault-password-file=.vault_pass
[WARNING]: Invalid characters were found in group names but not replaced, use
-vvvv to see details

PLAY [BaerMetal Server] ********************************************************

TASK [Power On] ****************************************************************
Tuesday 23 December 2025  10:33:38 +0000 (0:00:00.194)       0:00:00.194 ******
changed: [storm6-mgmt]
changed: [storm3-mgmt]
changed: [ucs56-mgmt]
changed: [ucs57-mgmt]
changed: [storm2-mgmt]

PLAY RECAP *********************************************************************
storm2-mgmt                : ok=1    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
storm3-mgmt                : ok=1    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
storm6-mgmt                : ok=1    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
ucs56-mgmt                 : ok=1    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
ucs57-mgmt                 : ok=1    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
Tuesday 23 December 2025  10:34:22 +0000 (0:00:44.335)       0:00:44.530 ******
===============================================================================
Power On --------------------------------------------------------------- 44.34s

[rbo]

oc get nodes
NAME     STATUS                     ROLES                  AGE     VERSION
ceph10   Ready                      storage-node,worker    143d    v1.33.6
ceph11   Ready                      storage-node,worker    508d    v1.33.6
ceph12   Ready                      storage-node,worker    508d    v1.33.6
inf4     Ready                      control-plane,master   2y39d   v1.33.6
inf5     Ready                      control-plane,master   2y39d   v1.33.6
inf6     Ready                      control-plane,master   2y39d   v1.33.6
storm2   Ready,SchedulingDisabled   virt-node,worker       209d    v1.33.6
storm3   Ready,SchedulingDisabled   virt-node,worker       209d    v1.33.6
storm5   Ready                      virt-node,worker       209d    v1.33.6
storm6   Ready,SchedulingDisabled   virt-node,worker       209d    v1.33.6
ucs55    Ready                      virt-node,worker       102d    v1.33.6
ucs56    Ready,SchedulingDisabled   virt-node,worker       102d    v1.33.6
ucs57    Ready,SchedulingDisabled   virt-node,worker       102d    v1.33.6