Ceph Version Upgrade, ver 2

In one of the previous articles, we addressed Ceph version upgrade. Please see here. At that time, we upgraded from 16.2.13 to 16.2.14. Upgrading a major version was one of the future steps.

Here, we will upgrade from 16.2.7 (Pacific) to 17.2.7 (Quincy). The latest version in the Pacific is 16.2.14. We follow the same steps described in the previous article.

sudo ceph health.  # make sure Ceph is in HEALTH_OK state
sudo ceph versions # check the current version
sudo ceph orch upgrade ls # query available version
# check upgrade version check
sudo ceph orch upgrade check --ceph_version 17.2.7 

sudo ceph osd set noout          # turn off some osd operations 
sudo ceph osd set noscrub.       # turn off some osd operations
sudo ceph osd set nodeep-scrub   # turn off some osd operations

sudo ceph orch upgrade start --ceph_version 17.2.7 # initiate upgrade
sudo ceph orch upgrade status    # check upgrade status

sudo ceph osd unset noout.        # turn back on
sudo ceph osd unset noscrub.      # turn back on
sudo ceph osd unset nodeep-scrub  # turn back on

The upgrade was completed in less than 20 minutes. In this cluster, all the major Ceph components are used: rbd block storage, CephFS and RGW Object storage as well as iSCSI. The total storage is 21 TiB. Out of this, 5 TiB was being used.

In the Ceph cluster, we enabled Ceph Manager Alerts module. We got 9 emails within 19 minutes. From the beginning to the end we got these messages.

HEALTH_WARN (8)

[WARN]…