Member-only story
Ceph Network Change
This article describes my journey of changing Ceph network and necessary components along the way.
The starting point is the cluster that we set up in Ceph Cluster Deploy article. The cluster has one monitor node and two OSD nodes with one OSD disk in each node. Nodes has one network and consequently the Ceph cluster has only public network.
- Monitor node: 172.25.65.17
- OSD nodes: 172.25.65.18 and 172.25.65.19
To check the list of hosts, use the command below.
sudo ceph orch host lsJourney for changing the network
Requirement
Before we switch a Ceph network, there are two requirements: a new network and (at least) three monitor nodes. Let’s say that we want to change the Ceph network from 172.25.0.0/17 to 172.29.0.0/17.
First we set up a new network on each node. Then we will add two more monitors to the cluster. The steps for this is described in Ceph: Adding/Removing monitors article.
When these two new monitors are added, we will use ip addresses in the new subnet: 172.29.65.20 and 172.29.65.21. Now, we have three monitors: 172.25.65.17, 172.29.65.20 and 172.29.65.21. Then, we will remove the original monitor (172.25.65.17) and add it back into the cluster with a new ip address (172.25.65.19).
While adding/removing monitors, the ceph configuration file (/etc/ceph/ceph.conf) on the bootstrap…
