Ceph deployment & configurations

Beyond basic operations on Ceph

These articles describe various deployments, configuration and advanced use cases. We assume that the readers are familiar with Ceph basic operations and concepts. If not, we recommend to read some articles in this list first.

Deployments

• Deployment of Multi-Monitor Ceph: Ceph (version: Quincy) cluster deployment with three monitor nodes on Ubuntu 22.04 using host labels and explaining what _admin label does.
• Ceph Version Upgrade: how to upgrade/downgrade Ceph cluster to a specific version.
• Ceph Version Upgrade, ver 2: an experience report for upgrading from 16.2.7 (Pacific) to 17.2.7 (Quincy)
• Ceph Deployment with Podman: Ceph (version: Quincy) cluster using Podman on Ubuntu 22.04
• Ceph Air-gapped Deployment: Ceph cluster deployment in an air-gapped environment
• Ceph Version Upgrade: Air-gapped Environment: how to upgrade a Ceph cluster in an air-gapped environment
• On Installing Ceph-common Package: how to install ceph-common packages from the Ceph repo

Configurations

• Classifying Ceph OSD disks: OSD disks are selectively used for pools using device classes and crush rules.
• Ceph Object Storage with https: how to set up a https access for RGW service and how to generate a private key and a certificate.
• Erasure Encoded Pools: how to create erasure encoded pools in Ceph clusters
• Kubernetes Provisioner Setup for Ceph RBD and CephFS: how to use an external Ceph cluster in Kubernetes as block- and file-based PV storages without Ceph admin credentials.
• Going deeper on Ceph-Based Storage Classes: how persistent volumes by rook-ceph provisioners appears in a Ceph cluster and how to tweak configuration to better manage them.
• Going Deeper: Rook-Ceph Object StorageClass: how rook-ceph object storageclass works behind the scenes.
• Ceph iSCSI Interface: how to set up iSCSI gateways, targets, hosts, and disks as well as how to configure an iSCSI client with multi-path.
• Customized Ceph RGW configuration: how to set up a Ceph RGW service with erasure encode pools.
• Ingress for Ceph RGW service: how to set up an ingress service for RGW service
• On Ceph Memory Management: how ceph get memory usage for its ps command and how memory limits for mon and osd daemon are set.

Performance Benchmarks

• Ceph Benchmark Tools, Part I: how to use rados bench utility to measure Ceph performance (bandwidth, IOPS and latency).
• Ceph Benchmark Tools, Part II: how to use rbd bench utility to measure io performance of rbd block images.
• Ceph Benchmark Tools, Part III: how to use fio (Flexible I/O Tester) on filesystem provided by Ceph RBD and CephFS.
• Ceph Benchmark Tools, Part 4: how to use iperf for network bandwidth measurement

Monitoring & Alerting

• Ceph Alert Email Setup: how to set up Ceph Alert Email using Gmail SMTP server.
• Ceph Grafana: how to configure Ceph grafana access and enable a centralized logging with Loki and Promtail. A simple Loki dashboard is provided as well.