Alert rule: CephPGNotDeepScrubbed

Please consider opening a PR to improve this runbook if you gain new information about causes of the alert, or how to debug or resolve the alert. Click "Edit this Page" in the top right corner to create a PR directly on GitHub.

Overview

One or more PGs haven’t been deep scrubbed recently. Deep scrub is a data integrity feature, protecting against bit-rot. It compares the contents of objects and their replicas for inconsistency. When PGs miss their deep scrub window, it may indicate that the window is too small or PGs weren’t in a 'clean' state during the deep-scrub window.

Steps for debugging

Initiate a deep scrub

$ ceph_cluster_ns=syn-rook-ceph-cluster
$ kubectl -n ${ceph_cluster_ns} exec -it deploy/rook-ceph-tools -- ceph health detail
$ kubectl -n ${ceph_cluster_ns} exec -it deploy/rook-ceph-tools -- ceph pg deep-scrub <PG_ID_FROM_ALERT>

Upstream documentation

docs.ceph.com/en/latest/rados/operations/health-checks#pg-not-deep-scrubbed