Just a heads up to Ceph users, there is currently a data corruption bug in EC pools if you have set allow_ec_overwrites to true on the pool.
Thanks to https://github.com/insanemal for bringing this to my attention.
You can follow along with the upstream bug tracker here: https://tracker.ceph.com/issues/70390
or this package's issue here: https://github.com/bazaah/aur-ceph/issues/34
To address any new corruption you can...
- Ensure that
ceph config get osd bluestore_elastic_shared_blobsis false (default is true)
or
- Verify that no EC pool has
allow_ec_overwritesset to true (default is false)
Changing either of these will not affect current data corruption, and so far the only known fix is to redeploy the OSD after making of the above changes
Pinned Comments
pbazaah commented on 2022-10-05 13:03 (UTC) (edited on 2022-10-05 13:03 (UTC) by pbazaah)
For future commenters:
TLDR:
https://aur.archlinux.org/pkgbase/ceph | From source build (slow)
https://aur.archlinux.org/pkgbase/ceph-bin | Pre-built binaries (fast)
Unlike the original community version, this repo builds ceph from source. Ceph is a large, complicated project so this takes several hours on a good build server.
To get a similar experience to how community/ceph worked (pre-built binaries) use ceph-bin instead.