What performance numbers are you seeing on pods with Ceph PVs? e.g., what does `rados bench` give?
Complete results are here: https://gist.github.com/MathiasPius/cda8ae32ebab031deb054054...
I'm definitely curious to find out though, so I'll run some tests and get back to you!