On Fri, May 29, 2020 at 11:38 AM Palanisamy <palaniecestar@gmail.com> wrote:

Hello Team,

Can I get any update on this request.

The Ceph team is not really involved in the out-of-tree rbd-provisioner. Both the in-tree and this out-of-tree RBD provisioner are deprecated to the ceph-csi [1][2] RBD provisioner. The ceph-csi provisioner also creates RBD images using UUIDs since that's what k8s provides to the driver (it never provides the namespace / PVC name). The difference is that ceph-csi provides a tool to map the image names [3] back to the PVC/PV in k8s -- and additional work is underway to expose this mapping via an endpoint like Prometheus so that the mappings are available all the time (even for third-party apps).

*Best Regards,* *Palanisamy*

On Fri, Nov 22, 2019 at 1:53 PM Palanisamy <palaniecestar@gmail.com> wrote:

...

Hello Team,

We've integrated Ceph cluster storage with Kubernetes and provisioning volumes through rbd-provisioner. When we're creating volumes from yaml files in Kubernetes, pv > pvc > mounting to pod, In kubernetes end pvc are showing as meaningful naming convention as per yaml file defined. But in ceph cluster, rbd image name is creating with dynamic uid.

During troubleshooting time, this will be tedious to find exact rbd image. Please find the provisioning logs in below pasted snippet.

kubectl get pods,pv,pvc NAME READY STATUS RESTARTS AGE pod/sleepypod 1/1 Running 0 4m9s

NAME CAPACITY ACCESS MODES RECLAIM POLICY STATUS CLAIM STORAGECLASS REASON AGE persistentvolume/pvc-cd37d2d6-cecc-4a05-9736-c8d80abde7f5 1Gi RWO Delete Bound default/test-dyn-pvc ceph-rbd 4m9s

NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE persistentvolumeclaim/test-dyn-pvc Bound pvc-cd37d2d6-cecc-4a05-9736-c8d80abde7f5 1Gi RWO ceph-rbd 4m11s

*rbd-provisioner logs*

I1121 10:59:15.009012 1 provision.go:132] successfully created rbd image "kubernetes-dynamic-pvc-f4eac482-0c4d-11ea-8d70-8a582e0eb4e2" I1121 10:59:15.009092 1 controller.go:1087] provision "default/test-dyn-pvc" class "ceph-rbd": volume "pvc-cd37d2d6-cecc-4a05-9736-c8d80abde7f5" provisioned I1121 10:59:15.009138 1 controller.go:1101] provision "default/test-dyn-pvc" class "ceph-rbd": trying to save persistentvvolume "pvc-cd37d2d6-cecc-4a05-9736-c8d80abde7f5" I1121 10:59:15.020418 1 controller.go:1108] provision "default/test-dyn-pvc" class "ceph-rbd": persistentvolume "pvc-cd37d2d6-cecc-4a05-9736-c8d80abde7f5" saved I1121 10:59:15.020476 1 controller.go:1149] provision "default/test-dyn-pvc" class "ceph-rbd": succeeded I1121 10:59:15.020802 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"test-dyn-pvc", UID:"cd37d2d6-cecc-4a05-9736-c8d80abde7f5", APIVersion:"v1", ResourceVersion:"24545639", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-cd37d2d6-cecc-4a05-9736-c8d80abde7f5

*rbd image details in Ceph cluster end*

rbd -p kube ls --long NAME SIZE PARENT FMT PROT LOCK kubernetes-dynamic-pvc-f4eac482-0c4d-11ea-8d70-8a582e0eb4e2 1 GiB 2

is there way to setup proper naming convention for rbd image as well during kubernetes deployment itself.

Kubernetes version: v1.15.5 Ceph cluster version: 14.2.2 nautilus (stable) *Best Regards,* *Palanisamy*

_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io

[1] https://github.com/ceph/ceph-csi [2] https://docs.ceph.com/docs/master/rbd/rbd-kubernetes/ [3] https://github.com/ceph/ceph-csi/blob/master/troubleshooting/tools/tracevol.... -- Jason