Hello I just added more nodes to quincy cluster(existing drives are SAS). The new nodes are sata drives. The problem is after creating a new replicated crush rule and applying to a new pool. The ceph cluster is still using osd with "hdd" class and not using sata drives. I tried a number of crush rules using replicated and EC and I cannot get the pools to use sata osds. Here is crush rule for sata: { "rule_id": 9, "rule_name": "rbdsatareplicated", "type": 1, "steps": [ { "op": "take", "item": -33, "item_name": "default~sata" }, { "op": "chooseleaf_firstn", "num": 0, "type": "host" }, { "op": "emit" } ] } I see in the crush rule "default~sata". I am wondering if this "default~" is causing me problems? Just another note. After I added the new sata nodes, my first crush rule used ec instead of replicated. I was getting errors when I tried to create a image on the ec pool "qemu-img error rbd create: Operation not supported on new pool". So I tried a test pool using replicated instead. Currently on the cluster I can create any number of pools and images if I use replicated/ec and the SAS drives which have a class of "hdd". Hope this makes sense? Here is some additional details: My existing nodes used SAS and are labelled: ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 1122.64075 root default -3 34.03793 host node-01 0 hdd 2.26920 osd.0 up 1.00000 1.00000 1 hdd 2.26920 osd.1 up 1.00000 1.00000 2 hdd 2.26920 osd.2 up 1.00000 1.00000 ..etc After adding SATA nodes I have: ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 1122.64075 root default -3 34.03793 host node-01 0 hdd 2.26920 osd.0 up 1.00000 1.00000 1 hdd 2.26920 osd.1 up 1.00000 1.00000 2 hdd 2.26920 osd.2 up 1.00000 1.00000 .... ... -34 133.78070 host node-20 141 sata 11.14839 osd.141 up 1.00000 1.00000 142 sata 11.14839 osd.142 up 1.00000 1.00000 143 sata 11.14839 osd.143 up 1.00000 1.00000 144 sata 11.14839 osd.144 up 1.00000 1.00000 145 sata 11.14839 osd.145 up 1.00000 1.00000 146 sata 11.14839 osd.146 up 1.00000 1.00000 ... Thanks jerry