[ceph-users] Re: Are there 'tuned profiles' for various ceph scenarios?

Here's an example for SCSI disks (the main benefit vs VirtIO is discard/unmap/TRIM support): <disk type='network' device='disk'> <driver name='qemu' type='raw' cache='writeback' io='threads' discard='unmap'/> <auth username='libvirt'> <secret type='ceph' uuid='3fc5de60-358e-e010-93c9-bacfc9636edf'/> </auth> <source protocol='rbd' name='yourpool/yourrbd'> <host name='yourmon1' port='6789'/> <host name='yourmon2' port='6789'/> <host name='yourmon3' port='6789'/> </source> <target dev='sda' bus='scsi'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> You also need a VirtIO-SCSI controller to use these, which will look something like: <controller type='scsi' index='0' model='virtio-scsi'> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </controller> Cheers, Simon. On 01/07/2020 20:52, Harry G. Coin wrote: > [Resent to correct title] > Marc: > > Here's a template that works here.  You'll need to do some steps to > create the 'secret' and make the block devs and so on: > > <disk type="network" device="disk"> >   <driver name="qemu" type="raw" cache="writeback"/> >   <auth username="libvirt"> >     <secret type="ceph" uuid="3fc5de60-358e-e010-93c9-bacfc9636edf"/> >   </auth> >   <source protocol="rbd" name="yournamespace/yourblockdevname" index="1"> >     <host name="yourmon1" port="6789"/> >     <host name="yourmon2" port="6789"/> >     <host name="yourmon3" port="6789"/> >     <host name="yourmon4" port="6789"/> >   </source> >   <target dev="vda" bus="virtio"/> >   <alias name="virtio-disk0"/> >   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" > function="0x0"/> > </disk> > > Glad I could contribute something.   Sure would appreciate leads for the > suggested sysctls/etc either apart or as tuned profiles. > > Harry > > On 7/1/20 2:44 PM, Marc Roos wrote: >> >> Just curious, how does the libvirt xml part look like of a 'direct >> virtio->rados link' and 'kernel-mounted rbd' >> >> >> >> >> >> -----Original Message----- >> To: ceph-users(a)ceph.io >> Subject: *****SPAM***** [ceph-users] Are there 'tuned profiles' for >> various ceph scenarios? >> >> Hi >> >> Are there any 'official' or even 'works for us' pointers to 'tuned >> profiles' for such common uses as >> >> 'ceph baremetal osd host' >> >> 'ceph osd + libvirt host' >> >> 'ceph mon/mgr' >> >> 'guest vm based on a kernel-mounted rbd' >> >> 'guest vm based on a direct virtio->rados link' >> >> I suppose there are a few other common configurations, but you get the >> idea. >> >> If you haven't used or know of 'tuned'-- it's a nice way to collect a >> great whole lot of sysctl and other low level configuration options in >> one spot. https://tuned-project.org/ >> >> Thanks >> >> Harry Coin >> >> >> >> >> _______________________________________________ >> ceph-users mailing list -- ceph-users(a)ceph.io To unsubscribe send an >> email to ceph-users-leave(a)ceph.io >> >> > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io >