croit.io(?) have some solution for booting from the network. They are very active here, you will undoubtedly hear from them ;)
-----Original Message----- Sent: 16 March 2021 18:37 To: ceph-users@ceph.io Subject: *****SPAM***** [ceph-users] Diskless boot for Ceph nodes
Hey folks - thought I'd check and see if anyone has ever tried to use ephemeral (tmpfs / ramfs based) boot disks for Ceph nodes?
On 3/16/21 6:37 PM, Stephen Smith6 wrote:
Hey folks - thought I'd check and see if anyone has ever tried to use ephemeral (tmpfs / ramfs based) boot disks for Ceph nodes?
croit.io does that quite succesfully I believe [1]. Gr. Stefan [1]: https://www.croit.io/software/features
On 2021-03-16 22:06, Stefan Kooman wrote:
On 3/16/21 6:37 PM, Stephen Smith6 wrote:
Hey folks - thought I'd check and see if anyone has ever tried to use ephemeral (tmpfs / ramfs based) boot disks for Ceph nodes?
croit.io does that quite succesfully I believe [1].
Same here at ungleich, all our ceph nodes with the exception of the monitors are PXE booted. And as a matter of fact, 90% of them even netboot via IPv6 only using ipxe. From an operational point of view I believe there is not much difference to a regular setup, besides you'll need to have a trigger in place to configure the servers when rebooting, as the boot image itself is rather empty in our case. Best regards, Nico -- Renewable hosting with full IPv6 support. Checkout www.datacenterlight.ch for details.
On 3/17/21 12:34 AM, Nico Schottelius wrote:
On 2021-03-16 22:06, Stefan Kooman wrote:
On 3/16/21 6:37 PM, Stephen Smith6 wrote:
Hey folks - thought I'd check and see if anyone has ever tried to use ephemeral (tmpfs / ramfs based) boot disks for Ceph nodes?
croit.io does that quite succesfully I believe [1].
Same here at ungleich, all our ceph nodes with the exception of the monitors are PXE booted. And as a matter of fact, 90% of them even netboot via IPv6 only using ipxe.
Nice, all our Ceph server are 100% installed through iPXE over IPv6, but not (i)PXE booted. Modern BIOSes (UEFI) might allow for directly booting from http(s) (also possible with iPXE). Especially Tianocore (EDK2) for arm64 allows you to do that. Then you just need a webserver where you can apply logic what image should be downloaded by a client. And indeed a mechanism to get a ceph.conf on your hosts, or use DNS magic to accomplish that [1]. Do take in mind that the less state there is on the Ceph hosts themselves, the more you rely on external systems to properly boot / configure your cluster. Carefully think about chicken / egg problems when (certain) parts of that infrastructure are unavailable. Gr. Stefan [1]: https://docs.ceph.com/en/latest/rados/configuration/mon-lookup-dns/
Hello, that's right, you can test our croit.io software for free or watch how it works in a recording of a webinar https://youtu.be/uMNxOIP1kHI?t=752 From our point of view, booting systems using PXE provides at least the same benefits as containers on a system but with much stronger integration. For example, we not only have debian10 buster images, but also suse15.2 leap that we can boot up anytime. You can even do that in the same cluster without a problem or migrate at any time between different operating systems. It makes you independent as well as flexible. If you break your OS, you simply press the reboot button and get a nice fresh and clean OS booted in your memory. Besides that, It is easy to maintain, solid, and all your hosts run on exactly the same software and configuration state (kernel, libs, Ceph, everything). -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.verges@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://goo.gl/PGE1Bx Am Di., 16. März 2021 um 22:07 Uhr schrieb Stefan Kooman <stefan@bit.nl>:
On 3/16/21 6:37 PM, Stephen Smith6 wrote:
Hey folks - thought I'd check and see if anyone has ever tried to use ephemeral (tmpfs / ramfs based) boot disks for Ceph nodes?
croit.io does that quite succesfully I believe [1].
Gr. Stefan
[1]: https://www.croit.io/software/features _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Hello, we implemented this as part of a customer project for Immutable Infrastructure. Regards, Joachim ___________________________________ Clyso GmbH - Ceph Foundation Member support@clyso.com https://www.clyso.com Am 16.03.2021 um 18:37 schrieb Stephen Smith6:
Hey folks - thought I'd check and see if anyone has ever tried to use ephemeral (tmpfs / ramfs based) boot disks for Ceph nodes?
_______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (6)
-
Clyso GmbH - Ceph Foundation Member
-
Marc
-
Martin Verges
-
Nico Schottelius
-
Stefan Kooman
-
Stephen Smith6