Attention: Documentation
While reading about mons, I've come across two documentation issues. 1. The 2013 blog "Monitors and Paxos, a chat with Joao" has a broken link. - The broken link returns a 404 - The bad URL is http://ceph.com/dev-notes/cephs-new-monitor-changes/ - That bad URL is on line 8 at https://github.com/ceph/ceph.io/blob/main/src/en/news/blog/2013/monitors-and... - The working URL is https://ceph.io/en/news/blog/2013/cephs-new-monitor-changes/ 2. The 2013 blog "Ceph’s New Monitor Changes" has 3 broken links. - Figures 1, 2, and 3 each have URLs that return 404 - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-57-12.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-58-59.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-59-49.png - I was unable to locate any of those three png files in Ceph's Github org - It'd be great if those three png files could be found and links updated so I can continue learning about how mons work. Thanks, Joel
Thanks Joel -- adding Zac. Cheers, dan On Fri, Mar 14, 2025 at 11:08 AM Joel Davidow <jdavidow@nso.edu> wrote:
While reading about mons, I've come across two documentation issues.
1. The 2013 blog "Monitors and Paxos, a chat with Joao" has a broken link.
- The broken link returns a 404 - The bad URL is http://ceph.com/dev-notes/cephs-new-monitor-changes/ - That bad URL is on line 8 at https://github.com/ceph/ceph.io/blob/main/src/en/news/blog/2013/monitors-and... - The working URL is https://ceph.io/en/news/blog/2013/cephs-new-monitor-changes/
2. The 2013 blog "Ceph’s New Monitor Changes" has 3 broken links.
- Figures 1, 2, and 3 each have URLs that return 404 - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-57-12.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-58-59.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-59-49.png - I was unable to locate any of those three png files in Ceph's Github org - It'd be great if those three png files could be found and links updated so I can continue learning about how mons work.
Thanks, Joel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I’ll PR this over the weekend. I found the missing graphics via the Wayback Machine. A lot has changed since then, you might get fresher context from the online docs.
On Mar 14, 2025, at 5:08 PM, Dan van der Ster <dvanders@gmail.com> wrote:
Thanks Joel -- adding Zac.
Cheers, dan
On Fri, Mar 14, 2025 at 11:08 AM Joel Davidow <jdavidow@nso.edu> wrote:
While reading about mons, I've come across two documentation issues.
1. The 2013 blog "Monitors and Paxos, a chat with Joao" has a broken link.
- The broken link returns a 404 - The bad URL is http://ceph.com/dev-notes/cephs-new-monitor-changes/ - That bad URL is on line 8 at https://github.com/ceph/ceph.io/blob/main/src/en/news/blog/2013/monitors-and... - The working URL is https://ceph.io/en/news/blog/2013/cephs-new-monitor-changes/
2. The 2013 blog "Ceph’s New Monitor Changes" has 3 broken links.
- Figures 1, 2, and 3 each have URLs that return 404 - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-57-12.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-58-59.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-59-49.png - I was unable to locate any of those three png files in Ceph's Github org - It'd be great if those three png files could be found and links updated so I can continue learning about how mons work.
Thanks, Joel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
I’m on it as well. I’ll take care of it, Anthony. This arrived at 3 AM on Saturday here, so I am just now waking up and seeing it. Sent from [Proton Mail](https://proton.me/mail/home) for iOS On Sat, Mar 15, 2025 at 08:06, Anthony D'Atri <[anthony.datri@gmail.com](mailto:On Sat, Mar 15, 2025 at 08:06, Anthony D'Atri <<a href=)> wrote:
I’ll PR this over the weekend.
I found the missing graphics via the Wayback Machine.
A lot has changed since then, you might get fresher context from the online docs.
On Mar 14, 2025, at 5:08 PM, Dan van der Ster <dvanders@gmail.com> wrote:
Thanks Joel -- adding Zac.
Cheers, dan
On Fri, Mar 14, 2025 at 11:08 AM Joel Davidow <jdavidow@nso.edu> wrote:
While reading about mons, I've come across two documentation issues.
1. The 2013 blog "Monitors and Paxos, a chat with Joao" has a broken link.
- The broken link returns a 404 - The bad URL is http://ceph.com/dev-notes/cephs-new-monitor-changes/ - That bad URL is on line 8 at https://github.com/ceph/ceph.io/blob/main/src/en/news/blog/2013/monitors-and... - The working URL is https://ceph.io/en/news/blog/2013/cephs-new-monitor-changes/
2. The 2013 blog "Ceph’s New Monitor Changes" has 3 broken links.
- Figures 1, 2, and 3 each have URLs that return 404 - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-57-12.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-58-59.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-59-49.png - I was unable to locate any of those three png files in Ceph's Github org - It'd be great if those three png files could be found and links updated so I can continue learning about how mons work.
Thanks, Joel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Thanks very much! I've been reading the docs on mons and appreciate the improvements in clarity and coverage. I've come across two discrepancies between what I've observed in 18.2.4 with cephadm and the info at https://docs.ceph.com/en/reef/rados/troubleshooting/troubleshooting-mon/#und... and at https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-mon/#u... : 1) rank 0 mon is in quorum and is leader, as shown below, but the above docs state: "... Monitors with rank 0 are by definition out of quorum." 2) the commands mon stat and quorum_status are ceph commands (i.e. ceph mon stat and ceph quorum_status, as shown below) but the above docs imply that they are ceph --admin-daemon <full_path_to_asok_file> commands Should I create a pull request for those? root@burnout:~# ceph tell mon.burnout mon_status { "name": "burnout", "rank": 0, "state": "leader", "election_epoch": 21834, "quorum": [ 0, 1, 2 ], "quorum_age": 9868638, "features": { "required_con": "<XXXX>", "required_mon": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ], "quorum_con": "<XXXX>", "quorum_mon": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ] }, "outside_quorum": [], "extra_probe_peers": [], "sync_provider": [], "monmap": { "epoch": 27, "fsid": "<fsid>", "modified": "2024-09-17T18:31:19.569918Z", "created": "2021-11-15T21:52:32.502914Z", "min_mon_release": 18, "min_mon_release_name": "reef", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ], "optional": [] }, "mons": [ { "rank": 0, "name": "burnout", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 1, "name": "damian", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 2, "name": "psylocke", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "feature_map": { "mon": [ { "features": "0x3f01cfbffffdffff", "release": "reef", "num": 1 } ], "client": [ { "features": "0x3f01cfbffffdffff", "release": "reef", "num": 2 } ] }, "stretch_mode": false } root@burnout:~# ceph mon stat e27: 3 mons at {burnout=[v2:<ip>:3300/0,v1:<ip>:6789/0],damian=[v2:<ip> :3300/0,v1:<ip>:6789/0],psylocke=[v2:<ip>:3300/0,v1:<ip>:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 21834, leader 0 burnout, quorum 0,1,2 burnout,damian,psylocke root@burnout:~# ceph quorum_status | jq . { "election_epoch": 21834, "quorum": [ 0, 1, 2 ], "quorum_names": [ "burnout", "damian", "psylocke" ], "quorum_leader_name": "burnout", "quorum_age": 9869930, "features": { "quorum_con": "<XXXX>", "quorum_mon": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ] }, "monmap": { "epoch": 27, "fsid": "<fsid>", "modified": "2024-09-17T18:31:19.569918Z", "created": "2021-11-15T21:52:32.502914Z", "min_mon_release": 18, "min_mon_release_name": "reef", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ], "optional": [] }, "mons": [ { "rank": 0, "name": "burnout", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 1, "name": "damian", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 2, "name": "psylocke", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] } } On Fri, Mar 14, 2025 at 4:10 PM Zac Dover <zac.dover@proton.me> wrote:
I’m on it as well. I’ll take care of it, Anthony. This arrived at 3 AM on Saturday here, so I am just now waking up and seeing it.
Sent from Proton Mail <https://proton.me/mail/home> for iOS
On Sat, Mar 15, 2025 at 08:06, Anthony D'Atri <anthony.datri@gmail.com <On+Sat,+Mar+15,+2025+at+08:06,+Anthony+D'Atri+%3C%3Ca+href=>> wrote:
I’ll PR this over the weekend.
I found the missing graphics via the Wayback Machine.
A lot has changed since then, you might get fresher context from the online docs.
On Mar 14, 2025, at 5:08 PM, Dan van der Ster <dvanders@gmail.com> wrote:
Thanks Joel -- adding Zac.
Cheers, dan
On Fri, Mar 14, 2025 at 11:08 AM Joel Davidow <jdavidow@nso.edu> wrote:
While reading about mons, I've come across two documentation issues.
1. The 2013 blog "Monitors and Paxos, a chat with Joao" has a broken link.
- The broken link returns a 404 - The bad URL is http://ceph.com/dev-notes/cephs-new-monitor-changes/ - That bad URL is on line 8 at
https://github.com/ceph/ceph.io/blob/main/src/en/news/blog/2013/monitors-and...
- The working URL is https://ceph.io/en/news/blog/2013/cephs-new-monitor-changes/
2. The 2013 blog "Ceph’s New Monitor Changes" has 3 broken links.
- Figures 1, 2, and 3 each have URLs that return 404 - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-57-12.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-58-59.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-59-49.png - I was unable to locate any of those three png files in Ceph's Github org - It'd be great if those three png files could be found and links updated so I can continue learning about how mons work.
Thanks, Joel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
Joel, You're welcome to create a PR, but I have forwarded this to Radek and expect an answer sometime soon. After I have received an answer, I will update the documentation. Zac On Thursday, March 20th, 2025 at 8:59 AM, Joel Davidow <jdavidow@nso.edu> wrote:
Thanks very much! I've been reading the docs on mons and appreciate the improvements in clarity and coverage.
I've come across two discrepancies between what I've observed in 18.2.4 with cephadm and the info at https://docs.ceph.com/en/reef/rados/troubleshooting/troubleshooting-mon/#und... and at https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-mon/#u...:
1) rank 0 mon is in quorum and is leader, as shown below, but the above docs state: "... Monitors with rank 0 are by definition out of quorum."
2) the commands mon stat and quorum_statusare ceph commands (i.e. ceph mon stat and ceph quorum_status, as shown below) but the above docs imply that they are ceph --admin-daemon <full_path_to_asok_file>commands
Should I create a pull request for those?
root@burnout:~# ceph tell mon.burnout mon_status
{ "name": "burnout", "rank": 0, "state": "leader", "election_epoch": 21834, "quorum": [ 0, 1, 2 ], "quorum_age": 9868638, "features": { "required_con": "<XXXX>", "required_mon": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ], "quorum_con": "<XXXX>", "quorum_mon": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ] }, "outside_quorum": [], "extra_probe_peers": [], "sync_provider": [], "monmap": { "epoch": 27, "fsid": "<fsid>", "modified": "2024-09-17T18:31:19.569918Z", "created": "2021-11-15T21:52:32.502914Z", "min_mon_release": 18, "min_mon_release_name": "reef", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ], "optional": [] }, "mons": [ { "rank": 0, "name": "burnout", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 1, "name": "damian", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 2, "name": "psylocke", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] }, "feature_map": { "mon": [ { "features": "0x3f01cfbffffdffff", "release": "reef", "num": 1 } ], "client": [ { "features": "0x3f01cfbffffdffff", "release": "reef", "num": 2 } ] }, "stretch_mode": false }
root@burnout:~# ceph mon stat
e27: 3 mons at {burnout=[v2:<ip>:3300/0,v1:<ip>:6789/0],damian=[v2:<ip>:3300/0,v1:<ip>:6789/0],psylocke=[v2:<ip>:3300/0,v1:<ip>:6789/0]} removed_ranks: {} disallowed_leaders: {}, election epoch 21834, leader 0 burnout, quorum 0,1,2 burnout,damian,psylocke
root@burnout:~# ceph quorum_status | jq . { "election_epoch": 21834, "quorum": [ 0, 1, 2 ], "quorum_names": [ "burnout", "damian", "psylocke" ], "quorum_leader_name": "burnout", "quorum_age": 9869930, "features": { "quorum_con": "<XXXX>", "quorum_mon": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ] }, "monmap": { "epoch": 27, "fsid": "<fsid>", "modified": "2024-09-17T18:31:19.569918Z", "created": "2021-11-15T21:52:32.502914Z", "min_mon_release": 18, "min_mon_release_name": "reef", "election_strategy": 1, "disallowed_leaders: ": "", "stretch_mode": false, "tiebreaker_mon": "", "removed_ranks: ": "", "features": { "persistent": [ "kraken", "luminous", "mimic", "osdmap-prune", "nautilus", "octopus", "pacific", "elector-pinging", "quincy", "reef" ], "optional": [] }, "mons": [ { "rank": 0, "name": "burnout", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 1, "name": "damian", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" }, { "rank": 2, "name": "psylocke", "public_addrs": { "addrvec": [ { "type": "v2", "addr": "<ip>:3300", "nonce": <nonce> }, { "type": "v1", "addr": "<ip>:6789", "nonce": <nonce> } ] }, "addr": "<ip>:6789/0", "public_addr": "<ip>:6789/0", "priority": 0, "weight": 0, "crush_location": "{}" } ] } }
On Fri, Mar 14, 2025 at 4:10 PM Zac Dover <zac.dover@proton.me> wrote:
I’m on it as well. I’ll take care of it, Anthony. This arrived at 3 AM on Saturday here, so I am just now waking up and seeing it.
Sent from [Proton Mail](https://proton.me/mail/home) for iOS
On Sat, Mar 15, 2025 at 08:06, Anthony D'Atri <[anthony.datri@gmail.com](mailto:On+Sat,+Mar+15,+2025+at+08:06,+Anthony+D'Atri+%3C%3Ca+href=)> wrote:
I’ll PR this over the weekend.
I found the missing graphics via the Wayback Machine.
A lot has changed since then, you might get fresher context from the online docs.
On Mar 14, 2025, at 5:08 PM, Dan van der Ster <dvanders@gmail.com> wrote:
Thanks Joel -- adding Zac.
Cheers, dan
On Fri, Mar 14, 2025 at 11:08 AM Joel Davidow <jdavidow@nso.edu> wrote:
While reading about mons, I've come across two documentation issues.
1. The 2013 blog "Monitors and Paxos, a chat with Joao" has a broken link.
- The broken link returns a 404 - The bad URL is http://ceph.com/dev-notes/cephs-new-monitor-changes/ - That bad URL is on line 8 at https://github.com/ceph/ceph.io/blob/main/src/en/news/blog/2013/monitors-and... - The working URL is https://ceph.io/en/news/blog/2013/cephs-new-monitor-changes/
2. The 2013 blog "Ceph’s New Monitor Changes" has 3 broken links.
- Figures 1, 2, and 3 each have URLs that return 404 - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-57-12.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-58-59.png - http://ceph.com/wp-content/uploads/2013/03/2013-03-07_17-59-49.png - I was unable to locate any of those three png files in Ceph's Github org - It'd be great if those three png files could be found and links updated so I can continue learning about how mons work.
Thanks, Joel _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-leave@ceph.io
participants (4)
-
Anthony D'Atri
-
Dan van der Ster
-
Joel Davidow
-
Zac Dover