- ceph-users - lists.ceph.io

Which RHEL/Fusion/CentOS/Rocky Package Contains cephfs-shell?
by duluxoz 08 Mar '24

08 Mar '24

Hi All, The subject pretty much says it all: I need to use cephfs-shell and its not installed on my Ceph Node, and I can't seem to locate which package contains it - help please. :-) Cheers Dulux-Oz

2 3

CephFS On Windows 10
by duluxoz 08 Mar '24

08 Mar '24

Hi All, I'm looking for some pointers/help as to why I can't get my Win10 PC to connect to our Ceph Cluster's CephFS Service. Details are as follows: Ceph Cluster: - IP Addresses: 192.168.1.10, 192.168.1.11, 192.168.1.12 - Each node above is a monitor & an MDS - Firewall Ports: open (ie 3300, etc) - CephFS System Name: my_cephfs - Log files: nothing jumps out at me Windows PC: - Keyring file created and findable: ceph.client.me.keyring - dokany installed - ceph-for-windows installed - Can ping all three ceph nodes - Connection command: ceph-dokan -l v -o -id me --debug --client_fs my_cephfs -c C:\ProgramData\Ceph\ceph.conf Ceph.conf contents: ~~~ [global] mon_host = 192.168.1.10, 192.168.1.11, 192.168.1.12 log to stderr = true log to syslog = true run dir = C:/ProgramData/ceph crash dir = C:/logs/ceph debug client = 2 [client] keyring = C:/ProgramData/ceph/ceph.client.me.keyring log file = C:/logs/ceph/$name.$pid.log admin socket = C:/ProgramData/ceph/$name.$pid.asok ~~~ Windows Logfile contents (ieC:/logs/ceph/client.me.NNNN.log): ~~~ 2024-02-28T18:26:45.201+1100 1 0 monclient(hunting): authenticate timed out after 300 2024-02-28T18:31:45.203+1100 1 0 monclient(hunting): authenticate timed out after 300 2024-02-28T18:36:45.205+1100 1 0 monclient(hunting): authenticate timed out after 300 ~~~ Additional info from Windows CLI: ~~~ failed to fetch mon config (--no-mon-config to skip) ~~~ So I've gone through the doco and done some Google-foo and I can't work out *why* I'm getting a failure; why I'm getting the authentication failure. I know it'll be something simple, something staring me in the face, but I'm at the point where I can't see the forest for the trees - please help. Any help greatly appreciated Thanks in advance Cheers Dulux-Oz

3 4

reef 18.2.2 (hot-fix) QE validation status
by Yuri Weinstein 08 Mar '24

08 Mar '24

Details of this release are summarized here: https://tracker.ceph.com/issues/64721#note-1 Release Notes - TBD LRC upgrade - TBD Seeking approvals/reviews for: smoke - in progress rados - Radek, Laura? quincy-x - in progress Also need approval from Travis, Redouane for Prometheus fix testing.

7 10

Ceph-storage slack access
by Matthew Vernon 08 Mar '24

08 Mar '24

Hi, How does one get an invite to the ceph-storage slack, please? Thanks, Matthew

5 10

Re: pgcalc tool removed (or moved?) from ceph.com ?
by John Zachary Dover 08 Mar '24

08 Mar '24

PGcalc has been restored to docs.ceph.com in this PR: https://github.com/ceph/ceph/pull/56045 PGcalc can be accessed here: https://docs.ceph.com/en/reef/rados/operations/pgcalc/ Zac Dover Upstream Docs Ceph Foundation On Thu, Aug 26, 2021 at 9:56 AM Mike Perez <miperez(a)redhat.com> wrote: > Hi all, > > I attempted to migrate this to the new website, but it's going to > require some CSS work. I'm not the best with CSS, and the old website > has a very large CSS file to dissect from. I'll see what I can come up > with tomorrow. > > https://github.com/ceph/ceph.io/issues/265 > > On Thu, Jul 8, 2021 at 12:33 AM Christian Rohmann > <christian.rohmann(a)inovex.de> wrote: > > > > Hey Dominik, > > > > On 05/07/2021 09:55, Dominik Csapak wrote: > > > Hi, > > > > > > just wanted to ask if it is intentional that > > > > > > http://ceph.com/pgcalc/ > > > > > > results in a 404 error? > > > > > > is there any alternative url? > > > it is still linked from the offical docs. > > > > It's available at https://ceph.com/pgcalc/ just now (with cert not > > matching), but there apparently are people working on migrating the > > whole website .... > > > > * ceph.com redirects to https://old.ceph.com/ with matching Let's > > Encrypt certificate > > * but https://ceph.com/pgcalc/ is not rewritten to the old.ceph.com > > domain and thus the certificate error because the cert is only valid vor > > old.ceph.com > > > > > > Regards > > > > Christian > > > > _______________________________________________ > > ceph-users mailing list -- ceph-users(a)ceph.io > > To unsubscribe send an email to ceph-users-leave(a)ceph.io > > > > > -- > Mike Perez > > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io >

1 0

Re: Journal size recommendations
by Christian Rohmann 08 Mar '24

08 Mar '24

On 01.03.22 19:57, Eugen Block wrote: > can you be more specific what exactly you are looking for? Are you > talking about the rocksDB size? And what is the unit for 5012? It’s > really not clear to me what you’re asking. And since the > recommendations vary between different use cases you might want to > share more details about your use case. FWIW, I suppose OP was asking about this setting: https://docs.ceph.com/en/latest/rados/configuration/osd-config-ref/#confval… And reading https://docs.ceph.com/en/latest/rados/configuration/osd-config-ref/#journal… states "This section applies only to the older Filestore OSD back end. Since Luminous BlueStore has been default and preferred." It's totally obsolete with bluestore. Regards Christian

1 0

rgw dynamic bucket sharding will hang io
by nuabo tan 08 Mar '24

08 Mar '24

When reshard occurs, io will be blocked, why has this serious problem not been solved?

2 2

Upgarde from 16.2.1 to 16.2.2 pacific stuck
by Edouard FAZENDA 08 Mar '24

08 Mar '24

Dear Ceph Community, I am in the process of upgrading ceph pacific 16.2.1 to 16.2.2 , I have followed the documentation : https://docs.ceph.com/en/pacific/cephadm/upgrade/ My cluster is in Healthy state , but the upgrade is not going forward , as on the cephadm logs I have the following : # Ceph -W cephadm 2024-03-06T08:39:11.653447+0000 mgr.rke-sh1-1.qskoyj [INF] Upgrade: Need to upgrade myself (mgr.rke-sh1-1.qskoyj) 2024-03-06T08:39:12.281386+0000 mgr.rke-sh1-1.qskoyj [INF] Upgrade: Updating mgr.rke-sh1-2.lxmguj 2024-03-06T08:39:12.286096+0000 mgr.rke-sh1-1.qskoyj [INF] Deploying daemon mgr.rke-sh1-2.lxmguj on rke-sh1-2 2024-03-06T08:39:19.347877+0000 mgr.rke-sh1-1.qskoyj [INF] Filtered out host rke-sh1-1: could not verify host allowed virtual ips 2024-03-06T08:39:19.347989+0000 mgr.rke-sh1-1.qskoyj [INF] Filtered out host rke-sh1-3: could not verify host allowed virtual ips 2024-03-06T08:39:19.366355+0000 mgr.rke-sh1-1.qskoyj [INF] Upgrade: Need to upgrade myself (mgr.rke-sh1-1.qskoyj) 2024-03-06T08:39:19.965822+0000 mgr.rke-sh1-1.qskoyj [INF] Upgrade: Updating mgr.rke-sh1-2.lxmguj 2024-03-06T08:39:19.969089+0000 mgr.rke-sh1-1.qskoyj [INF] Deploying daemon mgr.rke-sh1-2.lxmguj on rke-sh1-2 2024-03-06T08:39:26.961455+0000 mgr.rke-sh1-1.qskoyj [INF] Filtered out host rke-sh1-1: could not verify host allowed virtual ips 2024-03-06T08:39:26.961502+0000 mgr.rke-sh1-1.qskoyj [INF] Filtered out host rke-sh1-3: could not verify host allowed virtual ips 2024-03-06T08:39:26.973897+0000 mgr.rke-sh1-1.qskoyj [INF] Upgrade: Need to upgrade myself (mgr.rke-sh1-1.qskoyj) 2024-03-06T08:39:27.623773+0000 mgr.rke-sh1-1.qskoyj [INF] Upgrade: Updating mgr.rke-sh1-2.lxmguj 2024-03-06T08:39:27.628115+0000 mgr.rke-sh1-1.qskoyj [INF] Deploying daemon mgr.rke-sh1-2.lxmguj on rke-sh1-2 My public_network is set : root@rke-sh1-1:~# ceph config dump | grep public_network mon advanced public_network 10.10.71.0/24 * Do you have an idea why I have the following error : Filtered out host: could not verify host allowed virtual ips Current state of the upgrade : # ceph orch upgrade status { "target_image": "docker.io/ceph/ceph@sha256:8cdd8c7dfc7be5865255f0d59c048a1fb8d1335f6923996e 2c2d9439499b5cf2", "in_progress": true, "services_complete": [], "progress": "0/35 ceph daemons upgraded", "message": "Currently upgrading mgr daemons" } progress: Upgrade to 16.2.2 (24m) [............................] Thanks for the help. Best Regards, Edouard FAZENDA Technical Support Chemin du Curé-Desclouds 2, CH-1226 THONEX +41 (0)22 869 04 40 <https://www.csti.ch/> www.csti.ch

3 7

All MGR loop crash
by David C. 08 Mar '24

08 Mar '24

Hello everybody, I'm encountering strange behavior on an infrastructure (it's pre-production but it's very ugly). After a "drain" on monitor (and a manager). MGRs all crash on startup: Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgr ms_dispatch2 standby mgrmap(e 1310) v1 Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgr handle_mgr_map received map epoch 1310 Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgr handle_mgr_map active in map: 1 active is 99148504 Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgr handle_mgr_map Activating! Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgr handle_mgr_map I am now activating Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgr ms_dispatch2 mgrmap(e 1310) v1 Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgrc handle_mgr_map Got map version 1310 Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgrc handle_mgr_map Active mgr is now Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgrc reconnect No active mgr available yet Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: mgr init waiting for OSDMap... Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: monclient: _renew_subs Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: monclient: _send_mon_message to mon.idf-pprod-osd3 at v2:X.X.X.X:3300/0 <http://10.191.10.3:3300/0> Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: monclient: _reopen_session rank -1 Mar 07 17:06:47 pprod-mon1 ceph-mgr[564045]: *** Caught signal (Aborted) ** in thread 7f9a07a27640 thread_name:mgr-fin ceph version 17.2.6-170.el9cp (59bbeb8815ec3aeb3c8bba1e1866f8f6729eb840) quincy (stable) 1: /lib64/libc.so.6(+0x54db0) [0x7f9a2364ddb0] 2: /lib64/libc.so.6(+0xa154c) [0x7f9a2369a54c] 3: raise() 4: abort() 5: /usr/lib64/ceph/libceph-common.so.2(+0x1c1fa8) [0x7f9a23ce2fa8] 6: /usr/lib64/ceph/libceph-common.so.2(+0x444425) [0x7f9a23f65425] 7: /usr/lib64/ceph/libceph-common.so.2(+0x4442e0) [0x7f9a23f652e0] 8: /usr/lib64/ceph/libceph-common.so.2(+0x4442e0) [0x7f9a23f652e0] 9: (MonClient::_add_conns()+0x242) [0x7f9a23f5fa42] 10: (MonClient::_reopen_session(int)+0x428) [0x7f9a23f60518] 11: (Mgr::init()+0x384) [0x5604667a6434] 12: /usr/bin/ceph-mgr(+0x1af271) [0x5604667ae271] 13: /usr/bin/ceph-mgr(+0x11364d) [0x56046671264d] 14: (Finisher::finisher_thread_entry()+0x175) [0x7f9a23d10645] 15: /lib64/libc.so.6(+0x9f802) [0x7f9a23698802] 16: /lib64/libc.so.6(+0x3f450) [0x7f9a23638450] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. I have the impression that the MGRs are ejected by the monitors, however after debugging monitor, I don't see anything abnormal on the monitor side (if I haven't missed something). All we can see is that we get an exception on the "_add_conn" method ( https://github.com/ceph/ceph/blob/v17.2.6/src/mon/MonClient.cc #L775) Version : 17.2.6-170.el9cp (RHCS6)

3 6

Announcing Ceph Day NYC 2024 - April 26th!
by Dan van der Ster 08 Mar '24

08 Mar '24

Hi everyone, Ceph Days are coming to New York City again this year, co-hosted by Bloomberg Engineering and Clyso! We're planning a full day of Ceph content, well timed to learn about the latest and greatest Squid release. https://ceph.io/en/community/events/2024/ceph-days-nyc/ We're opening the CFP for presenters today -- it will close on March 26th so please get your proposals in quickly! Registration is also open now and space is limited, so book now to reserve your seat! Looking forward to seeing you there! -- dan

2 1