- ceph-users - lists.ceph.io

Re: help me enable ceph iscsi gatewaty in ceph octopus
by Sebastian Wagner 06 Aug '20

06 Aug '20

hi David, hi Ricardo, I think we first have to clarify, if that was actually a cephadm deployment (and not ceph-ansible). If you install Ceph using ceph-ansible, then please refer to the ceph-ansible docs. If we're actually talking about cephadm here (which is not clear to me): iSCSI for cephadm will land in the next octopus release and at that point we can add a proper documentation. Hope that helps, Sebastian Am 05.08.20 um 11:11 schrieb Ricardo Marques: > Hi David, > > I was able to configure iSCSI gateways on my local test environment using the following spec: > > ``` > # tail -14 service_spec_gw.yml > --- > service_type: iscsi > service_id: iscsi_service > placement: > hosts: > - 'node1' > - 'node2' > spec: > pool: rbd > trusted_ip_list: 10.20.94.201,10.20.94.202,10.20.94.203 > api_port: 5000 > api_user: admin1 > api_password: admin2 > api_secure: False > > # ceph orch apply -i service_spec_gw.yml > ``` > > You can use this spec as a starting point, but note that the pool must exist (in this case `rbd` pool), and you will need to adapt `hosts`, `trusted_ip_list`, etc... > > You may also want to change `api_secure` to `True` and set `ssl_cert` and `ssh_key` accordingly. > > Unfortunately, iSCSI deployment is not included in the documentation yet (coming soon). > > [1] https://docs.ceph.com/docs/octopus/cephadm/install/ > > > Ricardo Marques > > ________________________________ > From: David Thuong <davidthuong2424(a)gmail.com> > Sent: Wednesday, August 5, 2020 5:16 AM > To: ceph-users(a)ceph.io <ceph-users(a)ceph.io> > Subject: [ceph-users] help me enable ceph iscsi gatewaty in ceph octopus > > Please help me enable ceph iscsi gatewaty in ceph octopus . when i install ceph complete . i see iscsi gateway not enable. please help me config it > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io > > _______________________________________________ > ceph-users mailing list -- ceph-users(a)ceph.io > To unsubscribe send an email to ceph-users-leave(a)ceph.io > -- SUSE Software Solutions Germany GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany (HRB 36809, AG Nürnberg). Geschäftsführer: Felix Imendörffer

4 5

Many scrub errors after update to 14.2.10
by Andreas Haupt 06 Aug '20

06 Aug '20

Hi *, after updating our CEPH cluster from 14.2.9 to 14.2.10 it accumulates scrub errors on multiple osds: [cephmon1] /root # ceph health detail HEALTH_ERR 6 scrub errors; Possible data damage: 6 pgs inconsistent OSD_SCRUB_ERRORS 6 scrub errors PG_DAMAGED Possible data damage: 6 pgs inconsistent pg 3.69 is active+clean+inconsistent, acting [59,65,61] pg 3.73 is active+clean+inconsistent, acting [73,88,25] pg 12.29 is active+clean+inconsistent, acting [55,92,42] pg 12.38 is active+clean+inconsistent, acting [150,42,13] pg 12.46 is active+clean+inconsistent, acting [55,18,84] pg 12.75 is active+clean+inconsistent, acting [55,155,49] They all can easily get repaired (ceph pg repair $pg) - but I wonder what could be the source of the problem. The cluster started with Luminous some years ago, was updated to Mimic, then Nautilus. Never seen this before! OSDs are a mixture of HDD/SSD, both are affected. All on Bluestore. Any idea? Was there maybe a code change between 14.2.9 & 14.2.10 that could explain this? Errors in syslog look like this: Aug 5 19:21:21 krake08 ceph-osd: 2020-08-05 19:21:21.831 7fb6b2b9d700 -1 log_channel(cluster) log [ERR] : 12.38 scrub : stat mismatch, got 74/74 objects, 20/20 clones, 74/74 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 182904850/172877842 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes. Aug 5 19:21:21 krake08 ceph-osd: 2020-08-05 19:21:21.831 7fb6b2b9d700 -1 log_channel(cluster) log [ERR] : 12.38 scrub 1 errors Aug 6 08:28:44 krake08 ceph-osd: 2020-08-06 08:28:44.477 7fb6b2b9d700 -1 log_channel(cluster) log [ERR] : 12.38 repair : stat mismatch, got 76/76 objects, 22/22 clones, 76/76 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 183166994/173139986 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes. Aug 6 08:28:44 krake08 ceph-osd: 2020-08-06 08:28:44.477 7fb6b2b9d700 -1 log_channel(cluster) log [ERR] : 12.38 repair 1 errors, 1 fixed Thanks in advance, Andreas -- | Andreas Haupt | E-Mail: andreas.haupt(a)desy.de | DESY Zeuthen | WWW: http://www-zeuthen.desy.de/~ahaupt | Platanenallee 6 | Phone: +49/33762/7-7359 | D-15738 Zeuthen | Fax: +49/33762/7-7216

1 0

Get Cash App Customer Service to ask to for what reason is my cash not appearing?
by mary smith 06 Aug '20

06 Aug '20

In the event that you are not seeing your cash into your Cash app balance, at that point you have to guarantee that, is there any telephone number or email address that is related to you. Now and again, it happens cash goes to another telephone number or email address which is lined up with you. In the event that you get any issue here, at that point go to converse with Cash App Customer Service. https://www.customercare-email.com/customer-service/cash-app.html

1 0

Does Cash App Customer Service request for SSN?
by mary smith 06 Aug '20

06 Aug '20

Indeed, Cash App Customer Service requests your SSN to check your identity. It is fundamentally requested any government hostile to illegal tax avoidance and against tax avoidance. Here is a law, that makes it important to give your SSN. You don't have a need to enter your full SSN, enter just last four digits of it. Having such kind of warning permits them to affirm your identity, and by which they can easily catch dubious action. https://www.cash-app-customer-service.com/

1 0

Ceph influxDB support versus Telegraf Ceph plugin?
by victorhooi＠yahoo.com 06 Aug '20

06 Aug '20

Hi, I've read that Ceph has some InfluxDB reporting capabilities inbuilt (https://docs.ceph.com/docs/master/mgr/influx/) However, Telegraf, which is the system reporting daemon for InfluxDB, also has a Ceph plugin (https://github.com/influxdata/telegraf/tree/master/plugins/inputs/ceph) Just curious what people's thoughts on the two are, or what they are using in production? Which is easier to deploy/maintain, have you found? Or more useful for alerting, or tracking performance gremlins? Thanks, Victor

2 2

made a huge mistake, seeking recovery advice (osd zapped)
by Peter Sarossy 06 Aug '20

06 Aug '20

hey folks, I was deploying a new set of NVMe cards into my cluster, and while getting the new devices ready, it seems the device names got mixed up, and I managed to to run "sgdisk --zap-all" and "dd if=/dev/zero of="/dev/sd" bs=1M count=100" on some of the active devices. I was adding new cards so I could migrate off the 2k+2m erasure coded setup to a more redundant config, but in my mess up I ran the commands above on 3 of the 4 devices before the ceph status changed and I noticed the mistake. I managed to restore the LVM partition table from backup but it seems to not be enough to restart the OSD... I just need to recover one of the 3 drives to save all of my VM+Docker backing filesystem. I'm running on Kubernetes with Rook, after restoring the partition table it seems to be starting up ok, but then I get a stack trace and the container goes into Error state: https://pastebin.com/5wk1bKy9 Any ideas how to fix this? Or somehow extract the data and put it back together? -- Cheers, Peter Sarossy Technical Program Manager Data Center Data Security - Google LLC.

1 0

Authorized UV Printer Supplier in India - PH UV Printer
by ela1789brown＠gmail.com 06 Aug '20

06 Aug '20

If you are really searching for the best and most reputed UV printer supplier in India then there is only one name i.e. PH UV Printer https://phuvprinter.com/. it is the only UV printer supplier having the wide range of best quality UV printers allows you to print custom design over your products. With the help of this best quality UV printing you can easily print custom design over your products to make them more unique. If you want to know more then visit the official website of PH UV Printer. For more entertaining content visit: https://shayarikapitara.com/sorry-shayari/

1 0

librbd Image Watcher Errors
by Ml Ml 05 Aug '20

05 Aug '20

Hello, with cron i run backups with backurne (https://github.com/JackSlateur/backurne) which is rbd based. Sometimes i get those messages: 2020-08-05T18:42:18.915+0200 7fcdbd7fa700 -1 librbd::ImageWatcher: 0x7fcda400a6a0 image watch failed: 140521330717776, (107) Transport endpoint is not connected 2020-08-05T18:42:18.915+0200 7fcdbd7fa700 -1 librbd::Watcher: 0x7fcda400a6a0 handle_error: handle=140521330717776: (107) Transport endpoint is not connected 2020-08-05T18:45:13.496+0200 7fcdbd7fa700 -1 librbd::ImageWatcher: 0x7fcda400a6a0 image watch failed: 140521330717776, (110) Connection timed out 2020-08-05T18:45:13.496+0200 7fcdbd7fa700 -1 librbd::Watcher: 0x7fcda400a6a0 handle_error: handle=140521330717776: (110) Connection timed out 2020-08-05T18:58:01.408+0200 7fc66ffff700 -1 librbd::ImageWatcher: 0x7fc65c00a770 image watch failed: 140490057987152, (107) Transport endpoint is not connected 2020-08-05T18:58:01.408+0200 7fc66ffff700 -1 librbd::Watcher: 0x7fc65c00a770 handle_error: handle=140490057987152: (107) Transport endpoint is not connected Any idea what this indicates and how it could be solved? Thanks, Michael

1 0

RGW versioned objects lost after Octopus 15.2.3 -> 15.2.4 upgrade
by Chris Palmer 05 Aug '20

05 Aug '20

I have an RGW bucket (backups) that is versioned. A nightly job creates a new version of a few objects. There is a lifecycle policy (see below) that keeps 18 days of versions. This has been working perfectly and has not been changed. Until I upgraded Octopus... The nightly job creates separate log files, including a listing of the object versions. From these I can see that: 13/7 02:14 versions from 13/7 01:13 back to 24/6 01:17 (correct) 14/7 02:14 versions from 14/7 01:13 back to 25/6 01:14 (correct) 14/7 10:00 upgrade Octopus 15.2.3 -> 15.2.4 15/7 02:14 versions from 15/7 01:13 back to 25/6 01:14 (would have expected 25/6 to have expired) 16/7 02:14 versions from 16/7 01:13 back to 15/7 01:13 (now all pre-upgrade versions have wrongly disappeared) It's not a big deal for me as they are only backups, providing it continues to work correctly from now on. However it may affect some other people much more. Any ideas on the root cause? And if it is likely to be stable again now? Thanks, Chris { "Rules": [ { "Expiration": { "ExpiredObjectDeleteMarker": true }, "ID": "Expiration & incomplete uploads", "Prefix": "", "Status": "Enabled", "NoncurrentVersionExpiration": { "NoncurrentDays": 18 }, "AbortIncompleteMultipartUpload": { "DaysAfterInitiation": 1 } } ] }

4 9

module cephadm has failed
by Daniel Davidson 05 Aug '20

05 Aug '20

I am having trouble getting rid of an error after creating a new ceph cluster. The error is: Module 'cephadm' has failed: auth get failed: failed to find client.crash.ceph-0 in keyring retval: -2 Checking the keyrings and disguising the keys: # ceph auth ls ... client.crash.ceph-0.data.igb.illinois.edu key: keyA caps: [mgr] profile crash caps: [mon] profile crash ... mgr.ceph-0.uymvya key: keyB caps: [mds] allow * caps: [mon] profile mgr caps: [osd] allow * ... Then on the node: # cat mgr.ceph-0.uymvya/keyring [mgr.ceph-0.uymvya] key = keyB caps mds = "allow *" caps mon = "profile mgr" caps osd = "allow *" So the keys match where they should, but I am thinking that the domain missing off the mgr might be the issue. This is keeping me from getting rados working since the cluster is showing a health issue. It looks like this is an issue in my version of ceph (15.2.4)? Can someone point me to the fix or at minimum tell me how to remove the mgr on ceph-0 from the config so that I can get the system healthy. thanks, Dan

1 0