March 2020 - ceph-users - lists.ceph.io

by Mark Lopez

I noticed the same - https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/WS6OWKZ5NQX…. Out of curiosity, do you use the dashboard, and if so, does keeping the dashboard open cause the mgr RAM usage to increase overtime? Regards, Mark

4 years, 1 month

1
0
0 0

Re: v14.2.8 Nautilus released

by kefu chai

On Wed, Mar 4, 2020 at 3:46 AM Kaleb Keithley <kkeithle(a)redhat.com> wrote: > > > Just FYI, 14.2.8 build fails on Fedora-32 on S390x. Other architectures build fine. > Kaleb, see https://github.com/ceph/ceph/pull/33716. hopefully we can get in the next release or probably you could include this patch in the rpm packaging? > Build log at https://kojipkgs.fedoraproject.org//work/tasks/6999/42146999/build.log > > On Tue, Mar 3, 2020 at 7:38 AM Abhishek Lekshmanan <abhishek(a)suse.com> wrote: >> >> >> This is the eighth update to the Ceph Nautilus release series. This release >> fixes issues across a range of subsystems. We recommend that all users upgrade >> to this release. Please note the following important changes in this >> release; as always the full changelog is posted at: >> https://ceph.io/releases/v14-2-8-nautilus-released >> >> Notable Changes >> --------------- >> >> * The default value of `bluestore_min_alloc_size_ssd` has been changed >> to 4K to improve performance across all workloads. >> >> * The following OSD memory config options related to bluestore cache autotuning can now >> be configured during runtime: >> >> - osd_memory_base (default: 768 MB) >> - osd_memory_cache_min (default: 128 MB) >> - osd_memory_expected_fragmentation (default: 0.15) >> - osd_memory_target (default: 4 GB) >> >> The above options can be set with:: >> >> ceph config set osd <option> <value> >> >> * The MGR now accepts `profile rbd` and `profile rbd-read-only` user caps. >> These caps can be used to provide users access to MGR-based RBD functionality >> such as `rbd perf image iostat` an `rbd perf image iotop`. >> >> * The configuration value `osd_calc_pg_upmaps_max_stddev` used for upmap >> balancing has been removed. Instead use the mgr balancer config >> `upmap_max_deviation` which now is an integer number of PGs of deviation >> from the target PGs per OSD. This can be set with a command like >> `ceph config set mgr mgr/balancer/upmap_max_deviation 2`. The default >> `upmap_max_deviation` is 1. There are situations where crush rules >> would not allow a pool to ever have completely balanced PGs. For example, if >> crush requires 1 replica on each of 3 racks, but there are fewer OSDs in 1 of >> the racks. In those cases, the configuration value can be increased. >> >> * RGW: a mismatch between the bucket notification documentation and the actual >> message format was fixed. This means that any endpoints receiving bucket >> notification, will now receive the same notifications inside a JSON array >> named 'Records'. Note that this does not affect pulling bucket notification >> from a subscription in a 'pubsub' zone, as these are already wrapped inside >> that array. >> >> * CephFS: multiple active MDS forward scrub is now rejected. Scrub currently >> only is permitted on a file system with a single rank. Reduce the ranks to one >> via `ceph fs set <fs_name> max_mds 1`. >> >> * Ceph now refuses to create a file system with a default EC data pool. For >> further explanation, see: >> https://docs.ceph.com/docs/nautilus/cephfs/createfs/#creating-pools >> >> * Ceph will now issue a health warning if a RADOS pool has a `pg_num` >> value that is not a power of two. This can be fixed by adjusting >> the pool to a nearby power of two:: >> >> ceph osd pool set <pool-name> pg_num <new-pg-num> >> >> Alternatively, the warning can be silenced with:: >> >> ceph config set global mon_warn_on_pool_pg_num_not_power_of_two false >> >> Getting Ceph >> ------------ >> >> * Git at git://github.com/ceph/ceph.git >> * Tarball at http://download.ceph.com/tarballs/ceph-14.2.8.tar.gz >> * For packages, see http://docs.ceph.com/docs/master/install/get-packages/ >> * Release git sha1: 2d095e947a02261ce61424021bb43bd3022d35cb >> >> -- >> Abhishek Lekshmanan >> SUSE Software Solutions Germany GmbH >> GF: Felix Imendörffer HRB 21284 (AG Nürnberg) >> _______________________________________________ >> Dev mailing list -- dev(a)ceph.io >> To unsubscribe send an email to dev-leave(a)ceph.io > > _______________________________________________ > Dev mailing list -- dev(a)ceph.io > To unsubscribe send an email to dev-leave(a)ceph.io -- Regards Kefu Chai

4 years, 1 month

1
0
0 0

MIgration from weight compat to pg_upmap

by Stefan Priebe - Profihost AG

Hello, is there any way to switch to pg_upmap without triggering heavy rebalancing two times? 1.) happens at: ceph osd crush weight-set rm-compat 2.) happens after running the balancer in pg_upmap mode Greets, Stefan

4 years, 1 month

2
2
0 0

Deleting Multiparts stuck directly from rgw.data pool

by EDH - Manuel Rios

Hi, We're at 14.2.8, still got problems with abort multiparts. This night we created a full list of objects with the string multipart like 48efb8c3-693c-4fe0-bbe4-fdc16f590a82.3886182.8__multipart_MBS-a3d91785-9579-4b18-9635-f4694bd0db1c/CBB_SRVALFA/F$/Correo/Gmolins/Outlook/Outlook.pst$/20190702110014/Outlook.pst.2~nu6skEciSGZVSz3SlXZ-GMURki6wPB3.10 Total 5-6Millions parts Its secure delete rgw object directly from data pool? We tried with LC, it return list_multiparts -2, with AWS cli an error already reported in the tracker. I'm thinking about do a full bucket rewrite with radosgw-admin bucket rewrite but im not sure if this will solve something or generate more trash. Best Regards Manuel

4 years, 1 month

1
0
0 0

14.2.8 Multipart delete still not working

by EDH - Manuel Rios

Hi, We have updated our cluster to 14.2.8 since we suffered the bug https://tracker.ceph.com/issues/43583, now life cycle policies give more information than before. In 14.2.7 they ended instantly so something we have advanced. But they are not yet able to eliminate multipart. Just a line of the error that return -2 1. 2020-03-03 18:13:19.361 7fb58bcfb6c0 5 lifecycle: ERROR: abort_multipart_upload failed, ret=-2009, meta:_multipart_MBS-0fc78b70-efa6-49ef-bdd2-fd3a4b4f2c84/CBB_BIM-AUTOLOG/CBB_DiskImage/Disk_00000000-0000-0000-0000-000000000000/Volume_NTFS_00000000-0000-0000-0000-000000000001$/20190315230135/160.cbrevision.2~5nOv_6K_GZVwAJNqmEZ RrmE4lMs_-91.meta 2. 2020-03-03 18:13:19.361 7fb58bcfb6c0 20 obj_has_expired(): mtime=2019-03-16 00:53:58.0.940346s days=1 base_time=2020-03-03 00:00:00.000000 timediff=3.0496e+07 cmp=86400 3. 2020-03-03 18:13:19.362 7fb58bcfb6c0 20 abort_multipart_upload: list_multipart_parts returned -2 LC Applied <?xml version="1.0" ?> <LifecycleConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/"> <Rule> <ID>Incomplete Multipart Uploads</ID> <Prefix/> <Status>Enabled</Status> <AbortIncompleteMultipartUpload> <DaysAfterInitiation>1</DaysAfterInitiation> </AbortIncompleteMultipartUpload> </Rule> </LifecycleConfiguration> Suggestion ? Regards Manuel

4 years, 1 month

1
0
0 0

e5 failed to get devid for : udev_device_new_from_subsystem_sysname failed on ''

by Matthias Leopold

Hi, I installed a basic three host cluster with ceph-deploy for development today and I'm seeing messages like mon.somehost@2(electing) e5 failed to get devid for : udev_device_new_from_subsystem_sysname failed on '' in monitor logs when monitor starts up. What is this? I found this: https://tracker.ceph.com/issues/42053, but I wasn't using ceph-ansible. Cluster has 3 nodes, 3 monitors (all have that message), 2 managers and is healthy Ceph version is 14.2.8 on CentOS 7 thx Matthias

4 years, 1 month

1
0
0 0

leftover: spilled over 128 KiB metadata after adding db device

by Stefan Priebe - Profihost AG

Hello, i added a db device to my osds running nautilus. The DB data migratet over some days from the hdd to ssd (db device). But now it seems all are stuck at: # ceph health detail HEALTH_WARN BlueFS spillover detected on 8 OSD(s) BLUEFS_SPILLOVER BlueFS spillover detected on 8 OSD(s) osd.0 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device osd.1 spilled over 3.4 MiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device osd.2 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device osd.3 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device osd.4 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device osd.5 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device osd.6 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device osd.7 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device any idea how to force ceph to move the last 128kb to the db device? Greets, Stefan

4 years, 1 month

3
5
0 0

Nautilus 14.2.8

by Fyodor Ustinov

Hi! Again. New version in repository without announce. :( I wonder who needs to write a letter and complain that there would always be an announcement, and then a new version in the repository? WBR, Fyodor.

4 years, 1 month

3
3
0 0

Restrict client access to a certain rbd pool with seperate metadata and data pool

by Rainer Krienke

Hello, I do not know how to restrict a client.user to a certain rbd pool where this pool has a replicated metadata pool pool.rbd and an erasure coded data pool named pool.ec . I am running ceph nautilus. I tried this for a client.user: # ceph auth caps client.user mon 'profile rbd' osd 'profile rbd pool=pool.rbd' # ceph auth get client.user > ./client.user # rbd -n client.user -k ./client.user create pool.rbd/test --size=1G --data-pool=pool.ec 2020-03-03 15:54:43.813 7f2817fff700 -1 librbd::image::ValidatePoolRequest: handle_read_rbd_info: failed to read RBD info: (1) Operation not permitted 2020-03-03 15:54:43.813 7f2817fff700 -1 librbd::image::CreateRequest: 0x563421cf4730 handle_validate_data_pool: failed to validate pool: (1) Operation not permitted rbd: create error: (1) Operation not permitted If I remove the "... pool=pool.rbd" -section in "ceph auth caps ..." call from above everything works. Any idea how I can get this setup to work? Thanks Rainer -- Rainer Krienke, Uni Koblenz, Rechenzentrum, A22, Universitaetsstrasse 1 56070 Koblenz, Tel: +49261287 1312 Fax +49261287 100 1312 Web: http://userpages.uni-koblenz.de/~krienke PGP: http://userpages.uni-koblenz.de/~krienke/mypgp.html

4 years, 1 month

3
2
0 0

building ceph Nautilus for Debian Stretch

by Stefan Priebe - Profihost AG

Hello list, does anybody have a guide to build ceph Nautilus for Debian stretch? I wasn't able to find a backported gcc-8 for stretch. Otherwise i would start one. Greets, Stefan

4 years, 1 month

2
2
0 0

2024

2023

2022

2021

2020

2019

ceph-users March 2020