[Ceph-announce] v13.2.2 Mimic released

This is the second bugfix release of v13.2.x long term stable release series. This release contains many fixes across all the components of ceph and we recommend that all users upgrade. We thank everyone for contributing towards this release. The release notes are up at https://ceph.com/releases/13-2-2-mimic-released/ Changelog --------- * mgr: Sync the prometheus module (pr#23215, Boris Ranto) * ceph-volume: Restore SELinux context (pr#23295, Boris Ranto) * build/ops: debian/rules: fix ceph-mgr .pyc files left behind (issue#27059, issue#26883, pr#23831, Dan Mick) * ceph-volume: batch: allow journal+block.db sizing on the CLI (issue#36088, pr#24208, Alfredo Deza) * ceph-volume: do not use stdin in luminous (issue#25173, pr#23368, Alfredo Deza) * ceph-volume: process.call with stdin in Python 3 fix (issue#24993, pr#23239, Alfredo Deza) * ceph-volume: earlier detection for --journal and --filestore flag requirements (issue#24794, pr#24205, Alfredo Deza) * mgr: "balancer execute" only requires read permissions (issue#26912, issue#25345, pr#23583, John Spray) * build/ops: Boost system library is no longer required to compile and link example librados program (issue#25073, issue#25054, pr#23201, Nathan Cutler) * CephVolumeClient: delay required after adding data pool to MDSMap (issue#25206, pr#23725, Patrick Donnelly) * core: Fix 25085 and 24949 (pr#23272, David Zafman) * core: Limit pg log length during recovery/backfill so that we don't run out of memory (issue#21416, pr#23403, Neha Ojha) * MDSMonitor: note ignored beacons/map changes at higher debug level (issue#26898, issue#26929, pr#23704, Patrick Donnelly) * build/ops: mimic 13.2.0 doesn't build in Fedora rawhide (issue#24449, issue#24905, pr#23885, Kefu Chai) * ceph tell osd.x bench writes resulting JSON to stderr instead of stdout (issue#35942, issue#24022, pr#24041, Коренберг Маркr, John Spray, Kefu Chai) * ceph-disk: compatibility fix for python 3 (pr#24008, Tim Serong) * ceph-disk: return a list instead of an iterator (pr#23392, Alexander Graul) * ceph-volume add a __release__ string, to help version-conditional calls (issue#25169, pr#23333, Alfredo Deza) * ceph-volume batch carve out lvs for bluestore (issue#34535, pr#24074, Alfredo Deza) * ceph-volume batch command (pr#23777, Alfredo Deza) * ceph-volume batch: allow --osds-per-device, default it to 1 (issue#35913, pr#24079, Alfredo Deza) * ceph-volume enable the ceph-osd during lvm activation (issue#24152, pr#23393, Dan van der Ster, Alfredo Deza) * ceph-volume expand auto engine for multiple devices on filestore (pr#23807, Andrew Schoen, Alfredo Deza) * ceph-volume fix zap not working with LVs (issue#35970, pr#24081, Alfredo Deza) * ceph-volume lvm.activate conditional mon-config on prime-osd-dir (issue#25216, pr#23400, Alfredo Deza) * ceph-volume lvm.batch remove non-existent sys_api property (issue#34310, pr#23810, Alfredo Deza) * ceph-volume lvm.listing only include devices if they exist (issue#24952, pr#23149, Alfredo Deza) * ceph-volume tests/functional add mgrs daemons to lvm tests (pr#23784, Alfredo Deza) * ceph-volume: PVolumes.get() should return one PV when using name or uuid (issue#24784, pr#23327, Andrew Schoen) * ceph-volume: `lvm batch` allow extra flags (like dmcrypt) for bluestore (pr#23780, Alfredo Deza) * ceph-volume: `lvm batch` documentation and man page updates (pr#23756, Alfredo Deza) * ceph-volume: adds test for `ceph-volume lvm list /dev/sda` (issue#24784, issue#24957, pr#23349, Andrew Schoen) * ceph-volume: an OSD ID must exist and be destroyed before reuse (pr#23101, Andrew Schoen, Ron Allred) * ceph-volume: batch tests for mixed-type of devices (issue#35535, issue#27210, pr#23966, Alfredo Deza) * ceph-volume: expand auto engine for single type devices on filestore (pr#23786, Alfredo Deza) * ceph-volume: refuse to zap mapper devices (issue#24504, pr#22965, Andrew Schoen) * ceph-volume: run tests without waiting on ceph repos (pr#23806, Andrew Schoen) * ceph-volume: tests.functional inherit SSH_ARGS from ansible (pr#23812, Alfredo Deza) * ceph-volume: update batch documentation to explain filestore strategies (issue#34309, pr#23826, Alfredo Deza) * ceph-volume: update version of ansible to 2.6.x for simple tests (pr#23269, Andrew Schoen) * ceph_volume_client: allow atomic update of RADOS objects (issue#24173, issue#24863, pr#23878, Rishabh Dave) * cephfs-journal-tool: enable purge_queue journal's event commands (issue#24604, issue#26989, pr#23818, Xuehan Xu) * client: add inst to asok status output (issue#24724, issue#24931, pr#23109, Patrick Donnelly) * client: check for unmounted condition before printing debug output (issue#25213, issue#26914, pr#23603, Jeff Layton) * client: requests that do name lookup may be sent to wrong mds (issue#26984, issue#26860, pr#23700, "Yan, Zheng") * cls/rgw: add rgw_usage_log_entry type to ceph-dencoder (issue#35070, pr#23857, Vaibhav Bhembre) * common: check completion condition before waiting (issue#25007, issue#25222, pr#23435, Patrick Donnelly) * core: deep scrub cannot find the bitrot if the object is cached (issue#35068, pr#23873, Adam C. Emerson, Xiaoguang Wang) * core: force-create-pg broken (issue#34532, issue#26940, pr#23872, Sage Weil) * doc: Fix broken urls (issue#25185, issue#26916, pr#23607, Jos Collin) * doc: broken bash example in bluestore migration (issue#35078, pr#23854, Alfredo Deza) * doc: http://docs.ceph.com/docs/mimic/rados/operations/pg-states/ (issue#25055, pr#23163, Jan Fajerski, Nathan Cutler) * docs: radosgw: ldap-auth: fixed option name 'rgw_ldap_searchfilter' (issue#32129, pr#23956, Konstantin Shalygin) * filestore: add pgid in filestore pg dir split log message (issue#25225, pr#23453, Vikhyat Umrao) * kv: MergeOperator name() returns string, and caller calls c_str() on the temporary (issue#26907, issue#26875, pr#23865, Sage Weil) * libradosstriper conditional compile (issue#27213, pr#23869, Kefu Chai, Jesse Williamson) * librbd: deep-copy should not write to objects that cannot exist (issue#25000, issue#25083, pr#23358, Jason Dillaman) * librbd: validate data pool for self-managed snapshot support (issue#24945, pr#23560, Mykola Golub) * link against libstdc++ statically (issue#26880, issue#25209, pr#23490, Kefu Chai) * mds,osd,mon,msg: use intrusive_ptr for holding Connection::priv (issue#20924, pr#22339, "Yan, Zheng", Kefu Chai) * mds: MDBalancer::try_rebalance() may stop prematurely (issue#32086, issue#26973, pr#23883, "Yan, Zheng") * mds: avoid using g_conf->get_val<...>(...) in hot path (issue#24820, pr#23407, "Yan, Zheng") * mds: calculate load by checking self CPU usage (issue#26834, issue#26888, pr#23503, "Yan, Zheng") * mds: crash when dumping ops in flight (issue#26894, issue#26982, pr#23672, "Yan, Zheng") * mds: dump recent events on respawn (issue#25040, pr#23275, Patrick Donnelly) * mds: explain delayed client_request due to subtree migration (issue#26988, issue#24840, pr#23792, Yan, Zheng, "Yan, Zheng") * mds: handle discontinuous mdsmap (issue#24856, pr#23180, "Yan, Zheng") * mds: health warning for slow metadata IO (issue#24879, issue#25045, pr#23343, "Yan, Zheng") * mds: increase debug level for dropped client cap msg (issue#25042, pr#23309, Patrick Donnelly) * mds: introduce cephfs' own feature bits (issue#14456, issue#24914, pr#23105, Yan, Zheng, "Yan, Zheng", Patrick Donnelly) * mds: mark beacons as high priority (issue#26905, issue#26899, pr#23565, Patrick Donnelly) * mds: print mdsmap processed at low debug level (issue#25035, pr#23196, Patrick Donnelly) * mds: scrub doesn't always return JSON results (issue#23958, issue#25037, pr#23225, Venky Shankar) * mds: use fast dispatch to handle MDSBeacon (issue#23519, issue#26923, pr#23703, "Yan, Zheng") * mgr balancer does not save optimized plan but latest (issue#32082, issue#27000, pr#23782, Stefan Priebe) * mgr/MgrClient: Protect daemon_health_metrics (issue#23352, pr#23458, Kjetil Joergensen, Brad Hubbard) * mgr/dashboard: Display RGW user/bucket quota max size in human readable form (issue#35706, pr#24047, Volker Theile) * mgr/dashboard: Escape regex pattern in DeletionModalComponent (issue#24902, issue#26920, pr#23669, Tiago Melo) * mgr/dashboard: Prevent RGW API user deletion (pr#22670, Volker Theile) * mgr/dashboard: RGW is not working if an URL prefix is defined (pr#23203, Volker Theile) * mgr/dashboard: RestClient can't handle ProtocolError exceptions (pr#23875, Volker Theile) * mgr/dashboard: URL prefix is not working (issue#25120, pr#23874, Ricardo Marques) * mgr: Ignore daemon if no metadata was returned (pr#23356, Wido den Hollander) * mgrc: enable disabling stats via mgr_stats_threshold (issue#25197, issue#26837, pr#23463, John Spray) * mon: Automatically set expected_num_objects for new pools with >=100 PGs per OSD (issue#24687, issue#25144, pr#23860, Douglas Fuller) * mon: add purge-new (pr#23259, Sage Weil) * multisite: intermittent failures in test_bucket_sync_disable_enable (issue#26895, issue#26980, pr#23856, Casey Bodley) * multisite: object metadata operations are skipped by sync (issue#24367, issue#24986, pr#23172, Casey Bodley) * object errors found in be_select_auth_object() aren't logged the same (issue#32108, issue#25108, pr#23870, David Zafman) * os/bluestore/BlueStore.cc: 1025: FAILED assert(buffer_bytes >= b->length) from ObjectStore/StoreTest.ColSplitTest2/2 (issue#24439, issue#26944, pr#23748, Sage Weil) * os/bluestore: bluestore_buffer_hit_bytes perf counter doesn't reset (pr#23772, Igor Fedotov) * os/bluestore: fix assertion in StupidAllocator::get_fragmentation (pr#23676, Igor Fedotov) * osd,mon: increase mon_max_pg_per_osd to 300 (issue#25176, pr#23861, Neha Ojha) * osd/OSDMap: CRUSH_TUNABLES5 added in jewel, not kraken (issue#25057, issue#25101, pr#23226, Sage Weil) * osd/PrimaryLogPG: avoid dereferencing invalid complete_to (pr#23951, xie xingguo) * osd: do_sparse_read(): Verify checksum earlier so we will try to repair (issue#24875, pr#23378, David Zafman) * osd: segv in OSDMap::calc_pg_upmaps from balancer (issue#22056, issue#26933, pr#23888, Brad Hubbard) * qa/rgw: patch keystone requirements.txt (issue#26946, issue#23659, pr#23771, Casey Bodley) * qa/suites/rados: move valgrind test to singleton-flat (issue#24992, pr#23744, Sage Weil) * qa/tasks: s3a fix mirror (pr#24038, Vasu Kulkarni) * qa/tests: update ansible version to 2.5 (pr#24091, Yuri Weinstein) * qa: cfuse_workunit_kernel_untar_build fails on Ubuntu 18.04 (issue#26956, issue#26967, issue#24679, pr#23769, Patrick Donnelly) * qa: fix ceph-disk suite and add coverage for ceph-detect-init (pr#23337, Nathan Cutler) * rados python bindings use prval from stack (issue#25204, issue#25175, pr#23863, Sage Weil) * rados: not all exceptions accept keyargs (issue#25178, issue#24033, pr#23335, Rishabh Dave) * rbd: improved trash snapshot namespace handling (issue#25121, issue#23398, issue#25114, pr#23559, Mykola Golub, Jason Dillaman) * rgw: Fix log level of gc_iterate_entries (issue#23801, issue#26921, pr#23686, iliul) * rgw: Limit the number of lifecycle rules on one bucket (issue#26845, issue#24572, pr#23521, Zhang Shaowen) * rgw: The delete markers generated by object expiration should have owner (issue#24568, issue#26847, pr#23541, Zhang Shaowen) * rgw: add curl_low_speed_limit and curl_low_speed_time config to avoid (issue#25021, pr#23173, Mark Kogan, Zhang Shaowen) * rgw: change default rgw_thread_pool_size to 512 (issue#25214, issue#25088, issue#25218, issue#24544, pr#23383, Douglas Fuller, Casey Bodley) * rgw: civetweb fails on urls with control characters (issue#26849, issue#24158, pr#23855, Abhishek Lekshmanan) * rgw: civetweb: use poll instead of select while waiting on sockets (issue#35954, pr#24058, Abhishek Lekshmanan) * rgw: do not ignore EEXIST in RGWPutObj::execute (issue#25078, issue#22790, pr#23206, Matt Benjamin) * rgw: fail to recover index from crash mimic backport (issue#24640, issue#24629, issue#24280, pr#23118, Tianshan Qu) * rgw: radosgw-admin: 'sync error trim' loops until complete (issue#24873, issue#24984, pr#23140, Casey Bodley) * rgw_file: deep stat handling (issue#26842, issue#24915, pr#23498, Matt Benjamin) * rpm: should change ceph-mgr package depency from py-bcrypt to python2-bcrypt (issue#27212, pr#23868, Konstantin Sakhinov) * rpm: silence osd block chown (issue#25152, pr#23324, Dan van der Ster) * run-rbd-unit-tests.sh test fails to finish in jenkin's make check run (issue#27060, issue#24910, pr#23858, Mykola Golub) * scrub livelock (issue#26931, issue#26890, pr#23722, Sage Weil) * spdk: compile with -march=core2 instead of -march=native (issue#25032, pr#23175, Nathan Cutler) * test: Use pids instead of jobspecs which were wrong (issue#32079, issue#27056, pr#23893, David Zafman) * tests: cluster [WRN] 25 slow requests in powercycle (issue#25119, pr#23886, Neha Ojha) * tools/ceph-detect-init: support RHEL as a platform (issue#18163, pr#23303, Nathan Cutler) * tools: ceph-detect-init: support SLED (issue#18163, pr#23111, Nathan Cutler) * tools: cephfs-data-scan: print the max used ino (issue#26978, issue#26925, pr#23880, "Yan, Zheng") * qa/tests: added OBJECT_MISPLACED to the whitelist (pr#23301, Yuri Weinstein) * qa/tests: added v13.2.1 to the mix (pr#23218, Yuri Weinstein) Getting ceph * Git at git://github.com/ceph/ceph.git * Tarball at http://download.ceph.com/tarballs/ceph-13.2.2.tar.gz * For packages, see http://docs.ceph.com/docs/master/install/get-packages/ * Release git sha1: 02899bfda814146b021136e9d8e80eba494e1126 -- Abhishek Lekshmanan SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nürnberg)