[Ceph-announce] v12.2.5 Luminous released

Hello cephers, We're glad to announce the fifth bugfix release of Luminous v12.2.x long term stable release series. This release contains a range of bug fixes across all compoenents of Ceph. We recommend all the users of 12.2.x series to update. Notable Changes --------------- * MGR The ceph-rest-api command-line tool included in the ceph-mon package has been obsoleted by the MGR "restful" module. The ceph-rest-api tool is hereby declared deprecated and will be dropped in Mimic. The MGR "restful" module provides similar functionality via a "pass through" method. See http://docs.ceph.com/docs/luminous/mgr/restful for details. * CephFS Upgrading an MDS cluster to 12.2.3+ will result in all active MDS exiting due to feature incompatibilities once an upgraded MDS comes online (even as standby). Operators may ignore the error messages and continue upgrading/restarting or follow this upgrade sequence: Reduce the number of ranks to 1 (`ceph fs set <fs_name> max_mds 1`), wait for all other MDS to deactivate, leaving the one active MDS, upgrade the single active MDS, then upgrade/start standbys. Finally, restore the previous max_mds. See also: https://tracker.ceph.com/issues/23172 Other Notable Changes --------------------- * add --add-bucket and --move options to crushtool (issue#23472, issue#23471, pr#21079, Kefu Chai) * BlueStore.cc: _balance_bluefs_freespace: assert(0 == "allocate failed, wtf") (issue#23063, pr#21394, Igor Fedotov, xie xingguo, Sage Weil, Zac Medico) * bluestore: correctly check all block devices to decide if journal is\_… (issue#23173, issue#23141, pr#20651, Greg Farnum) * bluestore: statfs available can go negative (issue#23074, pr#20554, Igor Fedotov, Sage Weil) * build Debian installation packages failure (issue#22856, issue#22828, pr#20250, Tone Zhang) * build/ops: deb: move python-jinja2 dependency to mgr (issue#22457, pr#20748, Nathan Cutler) * build/ops: deb: move python-jinja2 dependency to mgr (issue#22457, pr#21233, Nathan Cutler) * build/ops: run-make-check.sh: fix SUSE support (issue#22875, issue#23178, pr#20737, Nathan Cutler) * cephfs-journal-tool: Fix Dumper destroyed before shutdown (issue#22862, issue#22734, pr#20251, dongdong tao) * ceph.in: print all matched commands if arg missing (issue#22344, issue#23186, pr#20664, Luo Kexue, Kefu Chai) * ceph-objectstore-tool command to trim the pg log (issue#23242, pr#20803, Josh Durgin, David Zafman) * ceph osd force-create-pg cause all ceph-mon to crash and unable to come up again (issue#22942, pr#20399, Sage Weil) * ceph-volume: adds raw device support to 'lvm list' (issue#23140, pr#20647, Andrew Schoen) * ceph-volume: allow parallel creates (issue#23757, pr#21509, Theofilos Mouratidis) * ceph-volume: allow skipping systemd interactions on activate/create (issue#23678, pr#21538, Alfredo Deza) * ceph-volume: automatic VDO detection (issue#23581, pr#21505, Alfredo Deza) * ceph-volume be resilient to $PATH issues (pr#20716, Alfredo Deza) * ceph-volume: fix action plugins path in tox (pr#20923, Guillaume Abrioux) * ceph-volume Implement an 'activate all' to help with dense servers or migrating OSDs (pr#21533, Alfredo Deza) * ceph-volume improve robustness when reloading vms in tests (pr#21072, Alfredo Deza) * ceph-volume lvm.activate error if no bluestore OSDs are found (issue#23644, pr#21335, Alfredo Deza) * ceph-volume: Nits noticed while studying code (pr#21565, Dan Mick) * ceph-volume tests alleviate libvirt timeouts when reloading (issue#23163, pr#20754, Alfredo Deza) * ceph-volume update man page for prepare/activate flags (pr#21574, Alfredo Deza) * ceph-volume: Using --readonly for {vg|pv|lv}s commands (pr#21519, Erwan Velu) * client: allow client to use caps that are revoked but not yet returned (issue#23028, issue#23314, pr#20904, Jeff Layton) * : Client:Fix readdir bug (issue#22936, pr#20356, dongdong tao) * client: release revoking Fc after invalidate cache (issue#22652, pr#20342, "Yan, Zheng") * Client: setattr should drop "Fs" rather than "As" for mtime and size (issue#22935, pr#20354, dongdong tao) * client: use either dentry_invalidate_cb or remount_cb to invalidate k… (issue#23355, pr#20960, Zhi Zhang) * cls/rbd: group_image_list incorrectly flagged as RW (issue#23407, issue#23388, pr#20967, Jason Dillaman) * cls/rgw: fix bi_log_iterate_entries return wrong truncated (issue#22737, issue#23225, pr#21054, Tianshan Qu) * cmake: rbd resource agent needs to be executable (issue#22980, pr#20617, Tim Bishop) * common/dns_resolv.cc: Query for AAAA-record if ms_bind_ipv6 is True (issue#23078, issue#23174, pr#20710, Wido den Hollander) * common/ipaddr: Do not select link-local IPv6 addresses (issue#21813, pr#21111, Willem Jan Withagen) * common: omit short option for id in help for clients (issue#23156, issue#23041, pr#20654, Patrick Donnelly) * common: should not check for VERSION_ID (issue#23477, issue#23478, pr#21090, Kefu Chai, Shengjing Zhu) * config: Change bluestore_cache_kv_max to type INT64 (pr#20334, Zhi Zhang) * Couldn't init storage provider (RADOS) (issue#23349, issue#22351, pr#20896, Brad Hubbard) * doc: Add missing pg states from doc (issue#23113, pr#20584, David Zafman) * doc: outline upgrade procedure for mds cluster (issue#23634, issue#23568, pr#21352, Patrick Donnelly) * doc/rgw: add page for http frontend configuration (issue#13523, issue#22884, pr#20242, Casey Bodley) * doc: rgw: mention the civetweb support for binding to multiple ports (issue#20942, issue#23317, pr#20906, Abhishek Lekshmanan) * docs fix ceph-volume missing sub-commands (pr#20691, Katie Holly, Yao Zongyou, David Galloway, Sage Weil, Alfredo Deza) * doc: update man page to explain ceph-volume support bluestore (issue#23142, issue#22663, pr#20679, lijing) * Double free in rados_getxattrs_next (issue#22940, issue#22042, pr#20358, Gu Zhongyan) * fixes for openssl & libcurl (issue#23239, issue#23245, issue#22951, issue#23221, issue#23203, pr#20722, Marcus Watts, Abhishek Lekshmanan, Jesse Williamson) * invalid JSON returned when querying pool parameters (issue#23312, issue#23200, pr#20890, Chang Liu) * is_qemu_running in qemu_rebuild_object_map.sh and qemu_dynamic_features.sh may return false positive (issue#23524, pr#21192, Mykola Golub) * [journal] allocating a new tag after acquiring the lock should use on-disk committed position (issue#23011, issue#22945, pr#20454, Jason Dillaman) * journal: Message too long error when appending journal (issue#23545, issue#23526, pr#21216, Mykola Golub) * legal: remove doc license ambiguity (issue#23410, issue#23336, pr#20988, Nathan Cutler) * librados: make OPERATION_FULL_FORCE the default for rados_remove() (issue#23114, issue#22413, pr#20585, Kefu Chai) * librados/snap_set_diff: don't assert on empty snapset (issue#23423, pr#20991, Mykola Golub) * librbd: potential crash if object map check encounters error (issue#22857, issue#22819, pr#20253, Jason Dillaman) * log: Fix AddressSanitizer: new-delete-type-mismatch (issue#23324, issue#23412, pr#20998, Brad Hubbard) * mds: add uptime to MDS status (issue#23150, pr#20626, Patrick Donnelly) * mds: FAILED assert (p != active_requests.end()) in MDRequestRef MDCache::request_get(metareqid_t) (issue#23154, issue#23059, pr#21176, "Yan, Zheng") * mds: fix session reference leak (issue#22821, issue#22969, pr#20432, "Yan, Zheng") * mds: optimize getattr file size (issue#23013, issue#22925, pr#20455, "Yan, Zheng") * mgr: Backport recent prometheus exporter changes (pr#20642, Jan Fajerski, Boris Ranto) * mgr: Backport recent prometheus rgw changes (pr#21492, Jan Fajerski, John Spray, Boris Ranto, Rubab-Syed) * mgr/balancer: pool-specific optimization support and bug fixes (pr#20359, xie xingguo) * mgr: die on bind() failure (issue#23175, pr#20712, John Spray) * mgr: fix MSG_MGR_MAP handling (issue#23409, pr#20973, Gu Zhongyan) * mgr: prometheus: fix PG state names (pr#21365, John Spray) * mgr: prometheus: set metadata metrics value to '1' (#22717) (pr#20254, Konstantin Shalygin) * mgr: quieten logging on missing OSD stats (issue#23224, pr#21053, John Spray) * mgr/zabbix: Backports to Luminous (pr#20781, Wido den Hollander) * mon: allow removal of tier of ec overwritable pool (issue#22971, issue#22754, pr#20433, Patrick Donnelly) * mon: ops get stuck in "resend forwarded message to leader" (issue#22114, issue#23077, pr#21016, Kefu Chai, Greg Farnum) * mon, osd: fix potential collided \*Up Set\* after PG remapping (issue#23118, pr#20829, xie xingguo) * mon/OSDMonitor.cc: fix expected_num_objects interpret error (issue#22530, issue#23315, pr#20907, Yang Honggang) * mon: update PaxosService::cached_first_committed in PaxosService::may… (issue#23626, issue#11332, pr#21328, Xuehan Xu, yupeng chen) * msg/async: size of EventCenter::file_events should be greater than fd (issue#23253, issue#23306, pr#20867, Yupeng Chen) * Objecter: add ignore overlay flag if got redirect reply (pr#20766, Ting Yi Lin) * os/bluestore: avoid overhead of std::function in blob_t (pr#20674, Radoslaw Zarzynski) * os/bluestore: avoid unneeded BlobRefing in _do_read() (pr#20675, Radoslaw Zarzynski) * os/bluestore: backport fixes around _reap_collection (pr#20964, Jianpeng Ma) * os/bluestore: change the type of aio_t:res to long (issue#23527, issue#23544, pr#21231, kungf) * os/bluestore: _dump_onode() don't prolongate Onode anymore (pr#20676, Radoslaw Zarzynski) * os/bluestore: recalc_allocated() when decoding bluefs_fnode_t (issue#23256, issue#23212, pr#20771, Jianpeng Ma, Igor Fedotov, Kefu Chai) * os/bluestore: trim cache every 50ms (instead of 200ms) (issue#23226, pr#21059, Sage Weil) * osd: add numpg_removing metric (pr#20785, Sage Weil) * osdc/Journaler: make sure flush() writes enough data (issue#22967, issue#22824, pr#20431, "Yan, Zheng") * osd: do not release_reserved_pushes when requeuing (pr#21229, Sage Weil) * osd: Fix assert when checking missing version (issue#21218, issue#23024, pr#20495, David Zafman) * osd: objecter sends out of sync with pg epochs for proxied ops (issue#22123, issue#23075, pr#20609, Sage Weil) * osd/OSDMap: skip out/crush-out osds (pr#20840, xie xingguo) * osd/osd_types: fix pg_pool_t encoding for hammer (pr#21283, Sage Weil) * osd: remove cost from mclock op queues; cost not handled well in dmcl… (pr#21426, J. Eric Ivancich) * osd: Remove partially created pg known as DNE (issue#23160, issue#21833, pr#20668, David Zafman) * osd: resend osd_pgtemp if it's not acked (issue#23610, issue#23630, pr#21330, Kefu Chai) * osd: treat successful and erroroneous writes the same for log trimming (issue#23323, issue#22050, pr#20851, Josh Durgin) * os/filestore: fix do_copy_range replay bug (issue#23351, issue#23298, pr#20957, Sage Weil) * parent blocks are still seen after a whole-object discard (issue#23304, issue#23285, pr#20860, Ilya Dryomov, Jason Dillaman) * PendingReleaseNotes: add note about upgrading MDS (issue#23414, pr#21001, Patrick Donnelly) * : qa: adjust cephfs full test for kclient (issue#22966, issue#22886, pr#20417, "Yan, Zheng") * qa: ignore io pause warnings in mds-full test (issue#23062, issue#22990, pr#20525, Patrick Donnelly) * qa: ignore MON_DOWN while thrashing mons (issue#23061, pr#20523, Patrick Donnelly) * qa/rgw: remove some civetweb overrides for beast testing (issue#23002, issue#23176, pr#20736, Casey Bodley) * qa: src/test/libcephfs/test.cc:376: Expected: (len) > (0), actual: -34 vs 0 (issue#22383, issue#22221, pr#21173, Patrick Donnelly) * qa: synchronize kcephfs suites with fs/multimds (issue#22891, issue#22627, pr#20302, Patrick Donnelly) * qa/tests - added tag: v12.2.2 to be used by client.1 (pr#21452, Yuri Weinstein) * qa/tests - Change machine type from 'vps' to 'ovh' as 'vps' does not … (pr#21031, Yuri Weinstein) * qa/workunits/rados/test-upgrade-to-mimic.sh: fix tee output (pr#21506, Sage Weil) * qa/workunits/rbd: switch devstack tempest to 17.2.0 tag (issue#23177, issue#22961, pr#20715, Jason Dillaman) * radosgw-admin data sync run crashes (issue#23180, pr#20762, lvshanchun) * rbd-mirror: fix potential infinite loop when formatting status message (issue#22964, issue#22932, pr#20416, Mykola Golub) * rbd-nbd: fix ebusy when do map (issue#23542, issue#23528, pr#21230, Li Wang) * rgw: add radosgw-admin sync error trim to trim sync error log (issue#23302, pr#20859, fang yuxiang) * rgw: add xml output header in RGWCopyObj_ObjStore_S3 response msg (issue#22416, issue#22635, pr#19883, Enming Zhang) * rgw: Admin API Support for bucket quota change (issue#23357, issue#21811, pr#20885, Jeegn Chen) * rgw: allow beast frontend to listen on specific IP address (issue#22858, issue#22778, pr#20252, Yuan Zhou) * rgw: can't download object with range when compression enabled (issue#23146, issue#23179, issue#22852, pr#20741, fang yuxiang) * rgw: data sync of versioned objects, note updating bi marker (issue#23025, pr#21214, Yehuda Sadeh) * RGW doesn't check time skew in auth v4 http header request (issue#23252, issue#22766, issue#22439, issue#22418, pr#20072, Bingyin Zhang, Casey Bodley) * rgw_file: avoid evaluating nullptr for readdir offset (issue#22889, pr#20345, Matt Benjamin) * rgw: fix crash with rgw_run_sync_thread false (issue#23318, issue#20448, pr#20932, Orit Wasserman) * rgw: fix memory fragmentation problem reading data from client (issue#23347, pr#20953, Marcus Watts) * rgw: fix mutlisite read-write issues (issue#23690, issue#22804, pr#21390, Niu Pengju) * rgw: fix the max-uploads parameter not work (issue#23020, issue#22825, pr#20476, Xin Liao) * rgw_log, rgw_file: account for new required envvars (issue#23192, issue#21942, pr#20672, Matt Benjamin) * rgw: log the right http status code in civetweb frontend's access log (issue#22812, issue#22538, pr#20157, Yao Zongyou) * rgw: parse old rgw_obj with namespace correctly (issue#23102, issue#22982, pr#20586, Yehuda Sadeh) * rgw recalculate stats option added (issue#23691, issue#23720, issue#23335, issue#23322, pr#21393, Abhishek Lekshmanan) * rgw: reject encrypted object COPY before supported (issue#23232, issue#23346, pr#20937, Jeegn Chen) * rgw: rgw: reshard cancel command should clear bucket resharding flag (issue#21619, pr#21389, Orit Wasserman) * rgw: s3website error handler uses original object name (issue#23201, issue#23310, pr#20889, Casey Bodley) * rgw: upldate the max-buckets when the quota is uploaded (issue#23022, pr#20477, zhaokun) * rgw: usage log fixes (issue#23686, issue#23758, pr#21388, Yehuda Sadeh, Greg Farnum, Robin H. Johnson) * rocksdb: incorporate the fix in RocksDB for no fast CRC32 path (issue#22534, pr#20825, Radoslaw Zarzynski) * scrub errors not cleared on replicas can cause inconsistent pg state when replica takes over primary (issue#23267, pr#21103, David Zafman) * snapmapper inconsistency, crash on luminous (issue#23500, pr#21118, Sage Weil) * Special scrub handling of hinfo_key errors (issue#23654, issue#23428, issue#23364, pr#21397, David Zafman) * src: s/--use-wheel// (pr#21177, Kefu Chai) * systemd: Wait 10 seconds before restarting ceph-mgr (issue#23083, issue#23101, pr#20604, Wido den Hollander) * test_admin_socket.sh may fail on wait_for_clean (issue#23507, pr#21124, Mykola Golub) * test/ceph-disk: specify the python used for creating venv (issue#23281, pr#20817, Kefu Chai) * TestLibRBD.RenameViaLockOwner may still fail with -ENOENT (issue#23152, issue#23068, pr#20628, Mykola Golub) * test/librbd: utilize unique pool for cache tier testing (issue#23064, issue#11502, pr#20550, Jason Dillaman) * test/pybind/test_rbd: allow v1 images for testing (pr#21471, Sage Weil) * test: Replace bc command with printf command (pr#21015, David Zafman) * tests: drop upgrade/jewel-x/point-to-point-x in luminous and master (issue#23159, issue#22888, pr#20641, Nathan Cutler) * tests: ENGINE Error in 'start' listener <bound in rados (issue#23606, pr#21307, John Spray) * tests: rgw: swift tests target ceph-luminous branch (pr#21048, Nathan Cutler) * tests: unittest_pglog timeout (issue#23522, issue#23504, pr#21134, Nathan Cutler) * Update mgr/restful documentation (issue#23230, pr#20725, Boris Ranto) Getting Ceph ------------ * Git at git://github.com/ceph/ceph.git * Tarball at http://download.ceph.com/tarballs/ceph-12.2.5.tar.gz * For packages, see http://docs.ceph.com/docs/master/install/get-packages/ * For ceph-deploy, see http://docs.ceph.com/docs/master/install/install-ceph-deploy * Release git sha1: cad919881333ac92274171586c827e01f554a70a * Blog entry: https://ceph.com/releases/v12-2-5-luminous-released/ From the ceph devel community, we wish you a happy upgrade process. Best, Abhishek