Ceph-announce August 2015

ceph-announce@ceph.io

2 participants
3 discussions

by Sage Weil

This Hammer point release fixes a critical (though rare) data corruption bug that could be triggered when logs are rotated via SIGHUP. It also fixes a range of other important bugs in the OSD, monitor, RGW, RGW, and CephFS. All v0.94.x Hammer users are strongly encouraged to upgrade. UPGRADING * TheÂ pgÂ ls-by-{pool,primary,osd}Â commands andÂ pgÂ lsÂ now take the argumentÂ recoveringÂ instead ofÂ recoveryÂ in order to include the recovering pgs in the listed pgs. NOTABLE CHANGES * librbd: aio calls may block (issue#11770,Â pr#4875, Jason Dillaman) * osd: make the all osd/filestore thread pool suicide timeouts separately configurable (issue#11701,Â pr#5159, Samuel Just) * mon: ceph fails to compile with boost 1.58 (issue#11982,Â pr#5122, Kefu Chai) * tests: TEST_crush_reject_empty must not run a mon (issue#12285,11975,Â pr#5208, Kefu Chai * osd: FAILED assert(!old_value.deleted()) in upgrade:giant-x-hammer-distro-basic-multi run (issue#11983,Â pr#5121, Samuel Just) * build/ops: linking ceph to tcmalloc causes segfault on SUSE SLE11-SP3 (issue#12368,Â pr#5265, Thorsten Behrens) * common: utf8 and old gcc breakage on RHEL6.5 (issue#7387,Â pr#4687, Kefu Chai) * crush: take crashes due to invalid arg (issue#11740,Â pr#4891, Sage Weil) * rgw: need conversion tool to handle fixes following #11974 (issue#12502,Â pr#5384, Yehuda Sadeh) * rgw: Swift API: support for 202 Accepted response code on container creation (issue#12299,Â pr#5214, Radoslaw Zarzynski) * common: Log::reopen_log_file: take m_flush_mutex (issue#12520,Â pr#5405, Samuel Just) * rgw: Properly respond to the Connection header with Civetweb (issue#12398,Â pr#5284, Wido den Hollander) * rgw: multipart list part response returns incorrect field (issue#12399,Â pr#5285, Henry Chang) * build/ops: ceph.spec.in: 95-ceph-osd.rules, mount.ceph, and mount.fuse.ceph not installed properly on SUSE (issue#12397,Â pr#5283, Nathan Cutler) * rgw: radosgw-admin dumps user info twice (issue#12400,Â pr#5286, guce) * doc: fix doc build (issue#12180,Â pr#5095, Kefu Chai) * tests: backport 11493 fixes, and test, preventing ec cache pools (issue#12314,Â pr#4961, Samuel Just) * rgw: does not send Date HTTP header when civetweb frontend is used (issue#11872,Â pr#5228, Radoslaw Zarzynski) * mon: pg ls is broken (issue#11910,Â pr#5160, Kefu Chai) * librbd: A client opening an image mid-resize can result in the object map being invalidated (issue#12237,Â pr#5279, Jason Dillaman) * doc: missing man pages for ceph-create-keys, ceph-disk-* (issue#11862,Â pr#4846, Nathan Cutler) * tools: ceph-post-file fails on rhel7 (issue#11876,Â pr#5038, Sage Weil) * build/ops: rcceph script is buggy (issue#12090,Â pr#5028, Owen Synge) * rgw: Bucket header is enclosed by quotes (issue#11874,Â pr#4862, Wido den Hollander) * build/ops: packaging: add SuSEfirewall2 service files (issue#12092,Â pr#5030, Tim Serong) * rgw: Keystone PKI token expiration is not enforced (issue#11722,Â pr#4884,Anton Aksola) * build/ops: debian/control: ceph-common (>> 0.94.2) must be >= 0.94.2-2 (issue#12529,11998,Â pr#5417, Loic Dachary) * mon: Clock skew causes missing summary and confuses Calamari (issue#11879,Â pr#4868, Thorsten Behrens) * rgw: rados objects wronly deleted (issue#12099,Â pr#5117, wuxingyi) tests: kernel_untar_build fails on EL7 (issue#12098,Â pr#5119, Greg Farnum) * fs: Fh ref count will leak if readahead does not need to do read from osd (issue#12319,Â pr#5427, Zhi Zhang) * mon: OSDMonitor: allow addition of cache pool with non-empty snaps with co... (issue#12595,Â pr#5252, Samuel Just) * mon: MDSMonitor: handle MDSBeacon messages properly (issue#11979,Â pr#5123, Kefu Chai) * tools: ceph-disk: get_partition_type fails on /dev/cciss... (issue#11760,Â pr#4892, islepnev) * build/ops: max files open limit for OSD daemon is too low (issue#12087,Â pr#5026, Owen Synge) * mon: add an 'osd crush tree' command (issue#11833,Â pr#5248, Kefu Chai) * mon: mon crashes when 'ceph osd tree 85 --format json' (issue#11975,Â pr#4936, Kefu Chai) * build/ops: ceph / ceph-dbg steal ceph-objecstore-tool from ceph-test / ceph-test-dbg (issue#11806,Â pr#5069, Loic Dachary) * rgw: DragonDisk fails to create directories via S3: MissingContentLength (issue#12042,Â pr#5118, Yehuda Sadeh) * build/ops: /usr/bin/ceph from ceph-common is broken without installing ceph (issue#11998,Â pr#5206, Ken Dreyer) * build/ops: systemd: Increase max files open limit for OSD daemon (issue#11964,Â pr#5040, Owen Synge) * build/ops: rgw/logrotate.conf calls service with wrong init script name (issue#12044,Â pr#5055, wuxingyi) * common: OPT_INT option interprets 3221225472 as -1073741824, and crashes in Throttle::Throttle() (issue#11738,Â pr#4889, Kefu Chai) * doc: doc/release-notes: v0.94.2 (issue#11492,Â pr#4934, Sage Weil) * common: admin_socket: close socket descriptor in destructor (issue#11706,Â pr#4657, Jon Bernard) * rgw: Object copy bug (issue#11755,Â pr#4885, Javier M. Mellid) * rgw: empty json response when getting user quota (issue#12245,Â pr#5237, wuxingyi) * fs: cephfs Dumper tries to load whole journal into memory at once (issue#11999,Â pr#5120, John Spray) * rgw: Fix tool for #11442 does not correctly fix objects created via multipart uploads (issue#12242,Â pr#5229, Yehuda Sadeh) * rgw: Civetweb RGW appears to report full size of object as downloaded when only partially downloaded (issue#12243,Â pr#5231, Yehuda Sadeh) * osd: stuck incomplete (issue#12362,Â pr#5269, Samuel Just) * osd: start_flush: filter out removed snaps before determining snapc's (issue#11911,Â pr#4899, Samuel Just) * librbd: internal.cc: 1967: FAILED assert(watchers.size() == 1) (issue#12239,Â pr#5243, Jason Dillaman) * librbd: new QA client upgrade tests (issue#12109,Â pr#5046, Jason Dillaman) * librbd: [ FAILED ] TestLibRBD.ExclusiveLockTransition (issue#12238,Â pr#5241, Jason Dillaman) * rgw: Swift API: XML document generated in response for GET on account does not contain account name (issue#12323,Â pr#5227, Radoslaw Zarzynski) * rgw: keystone does not support chunked input (issue#12322,Â pr#5226, HervÃ© Rousseau) * mds: MDS is crashed (mds/CDir.cc: 1391: FAILED assert(!is_complete())) (issue#11737,Â pr#4886, Yan, Zheng) * cli: ceph: cli interactive mode does not understand quotes (issue#11736,Â pr#4776, Kefu Chai) * librbd: add valgrind memory checks for unit tests (issue#12384,Â pr#5280,Zhiqiang Wang) * build/ops: admin/build-doc: script fails silently under certain circumstances (issue#11902,Â pr#4877, John Spray) * osd: Fixes for rados ops with snaps (issue#11908,Â pr#4902, Samuel Just) * build/ops: ceph.spec.in: ceph-common subpackage def needs tweaking for SUSE/openSUSE (issue#12308,Â pr#4883, Nathan Cutler) * fs: client: reference counting 'struct Fh' (issue#12088,Â pr#5222, Yan, Zheng) * build/ops: ceph.spec: update OpenSUSE BuildRequires (issue#11611,Â pr#4667, Loic Dachary) For more detailed information, seeÂ theÂ completeÂ change: http://docs.ceph.com/docs/master/_downloads/v0.94.3.txt GETTING CEPH * Git atÂ git://github.com/ceph/ceph.git * Tarball atÂ http://ceph.com/download/ceph-0.94.3.tar.gz * For packages, seeÂ http://ceph.com/docs/master/install/get-packages * For ceph-deploy, seeÂ http://ceph.com/docs/master/install/install-ceph-deploy

8 years, 8 months

v9.0.3 released

by Sage Weil

This is the second to last batch of development work for the Infernalis cycle. The most intrusive change is an internal (non user-visible) change to the OSD's ObjectStore interface. Many fixes and improvements elsewhere across RGW, RBD, and another big pile of CephFS scrub/repair improvements. Upgrading --------- * The return code for librbd's rbd_aio_read and Image::aio_read API methods no longer returns the number of bytes read upon success. Instead, it returns 0 upon success and a negative value upon failure. * 'ceph scrub', 'ceph compact' and 'ceph sync force are now DEPRECATED. Users should instead use 'ceph mon scrub', 'ceph mon compact' and 'ceph mon sync force'. * 'ceph mon_metadata' should now be used as 'ceph mon metadata'. There is no need to deprecate this command (same major release since it was first introduced). * The `--dump-json` option of "osdmaptool" is replaced by `--dump json`. * The commands of "pg ls-by-{pool,primary,osd}" and "pg ls" now take "recovering" instead of "recovery", to include the recovering pgs in the listed pgs. Notable Changes --------------- * autotools: fix out of tree build (Krxysztof Kosinski) * autotools: improve make check output (Loic Dachary) * buffer: add invalidate_crc() (Piotr Dalek) * buffer: fix zero bug (#12252 Haomai Wang) * build: fix junit detection on Fedora 22 (Ira Cooper) * ceph-disk: install pip > 6.1 (#11952 Loic Dachary) * cephfs-data-scan: many additions, improvements (John Spray) * ceph: improve error output for 'tell' (#11101 Kefu Chai) * ceph-objectstore-tool: misc improvements (David Zafman) * ceph-objectstore-tool: refactoring and cleanup (John Spray) * ceph_test_rados: test pipelined reads (Zhiqiang Wang) * common: fix bit_vector extent calc (#12611 Jason Dillaman) * common: make work queue addition/removal thread safe (#12662 Jason Dillaman) * common: optracker improvements (Zhiqiang Wang, Jianpeng Ma) * crush: add --check to validate dangling names, max osd id (Kefu Chai) * crush: cleanup, sync with kernel (Ilya Dryomov) * crush: fix subtree base weight on adjust_subtree_weight (#11855 Sage Weil) * crypo: fix NSS leak (Jason Dillaman) * crypto: fix unbalanced init/shutdown (#12598 Zheng Yan) * doc: misc updates (Kefu Chai, Owen Synge, Gael Fenet-Garde, Loic Dachary, Yannick Atchy-Dalama, Jiaying Ren, Kevin Caradant, Robert Maxime, Nicolas Yong, Germain Chipaux, Arthur Gorjux, Gabriel Sentucq, Clement Lebrun, Jean-Remi Deveaux, Clair Massot, Robin Tang, Thomas Laumondais, Jordan Dorne, Yuan Zhou, Valentin Thomas, Pierre Chaumont, Benjamin Troquereau, Benjamin Sesia, Vikhyat Umrao) * erasure-code: cleanup (Kefu Chai) * erasure-code: improve tests (Loic Dachary) * erasure-code: shec: fix recovery bugs (Takanori Nakao, Shotaro Kawaguchi) * libcephfs: add pread, pwrite (Jevon Qiao) * libcephfs,ceph-fuse: cache cleanup (Zheng Yan) * librados: add src_fadvise_flags for copy-from (Jianpeng Ma) * librados: respect default_crush_ruleset on pool_create (#11640 Yuan Zhou) * librbd: fadvise for copy, export, import (Jianpeng Ma) * librbd: handle NOCACHE fadvise flag (Jinapeng Ma) * librbd: optionally disable allocation hint (Haomai Wang) * librbd: prevent race between resize requests (#12664 Jason Dillaman) * log: fix data corruption race resulting from log rotation (#12465 Samuel Just) * mds: expose frags via asok (John Spray) * mds: fix setting entire file layout in one setxattr (John Spray) * mds: fix shutdown (John Spray) * mds: handle misc corruption issues (John Spray) * mds: misc fixes (Jianpeng Ma, Dan van der Ster, Zhang Zhi) * mds: misc snap fixes (Zheng Yan) * mds: store layout on header object (#4161 John Spray) * misc performance and cleanup (Nathan Cutler, Xinxin Shu) * mon: add NOFORWARD, OBSOLETE, DEPRECATE flags for mon commands (Joao Eduardo Luis) * mon: add PG count to 'ceph osd df' output (Michal Jarzabek) * mon: clean up, reorg some mon commands (Joao Eduardo Luis) * mon: disallow >2 tiers (#11840 Kefu Chai) * mon: fix log dump crash when debugging (Mykola Golub) * mon: fix metadata update race (Mykola Golub) * mon: fix refresh (#11470 Joao Eduardo Luis) * mon: make blocked op messages more readable (Jianpeng Ma) * mon: only send mon metadata to supporting peers (Sage Weil) * mon: periodic background scrub (Joao Eduardo Luis) * mon: prevent pgp_num > pg_num (#12025 Xinxin Shu) * mon: reject large max_mds values (#12222 John Spray) * msgr: add ceph_perf_msgr tool (Hoamai Wang) * msgr: async: fix seq handling (Haomai Wang) * msgr: xio: fastpath improvements (Raju Kurunkad) * msgr: xio: sync with accellio v1.4 (Vu Pham) * osd: clean up temp object if promotion fails (Jianpeng Ma) * osd: constrain collections to meta and PGs (normal and temp) (Sage Weil) * osd: filestore: clone using splice (Jianpeng Ma) * osd: filestore: fix recursive lock (Xinxin Shu) * osd: fix dup promotion lost op bug (Zhiqiang Wang) * osd: fix temp-clearing (David Zafman) * osd: include a temp namespace within each collection/pgid (Sage Weil) * osd: low and high speed flush modes (Mingxin Liu) * osd: peer_features includes self (David Zafman) * osd: recovery, peering fixes (#11687 Samuel Just) * osd: require firefly features (David Zafman) * osd: set initial crush weight with more precision (Sage Weil) * osd: use a temp object for recovery (Sage Weil) * osd: use blkid to collection partition information (Joseph Handzik) * rados: add --striper option to use libradosstriper (#10759 Sebastien Ponce) * radosgw-admin: fix subuser modify output (#12286 Guce) * rados: handle --snapid arg properly (Abhishek Lekshmanan) * rados: improve bench buffer handling, performance (Piotr Dalek) * rados: new pool import implementation (John Spray) * rbd: fix link issues (Jason Dillaman) * rbd: improve CLI arg parsing, usage (Ilya Dryomov) * rbd: recognize queue_depth kernel option (Ilya Dryomov) * rbd: support G and T units for CLI (Abhishek Lekshmanan) * rbd: use image-spec and snap-spec in help (Vikhyat Umrao, Ilya Dryomov) * rest-bench: misc fixes (Shawn Chen) * rest-bench: support https (#3968 Yuan Zhou) * rgw: add max multipart upload parts (#12146 Abshishek Dixit) * rgw: add Trasnaction-Id to response (Abhishek Dixit) * rgw: document layout of pools and objects (Pete Zaitcev) * rgw: do not preserve ACLs when copying object (#12370 Yehuda Sadeh) * rgw: fix Connection: header handling (#12298 Wido den Hollander) * rgw: fix data corruptions race condition (#11749 Wuxingyi) * rgw: fix JSON response when getting user quota (#12117 Wuxingyi) * rgw: force content_type for swift bucket stats requests (#12095 Orit Wasserman) * rgw: improved support for swift account metadata (Radoslaw Zarzynski) * rgw: make max put size configurable (#6999 Yuan Zhou) * rgw: orphan detection tool (Yehuda Sadeh) * rgw: swift: do not override sent content type (#12363 Orit Wasserman) * rgw: swift: set Content-Length for account GET (#12158 Radoslav Zarzynski) * rpm: always rebuild and install man pages for rpm (Owen Synge) * rpm: misc fixes (Boris Ranto, Owen Synge, Ken Dreyer, Ira Cooper) * systemd: logrotate fixes (Tim Seron, Lars Marowsky-Bree, Nathan Cutler) * sysvinit compat: misc fixes (Owen Synge) * test: misc fs test improvements (John Spray, Loic Dachary) * test: python tests, linter cleanup (Alfredo Deza) Getting Ceph ------------ * Git at git://github.com/ceph/ceph.git * Tarball at http://ceph.com/download/ceph-9.0.3.tar.gz * For packages, see http://ceph.com/docs/master/install/get-packages * For ceph-deploy, see http://ceph.com/docs/master/install/install-ceph-deploy

8 years, 8 months

[ANN] ceph-deploy 1.5.27 released

by Travis Rhoden

Hi everyone, A new version of ceph-deploy has been released. Version 1.5.27 includes the following: - a new "ceph-deploy repo" command that allows for adding and removing custom repo definitions - Makes commands like "ceph-deploy install --rgw" only install the RGW component of Ceph. This works for daemons/components such as --rgw, --mds, and --cli, depending on how packages are split on your distro. For example, Debian packages the Ceph MDS into a separate 'ceph-mon' package, and therefore if you use "install --mds" only the ceph-mds package will be installed. RPM packages do not do this, so it has to install "ceph", which includes MDS, MON, and OSD daemons. Further package splits are coming, but right now we do what we can. - Some fixes around using DNF (Fedora >= 22) - Early support for systemd (Fedora 22 and development Ceph builds only) - Loads of internal changes. Full changelog is at [1]. Updated packages have been uploaded to {rpm,debian}-{firefly,hammer,testing} repos on ceph.com, and to PyPI. Cheers, - Travis [1] http://ceph.com/ceph-deploy/docs/changelog.html#id2

8 years, 8 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

Ceph-announce August 2015