March 2023 - Dev - lists.ceph.io

Re: [ceph-users] Ceph Mgr/Dashboard Python depedencies: a new approach

by Casey Bodley

hi Ernesto and lists, > [1] https://github.com/ceph/ceph/pull/47501 are we planning to backport this to quincy so we can support centos 9 there? enabling that upgrade path on centos 9 was one of the conditions for dropping centos 8 support in reef, which i'm still keen to do if not, can we find another resolution to https://tracker.ceph.com/issues/58832? as i understand it, all of those python packages exist in centos 8. do we know why they were dropped for centos 9? have we looked into making those available in epel? (cc Ken and Kaleb) On Fri, Sep 2, 2022 at 12:01 PM Ernesto Puerta <epuertat(a)redhat.com> wrote: > > Hi Kevin, > >> >> Isn't this one of the reasons containers were pushed, so that the packaging isn't as big a deal? > > > Yes, but the Ceph community has a strong commitment to provide distro packages for those users who are not interested in moving to containers. > >> Is it the continued push to support lots of distros without using containers that is the problem? > > > If not a problem, it definitely makes it more challenging. Compiled components often sort this out by statically linking deps whose packages are not widely available in distros. The approach we're proposing here would be the closest equivalent to static linking for interpreted code (bundling). > > Thanks for sharing your questions! > > Kind regards, > Ernesto > _______________________________________________ > Dev mailing list -- dev(a)ceph.io > To unsubscribe send an email to dev-leave(a)ceph.io

1 week, 2 days

4
9
0 0

quincy v17.2.6 QE Validation status

by Yuri Weinstein

Details of this release are summarized here: https://tracker.ceph.com/issues/59070#note-1 Release Notes - TBD The reruns were in the queue for 4 days because of some slowness issues. The core team (Neha, Radek, Laura, and others) are trying to narrow down the root cause. Seeking approvals/reviews for: rados - Neha, Radek, Travis, Ernesto, Adam King (we still have to test and merge at least one PR https://github.com/ceph/ceph/pull/50575 for the core) rgw - Casey fs - Venky (the fs suite has an unusually high amount of failed jobs, any reason to suspect it in the observed slowness?) orch - Adam King rbd - Ilya krbd - Ilya upgrade/octopus-x - Laura is looking into failures upgrade/pacific-x - Laura is looking into failures upgrade/quincy-p2p - Laura is looking into failures client-upgrade-octopus-quincy-quincy - missing packages, Adam Kraitman is looking into it powercycle - Brad ceph-volume - needs a rerun on merged https://github.com/ceph/ceph-ansible/pull/7409 Please reply to this email with approval and/or trackers of known issues/PRs to address them. Also, share any findings or hypnosis about the slowness in the execution of the suite. Josh, Neha - gibba and LRC upgrades pending major suites approvals. RC release - pending major suites approvals. Thx YuriW

1 month, 2 weeks

12
24
0 0

new tcmalloc crashes on ubuntu 20.04

by Casey Bodley

the rgw suite just started hitting a tcmalloc crash on main against ubuntu 20.04: https://tracker.ceph.com/issues/59269 > src/tcmalloc.cc:332] Attempt to free invalid pointer 0x55e8173eebd0 this happens during startup of one of our librgw_file test cases https://tracker.ceph.com/issues/58219 tracks a similar crash from the fs suite in december, which apparently went away after reverting a change to ceph-dencoder's linkage, but it doesn't sound like we ever found the root cause is this crash showing up anywhere else? has anything changed with respect to tcmalloc versions or linkage recently?

1 month, 3 weeks

1
0
0 0

Action required: Enable two-factor authentication (2FA) on your GitHub account by April 1

by Ilya Dryomov

Hello, On April 1, 2023, the Ceph GitHub organization will start requiring two-factor authentication for all accounts (both members and outside collaborators). Any account that doesn't have two-factor authentication enabled on that date will be automatically removed from the organization. Disabling two-factor authentication on the account after that date would also remove it from the organization. If you don't have two-factor authentication enabled on your account already (some core developers still don't!), follow instructions at [1] to set it up. See [2] for a good explanation of why it matters. [1] https://docs.github.com/en/authentication/securing-your-account-with-two-fa… [2] https://github.blog/2022-05-04-software-security-starts-with-the-developer-… Thanks, Ilya

1 month, 4 weeks

1
1
0 0

17.2.6 RC available

by Yuri Weinstein

We are publishing a release candidate this time for users to try for testing only. Please note this RC had only limited testing. Full testing is being done now. Upgrading has been tested on some internal clusters, and the final upgrade of the longest-running cluster there is in progress. The branch name: https://github.com/ceph/ceph/tree/quincy-release https://shaman.ceph.com/builds/ceph/quincy-release/23eb3b2f0fc65087846571af… To install dev packages see https://docs.ceph.com/en/quincy/install/get-packages/#ceph-development-pack… The container build see - https://quay.ceph.io/ceph-ci/ceph:quincy-release Release notes: https://github.com/ceph/ceph/pull/50721 ***Don’t use this RC on production clusters!*** The goal is to give users time to test and give feedback on RC releases while our upstream long-running cluster also runs the same RC release during that time (period of one week). Please respond to this email to provide any feedback on issues found in this release. Thx YuriW

1 month, 4 weeks

1
0
0 0

03/30/2023 and 04/06/2023 perf meetings will be run by Josh!

by Mark Nelson

Hi Folks, I will be taking a very much needed holiday starting tomorrow and thus will not be running the next two performance meetings. Josh has kindly accepted the responsibility for running them however! If there are problems with the Jitsi transition I'm not responsible. ;) Etherpad: https://pad.ceph.com/p/performance_weekly Bluejeans (Assuming it's not Jitsi!): https://bluejeans.com/908675367 Mark

1 month, 4 weeks

1
0
0 0

Moving cluster log storage from monstore db

by Prashant Dhange

Hi All, We are looking for inputs on a new feature to be implemented to move clog messages storage from monstore db, refer trello card [1] for more details around this topic. Currently, every clog message goes to monstore db as well as debug/warning messages generates clog messages 1000s of times per seconds which leads to monstore db growing at an exponential rate in a catastrophic failure situation. The primary use cases for the logm entries in monstore db are : - For "ceph log last" commands to get historical clog entries - Ceph dashboard (mgr is subscriber of log-info which propagate clog to dashboard module) @Patrick Donnelly <pdonnell(a)redhat.com> suggested a viable solution to move the cluster log storage to a new mgr module which handles the "ceph log last" command. The clog data can be stored in the .mgr pool via libcephsqlite. Alternatively, if we donot want to get rid of logm storage from monstore db then the other solutions would be : - Stop writing logm entries to mon db if there are excessive entries getting generated - Filter out clog DBG entries and only log WRN/INF/ERR entries. Looking forward to additional perspectives arounds this topic. Feel free to add your inputs to trello card [1] or reply to this email-thread. [1] https://trello.com/c/oCGGFfTs/822-better-handling-of-cluster-log-messages-f… Regards, Prashant

1 month, 4 weeks

5
10
0 0

Ceph Leadership Team meeting notes 2023-03-29

by Adam King

- 17.2.6 - gibba cluster has been upgraded - saw known issue with slow backfilling, will use gibba cluster to test fix for it but fix is not targeted for 17.2.6 release - Still need to upgrade LRC - Once LRC is upgraded and everything is approved, will release rc build - release notes PR is open - cephalocon dev summit - draft schedule: https://pad.ceph.com/p/cephalocon-dev-summit-2023 - want to do some planning for the next few years here since that goes better in person - Potentially some panel involving users - cache tiering - summary of last week's discussion for those who missed it - plan is still to deprecate but not remove in reef - some docs work at the minimum will be done for the deprecation, possibly some added warnings if possible - Enforcing 2FA on github to be in the Ceph org - Not a lot of action following previous email about this - Need to do something about the bots in the ceph org - Specifically - CephaloBot @ceph-jenkins - Ceph Sepia lab robot @sepia-robot - Red Hat Ceph Storage Jenkins bot @rhcs-jenkins - Want infra team to look at this - Have cc'd Dan Mick, Adam Kraitman, Zack Cerza on this email, hoping one of them could see what these bots do and impact if they are removed from ceph org. - Discussion on scale testing - Currently, Gibba is being used for other things so we don't have any cluster with large logical scale - Might be able to get some scale or performance testing from community members, but nothing certain - Gibba could be brought back to large logical scale later if we have features that need the scale testing - Transitioning to Jitsi - Bluejeans will be unavailable as of April 1st - Discussed recording process for Jitsi meetings - Mike Perez will make some new Jitsi meeting rooms for teams who need it - Upgrade suites - Some of the upgrade suites start from tagged releases, when they used to start from the tip of the stable branch - wouldn't be too hard to have them use builds for the tip of the branch, just need to go through and change them - some of the tests are specifically peer-to-peer tests testing upgrades from certain point releases to others, so those should not be changed Thanks, - Adam King

1 month, 4 weeks

1
0
0 0

s3-select introduction blog / Trino integration

by Gal Salomon

Hi https://ceph.io/en/news/blog/2022/s3select-intro/ Recently I published a blog on s3-select. the Blog discusses what it is, and why it is required. the last paragraph discusses the Trino(analytic SQL utility) and its integration with Ceph/s3select. that integration is still on-work, and it is quite promising. Trino does not just provides a comprehensive SQL but also provides scalable processing for the SQL statements. we will be glad to hear your ideas and comments. Gal.

2 months

1
0
0 0

rbd cp vs. rbd clone + rbd flatten

by Tony Liu

Hi, I want 1) copy a snapshot to an image, 2) no need to copy snapshots, 3) no dependency after copy, 4) all same image format 2. In that case, is rbd cp the same as rbd clone + rbd flatten? I ran some tests, seems like it, but want to confirm, in case of missing anything. Also, seems cp is a bit faster and flatten, is that true? Thanks! Tony

2 months

2
2
0 0

2023

2022

2021

2020

2019

Dev March 2023