OVH is in the middle of a large maintenance window. Our Jenkins and chacra instances were restarted about 6 hours ago. This has resulted, so far, in:

Jenkins builds failing because either a chacra instance went down in the middle of a build or because Jenkins was restarted without a JAVA_ARGS setting we were relying on
chacra repos being incomplete (404s in teuthology jobs)
Jenkins builds getting delayed

There were a handful of failed ceph-dev-pipeline jobs due to #1. I’ve retriggered all of those.

I will see about getting the chacra repos rebuilt but there may still be some with missing packages. Unfortunately, those will require a full rebuild. Ping me if you find a repo with missing packages and I’ll be happy to retrigger the build.

I’ve subscribed to email notifications from OVH so we have a better heads up about this in the future.

David Galloway

Ceph Engineering Labs – Infrastructure Architect

david.galloway@ibm.com

IBM