Can we make sure that the teuthology logs and ceph logs are available for the AI bots. I love that they're training LLMs on Ceph debug output. :) On Wed, Aug 5, 2026 at 11:02 AM David Galloway via Sepia <sepia@ceph.io> wrote:

I’ve deployed Anubis on the reverse proxy host that serves pulpito/pulpit-ng to block the botnet attack.

RCA: A scraper botnet (~95K unique IPs, spoofed browser user agents) ramped pulpito-ng.ceph.com from ~1K to 40K requests/hour starting around 6am Eastern, including ~99K hits on job history pages. Every one of those pages makes pulpito-ng call paddles' /jobs/?description= endpoint, whose LIKE '%...%' query scans the entire 8.4M-row jobs table at 3-5s each. That kept all 16 paddles gunicorn workers permanently busy, so nothing got answered, including the liveness probe, and Openshift kill-looped the pods every ~7 minutes.

From: David Galloway <David.Galloway@ibm.com> Date: Wednesday, August 5, 2026 at 9:42 AM To: sepia@ceph.io <sepia@ceph.io> Subject: Paddles/Pulpito Outage

Paddles availability has been flapping over the past few hours due to a botnet attack. I’m working on setting up some form of mitigation.

-- David Galloway Ceph Engineering Labs – Infrastructure Architect david.galloway@ibm.com IBM _______________________________________________ Sepia mailing list -- sepia@ceph.io To unsubscribe send an email to sepia-leave@ceph.io

-- Patrick Donnelly, Ph.D. He / Him / His Red Hat Partner Engineer IBM, Inc. GPG: 19F28A586F808C2402351B93C3301A3E258DD79D