So, I ended up checking all datalog shards with:

radosgw-admin data sync status --shard-id=XY --source-zone=us-east-1

and found one with a few hundred references to a bucket that had been deleted.

I ended up shutting down HAProxy on both ends and runningĀ 

radosgw-admin data sync init

This seemed to clear out the shards and things are running normally now.

radosgw-admin stale instances list

didn't find these for some reason.

thx
Frank

On Wed, Oct 30, 2019 at 2:55 AM Konstantin Shalygin <k0ste@k0ste.ru> wrote:
On 10/29/19 10:56 PM, Frank R wrote:
> oldest incremental change not applied: 2019-10-22 00:24:09.0.720448s

May be zone period is not the same on both sides?



k