So, to jump into this thread - we seem to see the same problem as Harald on our cluster
here in Glasgow, except our "worst case" OSDs are much worse than his [we get up
to ~tens of GB in buffer_anon].
Activity is a mix of reads and writes against a single EC (8+2) encoded pool, with 8MB
objects.