My CPU-limited nodes lost several MB/s in bandwidth, which I now suspect is caused by this.

Note that the handshake is the CPU-limited part, so a CPU-limited node benefits (in terms of MB/s) from having few clients which use high bandwidth, the opposite of these bots.