This seems like a useful practice. Do you log how often this happens and which task is the winner? It seems like without that, you may not notice actual issues.
Usually, it doesn't matter why the consumer finds it slow; it could be anything from an unusual I/O issue (AWS is notorious for brief but painful networking issues) to a VM peer suddenly becoming ill behaved before being throttled.
They're also notorious becuass ECS is SO BAD.