I asked around and it seems like you're right about it not being a resource issue (network or computational). The issue is that the bridge is unstable and having tens of thousands of matrix.org users join/parting every now and then disrupts the IRC channels.