hmm, if that is the case - why would companies be having me do 5 rounds each with 1-2 people on each round?
That should be a huge factor in your decision.
If they're this messed up just setting up an interview cycle, it will not be any better once you start working there. In fact, it usually gets worse.