Not really a big deal in competition matches because each team has to play against every other team twice. Once at home and once afield. It balances out.
But it leads me to some musing: if we could remove the human element and replace it with infallible decision making AI would it improve the sport? In football they're trying to get there with cameras.