The classic proof that it's about audience effect is that arenas where the audience is further from the field have smaller home field advantage.