I believe you hear everyone in the hangout session. It shows you in main screen whoever is talking the loudest (i.e. the focus), but you do hear everyone.