Most consumer GPUs have a limit on the number of video streams their hardware encoder can handle at once, and in some cases the limit is as low as 2.
With that being said, its trivial to bypass with tools like: https://github.com/keylase/nvidia-patch
Regardless, this does throw a spanner in the works for a video based game streaming solution for P2P multiplayer.