I used to remote play on a second user on the PS5 and then used the controller connected to my PS5 to log into my main user profile and then game from there whenever I wanted to stream something to my friend(s). That way the issue of needing to connect the peripherals to the computer was solved