Sure, but somebody will have to host the website for the "web browser based person"? Even though the audio/video traffic will be P2P, there has to be some interface in the browser?
I keep wondering whether this browser interface would be possible on a static website with all code running client-side.