The riot features page makes it seem very "built-in" (https://about.riot.im/features#voice-video).
Recently we added the option for people to use their own self hosted Jitsi instances, if they prefer.
(1:1 calls at the moment are normal WebRTC, directly over Matrix)