It's P2P, like most videoconferencing. The server part is just for session management.
Well, if there's only 2, maybe 3 of you – anything beyond that is going to use a server to host the call for reliability.
Do you mean for more than 3 - the call/video is routed through the server and would consume server bandwidth? If so how is jitsi paying for all this if it is free?