You can check why it’s re-encoding, there’s some guides out there. In my case it was the subtitles! Turns out Safari can’t handle all types of subtitles. Might be worth looking into it.
That said, we are a family so I can’t get everyone else to stream to mpv, so Jellyfin works better for everyone. mpv is also a great piece of software, plays everything!