I also want to bring into light that Jellyfin is not very secure either [1], its sadly not in a great place to replace Plex still.
It might not be in a great place now, but I'm not sure that's necessarily a reflection of the product
That would mean running a publicly accessible instance would be ill advised if you can about the privacy of what you host. Plex on the other hand somewhat encourages publicly accessible instances, so you can listen/watch while not at home.
(The caveat being, certain plugins disclose media to Plex but arguably that's a first or second party not some rando on the internet scraping stuff)