For anyone wanted to try it out, Firefox and Chromium-based browsers have flags to enable it.

Firefox: about:config, image.jxl.enabled

Chromium: about:flags, Enable JXL image format