Can confirm that the data is often, though not always, stored in a shared directory and that yes, many tools can/do read gzip files directly which probably hinders the adoption of better compression algorithms.
If they do then they are just probably running zcat for you for convenience sake. You can always incorporate better compression by adding it to your pipeline, and piping in uncompressed data to the legacy tool then compressing the resulting output with whatever tool you want.