Do a scrub every once in a while. Mount with discard=async or turn on systemd's fstrim service if you're using SSDs.

If it would actually affect performance, turn on autodefrag. Be aware that running a manual defrag, instead of using the mount option, will break reflinks.