Are you already aware of the PipeWire batch flags which add additional latency to USB audio devices (dependent on ALSA period rather than quantum)? https://pipewire.pages.freedesktop.org/wireplumber/configura...
[W][30498.719355] spa.alsa | [ alsa-pcm.c: 2478 spa_alsa_read()] steinberg_ur44_mono_in:UR44,0,2: follower delay:4042 target:4832 thr:256, resync (374 missed)