Yes, the latency increases, the audio quality worsens, and I see the following messages in Pipewire's logs:

[W][30498.719355] spa.alsa | [ alsa-pcm.c: 2478 spa_alsa_read()] steinberg_ur44_mono_in:UR44,0,2: follower delay:4042 target:4832 thr:256, resync (374 missed)