In theory you wouldn’t even need to load firmware- you could just manipulate the relevant registers directly over SWD for the silliest IO expander.

In our case it was the only choice. I’d say we’d use UART now but the RP2350 can pretty much do it all in one chip.

I think RP2040 does not support UART booting.