Someone told me the other day I should use a foot pedal, and then I remembered I already had an Elgato one under my desk connected with my Stream Deck. I got it very cheap used on eBay. So, that's an option too.

Scroll Lock is really good key for that in my opinion. If your keyboard does not have it exposed then you can use some remapping program like https://github.com/jtroo/kanata

I have a Stream Deck and made a dedicated button for this. So I tap the button speak and then tap it again and it pastes into wherever my cursor was at.

And then I set the button right below that as the enter key so it feels mostly handsoff the keyboard.

Right option. Push to talk

Great question. I'd love to know if anyone has had any success with handheld buttons/bluetooth remotes or similar, too.

Can you please teach me how to use the CAPS LOCK key as a push-to-talk?