IIRC You can get rid of the switch delay using Yabai[1] but you will need to disable SIP which may be a no go if you have work assigned MacBook

[1] https://github.com/koekeishiya/yabai