Should be saving rdi + 0x0020 on windows to save the current fiber storage pointer on jump.

Certain win32 api calls actually use fibers deep down even if you don't use them. You will get a crash after bouncing around. I vaguely remember(or think) schannel is one such set of win32 functions that'll cause it.