Can confirm. No Output Caching rules defined, I am still able to reproduce crash.
[EDIT]
What is handy is that it appears that disabling "Enable kernel cache" takes effect immediately. No iisreset or server reboot required in my testing environment.
Yes, unticking that checkbox works for me instantly.
Damnit. I'll double-check on my side too and update my answer accordingly. I don't want people to think they're safe if they're not!