The panics I get are related to Thunderbolt, so I suspect it's an issue with the Thunderbolt kernel drivers. I run two external Apple Thunderbolt monitors and that's at the core of most of my issues.
I suspect RAM issues. OS X isn't great if - say - Chrome eats all the memory. And if the RAM itself isn't rock solid, you will get crashes.
A lot of issues went away when I installed 32GB.