No fun, and likely life threatening. With a max speed of about 2 1/2 knots with a clean hull, the little boat isn't fast enough to sail out of the way of heavy weather.
Once in a big storm, I can't even imagine the beating one would take inside that tiny craft, sliding down the face of a monster wave, crashing into the trough at the bottom, getting rolled. But perhaps his hull and rig design isn't subject to the same broaching and capsizing forces as a larger monohull...
I'm curious to read more about the design of the boat, his equipment, procedures and planning. Though it's best not to judge from a mere photo, there were several things visible in the images of the craft and video of his attempted departure that seemed counter to good seamanship.