I don't know if its just me, but the GIFVs embedded on the page dont load for me, unless I click on them to open them in a page on their own, and the second one doesn't play even in this case.
Firefox 32.0.3 on Linux
Firefox 32.0.3 on Linux
FF on Windows (32.0.2) does support H.264, and the GIFV files play as expected. IIRC, FF on Android was the first version to get H.264 support, which it's had for some time now.
EDIT: You can check codec support for your current browser+platform at YouTube's HTML5 page, below. I briefly dug around in Bugzilla for this issue, but haven't found it yet.
There's also an about:config option "media.gstreamer.enabled" which needs to be set to true, but I don't remember ever having to set this myself.