In FFmpeg, we have found in the past that functions written in pure assembly are typically a few % faste than those written in intrinsics. Depending on your use case, that may make it worth it.
The obvious disadvantage is that pure assembly is harder, so writing functions takes a bit longer.