Yes, even though protobuf is a binary format, it is slower to parse than JSONs with simdjson. Counterintuitive, but that is the power hardware acceleration :)
I know about fast_float (which is by the same author as simdjson), however my believe is that binary format is impossible to beat here.