You could implement something like Certificate Transparency's "precertificates" where you store a hash of the digital signature in a public Merkle tree, so during review the reviewer's identity isn't known. But once the paper is published, the actual signature can also be published and checked against the review hashes in the paper. If they're missing or inconsistent, treat the paper as unreviewed.