1. You can create throwaway PGP keys, it's not like they can definitively identify you
2. You can encrypt messages for target PGP public key(s) without actually signing them
It's a good way to prevent people from snooping on your messages. Why do you think it's a bad idea?