Not very meaningful to create yourself a problem to heroically overcome it later. You can already create enough problems unintentionally.
And not using special chars is cheap, as by requiring a min-length of 13 instead of 12, you can get an even greater level of security.