I've definitely heard of cases of people who've had their Japanese citizenship revoked after the authorities found out they were a dual national.
However the level of proactive enforcement of such rules can be very variable. Dual-citizenship can be trivially hidden and nobody will hunt you down for it, particularly if you live abroad. If you bring it to the attention of some authority, though, they will be forced to take action.