I lived in Osaka, which is ostensibly the crime capital of Japan, for a few months. I have never felt more safe in my entire life. Yes, there were the characteristic Yakuza businesses, but I would have been surprised if I dropped my passport at 2 am and it wasn't returned.