The US isn't exactly known for it's fair and perfect legal system (particularly if you're brown), so the fact that Japan's numbers are even higher says something.
That means the country is arresting and bringing the wrong people to trial.
In an ideal world you're only arresting and convicting people with clear and obvious guilt. That would probably look like a society with very strong individual rights, extremely low (near 0) bias and a high conviction rate.