Would you be able to tell apart a pizza from a top italian restaurant and a microwaved instant pizza? The differences between top-grade sushi and bad sushi are just as obvious, you really don't need to be an expert.
By the way, in japan there is a highly developed market for fish with many levels of quality, so the expensive restaurants get the best parts of the best fish and the leftovers end up in cheaper places.