<postal code> <prefecture> <city> <district> <num>-<num>-<num>-<apt. num>
Or in English style:
<num>-<num>-<num> <district> <building name> <apt num> (optional, can also append the apt number to the 3 numbers on the top line) <city> <prefecture> <postal code>
The 2nd <num> is the "block", the first is the "chome" which is a division of the district within the city, and the 3rd is the building number. Otherwise, you're correct. The streets have no names (except for big thoroughfares, but these aren't used for addresses anyway), and buildings have numbers, which are usually assigned by when they were built.