Right, but most buyers finance with a mortgage.

The affordability is determined by monthly payments, which are a function of home price and interest rates. If home prices are up but interest rates are way, way down (which is currently the case) it can be possible that houses are still more affordable.

You have to consider home costs as down payment + monthly mortgage payment (+ taxes if you're getting specific) to understand affordability.