It is the most economically viable product, which is why they dominate.
>for four to sixteen units that seems like it could be fine?
Those costs have also skyrocketed because now you have additional requirements like fire, egress, additional structural when going over two stories, etc.
It's why most new apartments are "luxury" apartments. The costs have grown so out of control that the only way to break even is to make them outrageously priced.