Hub motors make wheels quite heavy, which means that there's more unsprung mass [1] in the vehicle, making it less responsive under acceleration/braking and more noisy and sensitive to vibrations.
They're common in electric scooters, bikes and bicycles though.