What you want to get down to is the intrinsic dimensionality. Go below that and you start discarding useful information.