Completely disagree. This is the best possible time to release it.
If it does poorly, well, so is everyone else. If it does well, then it’s because Apple are geniuses.
(the other option, of course, is to not release at all - but then they aren’t, by definition, getting into VR)