You can argue about what is more important for your project, but the worst part is that npm doesn't give project owners to decide otherwise.

As kjksf already stated, patch versions can introduce security vulnerabilities too.