Since this year you won't be allowed to do that anymore - since backwards compatibility behaviour allowed app developers to avoid privacy protecting features like runtime permissions.
"Existing apps that are not receiving updates are unaffected. Developers remain free to use a minSdkVersion of their choice, so there is no change to your ability to build apps for older Android versions."
[1] https://developer.android.com/distribute/best-practices/deve...
> As we announced last year, Google Play will require all app updates to target Android Oreo (targetSdkVersion 26 or higher) by November 2018.
https://android-developers.googleblog.com/2018/08/introducin...