No, you can't disable the PRs tab; you can disable any tab except Code and PRs. Torvalds famously complained about this because he handles pull requests through email, so all PRs on his Linux repo are useless.
PRs cannot be disabled.
...without archiving the repo.
Archived repos however have that ugly yellow warning.
Can you still push to the repo? Perhaps via --force?