Exactly this.
The whole point of semver is to address the issue of backward-incompatible changes breaking downstream dependencies (well, among important other things).
What Go is doing is forcing you to use Semver the way it is intended to be used; from the semver specification:
---
Given a version number MAJOR.MINOR.PATCH, increment the:
MAJOR version when you make incompatible API changes,
MINOR version when you add functionality in a backwards compatible manner, and
PATCH version when you make backwards compatible bug fixes.
Additional labels for pre-release and build metadata are available as extensions to the MAJOR.MINOR.PATCH format.
---
If you don't want to adhere to this, just cut PATCH versions and MINOR versions.
It's an absolute terrible idea though.
As annoying as it may seem, there's a lot of benefits to using semver the way it is intended to: it forces you, the developer, to think a little more about how you design your code.
The small amount of productivity you lose getting used to do the proper thing (i.e. cut MAJOR version, or spend more time designing your code so that it more forward thinking) will pay off in the long term.
The tiny amount of productivity you gain by not doing the right thing will come back to haunt you and make you wish you had been more rigorous.
His startup might be small right now, but if it becomes successful, their number of internal users might explode overnight and they'll suddenly wish they had used semver properly all along.