Yes. When you add a patch then increment the semver patch version number. When you add a public function then increment the semver minor version and reset the semver patch version to 0.
If you're doing something else, then you're not doing semver, and IMHO you should highlight that to your users.