Skaffold does much of what you are looking for.
K8s manifest autoloading works, and IDE support is somewhat there. Not sure about build caches, should be possible I think.
Only problem is the Kustomize overlay syntax is a bit hard to grok. You can also use Helm or raw kubectl deploy commands.