The point of the tooling is that you describe what you want your deploy to look like, and it updates the deploy to match the description. If you delete something from the description and it stays running, that would be very confusing.
It works ok in practice.
You describe what you want your deploy to look like, and that's what gets deployed. It doesn't start removing/deleting things to match.
It might take resources offline or leave them orphaned, but never delete them.