You have to think about the mechanism if you remove a file. Ansible is imperative like a shell script, not declarative.