You can but neglect of duty can doubtless happen when you are overwhelmed with just trying to survive yourself fending off an invasion from the adjacent territory.