There is no practical reason why a forum could not have an optin-optout-delete API/protocol/etc that all search engines/archivers should follow.
When I delete something all should follow the orders and those that do not need to be responsible for it.
Of course there are plenty of business reasons why engines don't want to do it.