Even if it's only rare, the test also shows clearly to a reviewer that the bug has been fixed.

In my opinion, as soon as a test suite finds a bug it has added a lot of value, even if it's rare.