Lets not forget the benefit of the automated test army known as CPAN Testers. You release to CPAN they test it across many versions of each major operating system Windows, Linux, Mac OSX, FreeBSD, NetBSD, OpenBSD, DragonflyBSD, etc...
It definitely would be beneficial if it were on CPAN. However they would need to add tests to the repo first :)