Not to keep all of their copyright, just their commercial rights. I say if the thing has been out of print for say, 15 years, verbatim distribution should be allowed.
Copyright itself only lasted about 15 years originally, which is a reasonable amount of time to commercialise a work. If you haven't done anything commercial with it in 15 years, it seems reasonable to me to allow the public to enjoy the work.