>> a public domain codebase with some GPL code

> which would still be a GPL codebase

If the GPL-licensed parts have become so insignificant that they can easily be replaced, it effectively no longer would be.