Yes, but you get an automatic patent grant if you use OpenJDK; I presume this grant remains valid after you've applied a large number of patches.

But yes, you can't "start over".