> If the source is fully open (it is) than detecting and disabling backdoors is completely possible

There exists a possible world where a group of underpaid FOSS devs forked Chromium and AOSP and effectively developed it further.

But it is not our world.

> the GrapheneOS team could simply continue development of AOSP on their own.

They won't be able to do so.