If there were extra-terrestrial intervention, it would only have needed to be a one-time event.
And it wouldn't be technologically hard to do it such that no trace remains over those timescales.
So, yes, that's "crazy". On the other hand, it's unfalsifiable in the absence of other theories.