What's another few thousand years? People haven't been taking Genesis literally since at least Origen's day (~200 AD).
---
For who that has understanding will suppose that the first, and second, and third day, and the evening and the morning, existed without a sun, and moon, and stars? and that the first day was, as it were, also without a sky? And who is so foolish as to suppose that God, after the manner of a husbandman, planted a paradise in Eden, towards the east, and placed in it a tree of life, visible and palpable, so that one tasting of the fruit by the bodily teeth obtained life? and again, that one was a partaker of good and evil by masticating what was taken from the tree? And if God is said to walk in the paradise in the evening, and Adam to hide himself under a tree, I do not suppose that anyone doubts that these things figuratively indicate certain mysteries, the history having taken place in appearance, and not literally.
Origen via Ante-Nicene Fathers Vol. 4, p. 365
http://www.ccel.org/ccel/schaff/anf04/Page_365.html