It definitely is an American evangelical/fundamentalist thing. (Might also be elsewhere, I can't say) The history is that in the 1800s many seminaries, beginning with German seminaries, began teaching theology that differed from traditional orthodoxy. In the early 1900s a counter-movement emerged in the US which insisted on five fundamentals (hence "fundamentalist"): the Bible is "infallible" and inspired by God, the virgin birth of Jesus, the bodily resurrection of Jesus, that Christ's death atoned for our sins, and the reality of Jesus' miracles. It seems that over time the first point seems to become a literal interpretation of much of the Bible, in particular, Genesis 1. I assume this is because the Modernist theology has to symbolize the Bible if it wants to harmonize the Bible with Modern ideas about there is no literal God, miracles can't happen, etc., since a God that exists and intervenes (e.g. miracles) is kind of the whole point of the text. I'm not totally what happened or why, but it seems like the fundamentalists simplified things from "these are our assumptions" to "this is what the Bible says". YEC is the poster-child, but an unnuanced, one-sided view is endemic. I think evangelicals were originally more nuanced, but over time seem to have merged with the fundamentalists.
However, I don't think the Church has historically had an official position on how long creation took. I know some early Church fathers figured Creation took 6000 years: "a day is to the Lord as 1000 years". I also assume that "1000 years" had a similar feeling as "a million years" to us: you can do math with it, but a million years is pretty much an unimaginably long time.
It is also well-known that it is a hermeneutical error to interpret poetry literally, but there is little recognition, at least among evangelicals/fundamentalists that Genesis 1 is actually poetry, and hence interpreting it literally is what I would call a hermeneutical gaffe.