In my first interview shortly after college, I said something about looking forward to a leadership role. A close friend mentioned the exact same thing you and the individual below did... It made perfect sense and I've thoroughly avoided saying that since. I was certainly a lot more outwardly ambitious for a few months post graduation, but much less so now.
And thank you for the upvote! Help is help anyway I look at.