Stephen Smale scored a Wolf Prize, a Fields Medal, a Sloane Fellowship and a slew of other accolades off the back of mediocre grades at the University of Michigan (a fairly decent public research uni I've heard but not as far as I know an "elite" school).
Looking around there's many a high achiever that missed out on a US Ivy League placing.