Who was the first US president to speak out against slavery? (Hint: it wasn't Abe Lincoln.) I think this factoid will ultimately matter about as much to the average American after we've had 5 more black presidents.
Still, I think it's pretty important that Obama was at least partly black - it showed that it could be done, and I'm sure he inspired millions of people (black and otherwise).