If the team is mediocre, you'll hate yourself for taking the job as they squander their big opportunity and the company falls apart or stagnates.
Or they're building a product that doesn't need "class A" software engineers to build (of which there are many) and you'll be bored building a CRUD app or similar.
Or the team is fine and you'll be seen as the arrogant one, as silent resentment always shines through. You don't want to be "that guy".
Either way, there's no scenario in which it sounds like a good fit, from the description you've provided.
If you're genuinely one of the class A players you describe, there's plenty of other opportunities that will make you happier in the long run.