The bigger downside is nuisance tripping because the breaker doesn't like electrical noise emitted by some device or another in your house. I don't have any AFCIs but I've heard it's pretty common.

You'd rather have one circuit go out instead of the whole house, and if all you have is the one AFCI breaker you're going to have a much harder time identifying what device(s) is the culprit.