While it's true that it'll never work against you, it could fail to work -for- you. In that case, it has technically worked against you because you failed to realize the potential of the meeting because of it.
It all comes down to knowing yourself, your business, your clients, and your clients' businesses.
If you can't tell when to wear a suit or not, wear a suit. If you can tell, you don't need this advice.