True, just like it would be in poor taste to stick a beautiful ornate green column in a building where it doesn’t belong. Beauty requires harmony on the collective level, a cacophony of individually beautiful things can be ugly as a whole. We don’t want eyesores like we don’t want a wrong note in a symphony, though the same note might fit well in a different symphony.
Not a matter of opinion and not in the eye of the beholder, beauty is almost entirely objective. “Good” taste / “bad” taste may be our way of saying how much one has jammed the frequency in his brain that disables himself from perceiving beauty.
A stronger way of saying this, which I believe to be true, is that no two people with good taste will have strongly divergent views when evaluating the same thing, whether that be a piece of elegant software or Shakespeare or Bach.