Nonsense. One can have "refined taste", which means that you can detect all the subtleties of a particular kind of art (e.g. modern abstract art, or modern jazz) that I cannot. My taste in other fields is considerably more refined than the person who likes modern jazz and abstract art; perhaps they cannot stand any science fiction, whereas I have strong opinions about which is good and which is not.
The phrase "good taste" implies there is one standard, one dimension on which one can rate art, but clearly there are many different ones, depending on ones tastes.