This is incorrect, from a linguistic perspective, but it's absolutely the case that if I asked 10 of my friends to describe Ä, 9 of them would say "'A' with an umlaut".
The vernacular not matching expert terms of art never ceases to annoy people, but it's not really worth fighting, I don't think.