I don't think it's any less science, inasmuch as science seeks to explain the natural world. It's just at a higher level of complexity and a different point in the learning curve than more externally observable levels of science.
Would we say that Copernicus was a charlatan or not a scientist because the heliocentric model turned out to be wrong? As you acknowledge, Freud pushed the collective understanding further.