When I was a kid I found it confusing people would confuse there, their and they're – or rather being taught that people confuse them. I'm not sure whether it was due to me being more literate than verbal or not but "they're" at least has always been distinct to me. Maybe it's due to accent changes. I used to pronounce bull and ball the same.