That's interesting - I have subtitles on at all times (I am Swedish, we never dub adult content so I have used subtitles for a very long time), but when I do watch children's movies with my kids, they are dubbed, and then I find having subtitles on is extremely annoying.
I cannot stand having subtitles in the same language as the dialogue, but which differs in phrasing/content. It is very distracting to me.