If it's the same author I found based on a cursory search from your profile, then "famous" is a bit of a stretch.
> Where I think it hurt was we didn't do any group social activities and lived in remote places
I got a similar feeling reading about Chris Paolini. Homeschooled, raised in a remote place. Fed a lot of his early life experiences, particularly travel, into his novels but felt alienated from other kids.