Didn't try it until I moved to Bangkok in my early 30s. First time I had it I gagged - - not because I found it disgusting, but rather, it was just so different to my American palate.
Second time it tasted of a onion based custard that I could stomach, but live without.
Third and all subsequent times, it tasted like ice cream with a slight pungent background that I needed every night. I was hunting for the good stuff as well as any local.
You don't have to grow up on the fruit to enjoy it, but it is definitely an acquired taste that can be gained in the adult years as well.