Yeah, there is undoubtedly a genetic side to it. My teeth decay rapidly -- as an under-two toddler, I had to undergo full anesthesia for a dental rehabilitation. Though neither my siblings nor my parents have very bad teeth, I've always been the exception (I guess I got just the right mutation). My pediatric dentist was always expressing astonishment at how quickly my teeth decay.
You know how dentists say "Hey, I can tell you drink a ton of soda, you need to stop"? I would get told this every time I'd go in for a cleaning, despite not drinking any soda and very little fruit juice/other sugary drinks for many years, 90%+ water only.
Fast forward 20-something years, and 2 of my daughters have had to undergo a dental rehab similar to mine at very young ages (though not quite as young as me), despite the stringent dental regimen my wife enforces to prevent this fate. There's no doubt that they got my bad teeth genes.
We're talking young kids here, ages 2-3 at the time of the operation (I was 18 mos. when I went down). They don't eat an inordinate amount of sugar, and as I stated above, my wife is very thorough with their dental hygiene. The water is fluoridated where we live. A lot of kids this age surely have much worse diets and much worse dental hygiene, but their teeth seem to be problem-free for many years.
Personally, I've had tons of fillings, 7-ish root canals, two teeth fully extracted because they were past saving, and several that badly need work and I'm not even 30 yet. Pretty much the only people living with worse teeth are opiate addicts.
I hope I win the lottery some day so I can get a mouth full of implants and be done with it. I hear the going rate for this is about $75,000.
A lot of people refuse to believe that genetics play any role, but that's absolutely not consistent with my experience, nor the opinion of most of the dentists I've had.