I can't say I haven't looked back; occasionally I'll fall back to Google when DDG is having trouble finding what I want to find. Even then, it's certainly less than 10% of the time (maybe even less than 5%), and I find when I have to do that, Google's results aren't super high quality either (though most of the time the quality is just better enough that it turned out to be useful to have the Google fallback).
As for just "getting the answer", I suspect you're right most of the time, but I really don't mind clicking through the first few results links to see the answer. Figuring out the best answer and putting it in-line with the search results is a nice-to-have for me, but certainly not essential.
Also note that I'm making a trade-off here: lower search result quality in return for not having my search history tracked. For many people, I imagine they don't care about their privacy as much and will make the opposite trade-off. That's fine; I'm just glad we have good enough options so people can make that decision and not be forced one way or the other.