Hm, this is an interesting peek into your world view for me.
To me, it does not make sense to describe yourself as a "founder", "startup builder" or even "entrepeneur." That is not what you do. You are a founder of something, and that is what I am interested in if I ask that question.
I have no idea whether people actually say something like that, but I can certainly understand someone asking for more information if the answer to "what do you do?" is "I am a founder" or "I work at a startup" instead of "I work for Goldman Sachs." I would!
So, anyway, perhaps part of why you seem to get into the types of conversations described is the way you initially respond.