So this might seem weird, but there are many people who do not at all feel that way. I can't even begin to imagine what feels condescending about someone using "so" as a filler word.
For people with a bit of social anxiety, it can serve as an easy and comfortable lead-in to share a thought when they can't think of a better way.