Linguist here. There’s no right way to understand your own language. The language is what native speakers collectively think that the language is. If they (by the way, am I referring to op now or to the native speakers?) think that something sounds unnatural, then it is unnatural to them. You can’t be wrong about this, just as you can’t be wrong about whether it feels natural to hug someone you met five minutes ago.
Everything we as linguists can do is to say that x feels natural to this many people and unnatural to this many people. However, when writing something, if enough people think that something feels unnatural, maybe you should investigate if you can phrase things differently so that more people will accept it.