Frankly, you don't have to take my word for it. I suggest doing some research on how mood and tense work in linguistics. It's not clear to me that you understand what these terms actually mean. Maybe I'm wrong.
The point I am making, is that by the definition of mood, "inferential" simply has to be a mood. The point of using it is to suggest a particular relationship with reality ("I didn't see this, but I heard it second-hand"). That's modality, i.e. mood. It also happens to restrict the temporality of the verb to the past.
> It clearly transmits the essential time information and also adds mood no-confirm structure on top.
What you seem to be referring to here is the actual vocal pattern that you attach to a verb root to signify gossip. Of course, word endings can convey both tense and mood, just as they can convey both gender and number. But they are still separate concepts.