> Therefore, my notes end up a muddled version of the source material and I’ll just use the source material for reference, making the initial note take a big waste of time from the standpoint of having an easy reference available.

There's more value to note-taking than just having a reference afterwards. The act can be helpful with retention. I don't reference a lot of my notes.