Also a lifelong musician here, and I think you're completely wrong about harmony. Western music (assuming that's what we're talking about here) IS directly derived from harmonic progression. It is truly the core of the music. The underlying chords are the obvious harmonic progression. Melody is just an expression of underlying harmonic structure. Rhythm is meant to emphasize the changes and movement of harmonic structure. Timbre itself is meaningless without a note to carry it, and a note is meaningless without the harmony it implies.
All of the many parts of western music serve the harmonic progression. This is because human emotion attaches itself most strongly to harmonic progression, and music is the art of manipulating human emotion through sound.
>A set of great musicians can play a single note for minutes and get it to sound amazing, this has always fascinated me more.
Someone already asked, but give me an example.