Freedom of assembly is at an equal level of importance, legally, in the USA, to freedom of speech; they’re set forth in the same amendment.
Culturally, freedom of assembly is, if anything, MORE significant for Americans than freedom of speech, it’s just not relevant to Internet forums, so you don’t hear it much discussed online.
Neither right is absolute.