I do agree that there is some continuum of conscious experience between certain animals up to humans. I even believe there is an extremely remote but real possibility that other organisms such as plants, fungi, even bacteria, have some sliver of internal life that could resemble our consciousness.
But panpsychism goes WAY beyond this into a mush that makes no sense. Rocks and atoms very obviously are not conscious, and any non-religious theory of consciousness that posits that they have to be, even a tiny little bit, is in my opinion self-evdiently wrong (e.g. IIT).
Of course, if we want to posit that some form of god exists beyond physical phenomena, panpsychism is valid again.