This is a common misconception, so much so that whiners about anime pics is a common occurrence on 4chan. 4chan is a board primarily for anime fans and thus for example it's normal and acceptable for there to be anime related posts in all of the boards, while it's not acceptable for other topics to bleed out of their own boards.
4chan dates back from a time where you'd have, say, forums for people who like X, and that forum might also have off-topic boards for stuff like food, travel, politics, and other off-topic discussion. While there are people who are interested in specific topics in said boards, everyone on the site across all boards are expected to like X.
As 4chan is wide open and due to the existence of /b/, there is thus a constant flow of people who aren't anime fans whinging about anime in the non-anime boards, who are generally ignored or rebuked.
I haven't been a regular visitor for some years, so some cultural loss might be expected, but certainly at the time that this happened, 4chan was still solidly an anime community.
Here are a few examples (which also demonstrate that while it's hard to define 4chan users in any way simply because it's an undefined set of random people that might visit and leave at any time, the only commonality would that most (not all; the so-call "redditors"/"tourists") are anime fans:
https://4archive.org/board/qa/thread/382065/whats-the-deal-w...
https://4archive.org/board/qa/thread/564357/its-acceptable-t...