I think you may have fallen victim to a common misconception of how ideology actually functions.
The most affected by ideology aren't the ones consciously committing to a cause. Ideology is strongest precisely when you think you're outside of it - when your ideological commitments have become so normalized that they are completely invisible to you.
There is no such thing as being unideological, whatever you perceive as such is just a reflection of your own ideology.
If you'd like to delve deeper into the theory of ideology and how it functions, I'd recommend the works of philosophy legend and ideology expert Slavoj Zizek.
There's his seminal work, The Sublime Object of Ideology, which goes into this at depth, but is a very dry and academic read. If you'd like something a bit more digestible, I would recommend the movie The Pervert's Guide to Ideology, which uses a more pop-sci approach of dissecting popular movies to demonstrate their ideological function.