Not having the time to concern yourself with politics isn't a position of neutrality or agnosticism. You can only adopt that position if the status quo of a society provides you sufficient protection, stability, prosperity, etc. to allow you to tune it out. If those conditions aren't true, it's not possible to "not concern yourself with politics" in a Maslow's hierarchy sense. And so doing so is unavoidably a tacit defense of the status quo.