> It all comes down to their ideology, which in a nutshell comes down to: maximizing profits and (perceived) short-term gains for its core constituency (i.e. business elites)
That's not it at all. It politics, not ideology.
The fossil fuel industries in the US are huge. They employ millions of people.
But those industries are rightly under attack for causing climate change and generally destroying the environment. If we did the right thing and priced carbon and prohibited pollution then they would be uncompetitive. Those forms of energy would cost more than solar or nuclear or something else and those people would lose their jobs.
Which is what needs to happen, but did you really think they'd go down without a fight? Any politician who wants to win an election in those districts is going to be under pressure to take the "screw the environment to save the oil industry" position. It happens that the oil and coal deposits are disproportionately in red states, so that's where those constituents live and those are the politicians saddled with that voting block.
This is a different motivation than an ideological preference for actual deregulation, which would have them e.g. refusing to regulate the tech industry rather than calling for some ridiculous anti-encryption nonsense.
To get rid of it you need to do one of two things. One option is that when the other team gets in they need to do a better job of completely smashing those industries into smithereens so they no longer represent a powerful constituency (e.g. Obama could have done this but didn't), but they pay a short term cost for doing that. They'd almost certainly lose the next election because in the short term the people whose jobs you just destroyed are going to be angry and resentful. You also run the risk that after you lose the election the other team comes in and undoes what you did.
The other option, and this is the really great one, is that you also pick some evil constituency of the other team and have everyone get together and destroy them both at once, so that politically it cancels out. But that requires a level of bipartisanship that isn't currently very common. It's everybody doing something which is good for the country even though it yields no partisan advantage, and that's not really how modern politicians think, so how do you get it to happen?