So, the legal reasoning might be to cut their losses litigating to defend rulings they think they'll lose due to the administrative error. I also suspect that being seen to roll back some regulations likely gives Lee Zeldin (the EPA admin) some political room to maneuver. He's historically be associated with anti-PFAS efforts (in Congress he represented a district with contamination problems and he voted for anti-PFAS legislation), but he's also part of an administration with a strong anti-regulation agenda, so he needs to walk a fine line.