I think you are exaggerating, conflating "checks" with "electronic transfers from my (checking) account".
IRS has an excellent electronic debit system. Sure, the money comes from my checking account. Are you saying that is the same as a check?
> Paying the gas bill. My gas company charges $5+ to pay by credit or debit card. > Paying the electric bill. The electric company charges $5+ to pay by credit or debit card.
e-pay by the bank... is the same as a check? Maybe...
The whole thing about the rent is surprising. I'm surprised you don't get billed for checks. I had a direct-debit-only landlord recently. Surcharge for everything else.
You forgot: your cable company also wants direct access to your bank account and will give you $5/month for the privilege. So consider that a fee for paying any other way.