I don't think it's an FU to them. You can get a much better rate than 4.15% right now, which means they are just using your money to buy those things to the maximum extent possible. Shop around.
If you don't want to deal with some random bank and their crazy password requirements, you can probably buy CDs through your ordinary brokerage account.
Finally, if you want to FU a bank, depositing your money there isn't the best way to do that. Start spreading rumors that Apple Card savings is about to be insolvent and get everyone to withdraw their money. That they hate. Ask Silicon Valley Bank.