I finally found a link from just googling around that took me directly to a page where you could add a security key. But the catch was that I had to have an active session if I wanted to add a key. If you weren't already logged in in another tab, it will redirect you to the BofA dashboard after you log in. From all the time I spent, there is no way to get to that page from the BofA web dashboard. Very frustrating and annoying experience. But atleast it is out of the way now.
FYI you can only have a max of 2 yubikeys.
At least it is mentioned here: https://www.foerde-sparkasse.de/de/home/service/fido-token-m...
However, this is a website I'd say my mother to not go to
Morgan Stanley is the only bank/financial company I know supports hardware keys.