Yes you can! I do a lot of banking on GrapheneOS.

You might want to check this site out to see if your bank app works though: https://privsec.dev/posts/android/banking-applications-compa...

Even if your app isn't listed there, there's still a chance that it'll work. Mine isn't listed on that site, but it still works with no issues.