I think banks / insurance companies are looking for solid math skills. If you can learn / work with higher math for physics, you can work with financial math.