PayPal is a bank in the EU and has a banking licence from Luxembourg's CSSF.
I stand corrected!
In the US, yes (in most cases PayPal is legally a money transmitter), but as sibling comment pointed out this is not necessarily the case in other countries with stricter legislation.
Starbucks isn't a bank either, but they also kind of are [1].