It is not uncommon to own olive orchards in southern europe (a family thing). I have olives too.
I never understood the obsession with oleander around these parts. It's (in my humble opinion) not any prettier than "native" ornamentals, and it's toxic to boot.
Add to that list that it's apparently an eager vector for X. fastidiosa...