Not really a concern, honestly. The cool about Stoicism is that you can just dial up your happiness without any regard to external circumstances because you and you alone are responsible for your emotions.