I can see that. In the year that I've been using Camo, I've never personally had that issue, but I can see it being problematic if you're constantly needing your phone for a second factor all day (consider a yubikey?).
I'd say that another _advantage_ (IMHO) of Camo is that I don't have my phone to use for distractions while on calls, so that's a pro in my book.