If the phone not having a internet/network coverage was a problem, my idea could be useful. It also makes the phone a kind of hardware token, a user can login only if he has his phone.
However from the responses it looks like this is not an issue and I'll probably not work further on this idea.