It also gets you the worst of both worlds, in that you have to build both a Facebook auth solution, and store some form of user password hash on your servers
A pet peeve of mine is when I click on the login with facebook button and the site still makes me fill out my name, username, email address, and set a password. So what's the point of logging in with facebook?