The only problems I could see is that some services that ONLY auth via Facebook will not work.

Having stated that, consider if you eliminate Facebook from your life and have issues on the web, and the answer to those issues is not "create a Facebook account" then it should be relatively safe to remove Facebook from your life.