You can remove the app. Its not permissions for life.
If Facebook had a history of strong privacy protection and strict opt-in policy to information sharing, this wouldn't be so bad. But since Facebook has the completely opposite history, including Zuck coming right out and saying that he would prefer all Facebook user info to be shared, I'm not going to trust Facebook to keep whatever I want private private.