Seems like you can add people to your community but not remove them.