While I don't disagree with you, I think at some level we need to remove the "lens" with which we are appreciating poetry or any other art-form and to appreciate it for the art itself. In that regards his privileged upbringing or whiteness shouldn't take away from the merits of his actual poetry.