This sounds a lot like Haiti. I was there on vacation for a couple of weeks. In general, Haiti dirty and poor, but there were some truly beautiful places. Unfortunately, only a few of them are actually available if you aren't there on either a cruise, or are friends/connected with the local 'bourgeoisie'.

One of the places that stuck with me the most is Kay Winnie in Seguin. It's a house, built by a man who moved there from the city in order to protect one of the last forests in Haiti. He grows and plants saplings to grow the forest. Unfortunately, you need to hike quite far or drive through incredibly rough terrain to get there.