The books recommended seem to have less than stellar reviews, unfortunate
Realistically, arabic is difficult, and actually speaking street arabic is frustrating.
Source: Currently doing arabic, spending the month in Jordan on vacation doing an arabic intensive, using al-kitaab in both classroom settings and self study.
Arabic is, however, definitely terrific. I'm definitely going to blow all my vacation days next year to come back again.