this book:
Programming Massively Parallel Processors by Wen-mei W. Hwu , David B. Kirk , Izzat El Hajj
seems to be tailor mode for folks transitioning from cpu -> gpu arch.