I'm still learning about Bayesian Stats myself, but so far I've really enjoyed Think Bayes[0] by Allen Downey. He's a great writer and one of his other books was recently on the front page here.

0 - http://www.greenteapress.com/thinkbayes/