Also, John Kruschke's "Doing Bayesian Data Analysis", aka the "Puppy Book", is a gentle introduction to Bayesian inference. It is very readable, especially with regards MCMC.