It's probably not as easy a swap as tensorflow, but stan would be a natural fit for bayesian inference, and its NUTS sampler should be very performant.

http://mc-stan.org