In an old post (in 2009)[1] from their blog, they host their stuff on Rackspace.

[1] https://github.com/blog/530-how-we-made-github-fast