I may be off the mark with what you believe, but just in case:
It's a common misconception that the big bang originated at a specific point. The big bang seems to have happened everywhere simultaneously, so it wouldn't be true to say that gravity is pulling everything back toward a point of origin.
Here's an excellent video on misconceptions about the universe: https://www.youtube.com/watch?v=XBr4GkRnY04
(Ironically, the video was created because the creator was a scientist, yet they fell into the trap of believing something incorrect to the point of being publicly mistaken about it. The universe is extremely counterintuitive!)