Without doing the math - Djokovic is such a strong player that even if he's only returning a quarter of your serves, meaning you're 3/4's of the way to winning your set (I don't tennis, sorry if I'm getting the terms wrong), he's still probably going to beat you.