I have had 2 major neck operations due to 3 fractured vertebrae so...
Listen to your doctors and your physical therapists. I did lots of fiction reading and exercised like hell when I was allowed / needed to. Eat healthy, like you normally would even without a fractured hip (although your doctors probably recommended supplements). Do activities that bring a smile to your face.
Bottom line: let your body heal naturally, don't worry too much and as most of the comments here have said, be patient.