Even without waking up or handling an issue, a silent on-call also has a psychological tension and should be compensated with time off.