Yes, the baby is in fact not feeding most of the time. You can easily find several hours a day during which you can bond with the baby, I'm pretty sure your wife is going to be supportive in this effort.

(It's our second kid)