I took 3 months off for my first and 4 months for the second. My wife was pretty miserable through the first month. Breastfeeding is exhausting, as well as being woke up at various time of the night. I'm glad I was home so I could take care of the rest.
I agree that afterwards things got easier, and we were able to enjoy some vacations.
But still there is a huge difference between spending a few hours at the beach with the baby and going back to work whole day.