Your board holders also have a significant input on your success. If they hold the board, but let their arms flex, then they absorb too much of the energy of the strike. They can make it easier for you as well, by flexing the board inwards towards them.
I've gone through boards with a one inch punch with barely any effort, and also failed several times, and it has always been down to the person or persons holding the board for me.