I'm honestly curious, this topic (how people arrive at their morality) fascinates me. We would probably agree a lot (I don't eat meat mostly out of a similar logic).
Why innocence? How does innocence make a life more valuable? It's true that the kid has done nothing wrong, whereas the 40yo has sinned thoroughly, but on the other hand the kid has done nothing good for the world, and the 40yo probably has.
And vulnerability? If a high-speed train/cancer/thug is going to kill a 40yo and a toddler, how does the increased inherent vulnerability of the toddler make any difference?