From my understanding Raphael is specific to the SVG context. Two.js is renderer agnostic, you can choose whether it draws in SVG, canvas, or webgl. This is one of many differences between the two.
Still specific to vector graphics rendering.
So not "on the contrary", but "to be exact".