Strictly speaking, Google doesn't actually distribute 'the' Java(tm) VM. They distribute the Dalvik VM, which supports Java, among others. Arguably, Google would not be in trouble, if they distributed Sun/Oracle's Java. (They'd be in different trouble re: Java ME instead, but that's a different question.)
Spinning up the FUD machine, anyone implementing a VM must have similar types of problems to solve, and so it's possible, just like in Dalvik, that the Python and Ruby infringe upon those or similar patents that opponents with deep pockets hold. Sprinkle some mutterings of Ogg Vorbis on top, and a sufficiently knowledgeable advocate against Ruby/Python could easily argue the opposite. (Python? That's, like, an open source language right? So that means no one to indemnify us if Oracle decides Python also infringes their patents?)