This even has a name. It's called a "smudge attack"

http://en.wikipedia.org/wiki/Smudge_attack