Thats why some PIN screen implementations have PIN screen scrambling. It can defeat shoulder surfing.