I'm not completely sure it's the same thing, but I remember a technique for picking using colour maps. It's described in this tutorial:

http://www.opengl-tutorial.org/miscellaneous/clicking-on-obj...