When I'm at a conference, I prefer finding people with entirely different sets of interests. This gives me the opportunity to potentially learn something new and maybe even find out about a field I didn't previously know about.
This idea sounds interesting. I'd like to see where it could go if you built it online and let people use it while not at conferences; keep a virtual "hallway track" online at all times.