With current ram sizes this might be negligible, but 32bit chrome would have to load 32bit versions of all system frameworks, while you have 64bit in memory all the time. The less 32bit apps you have, the better :)
(Chrome startup is so slow on my machine that this might be negligible anyway).