Considering the Chromecast is plugged behind the TV, wouldn't it be really awkward to get to to tap on it?
Btw, Google has a series of APIs called Nearby (https://developers.google.com/nearby/) that are all about connecting to nearby devices but NFC doesn't seem the right answer here.