if my bot is actually my cat actuating a switch for it to load a page, does it have to follow robots.txt?