I allow all robots and even provide a sitemap on Subreply, a social network I created.