Reply to comment

Basically, an opt out list would give people a general way in which the bot could validate against. If someone is on the list, their content is simply not indexed. Since the bots are client based, that shouldn't be an issue. a central server of avatar names and/or keys which don't wish to be indexed.

I don't think many folks would opt out, but - it gives them a chance to do so. A simple txt file on the web would suffice.

I remember robots.txt, when it came out and the effect it had. Things have changed a bit since then. :-)