[dadadev] atom and the privacy, multiple fields and foreign languages.

Gerard gerard at seibercom.net
Wed Jan 4 12:22:48 PST 2006

"Alfred Vink" <alfred at alfsoft.com>

> Michael:
> 4. If I use the archiving of my discussion list the e-mail addresses are
> displayed doing a Google search with the keywords of the name of the person.
> Add a robots.txt file to the root of your site and in this textfile type:
> User-agent: *
> Disallow: /cgi-bin/
> Now your problem is gone, there are a multiple of things you can set in the
> robots.txt file to have control over how searchengines scan your site.
> Alfred

You might want ot check out this URL for further information.


If you create a custom DADA directory under your home directory, those
files would never have been indexed anyway. You should really consider
that option.

Gerard Seibert
gerard at seibercom.net

More information about the freebsd-questions mailing list