[dadadev] atom and the privacy, multiple fields and foreign languages.

Gerard gerard at seibercom.net
Wed Jan 4 12:22:48 PST 2006


"Alfred Vink" <alfred at alfsoft.com>

> Michael:
> 
> 4. If I use the archiving of my discussion list the e-mail addresses are
> displayed doing a Google search with the keywords of the name of the person.
> 
> Add a robots.txt file to the root of your site and in this textfile type:
> 
> User-agent: *
> Disallow: /cgi-bin/
> 
> Now your problem is gone, there are a multiple of things you can set in the
> robots.txt file to have control over how searchengines scan your site.
> 
> Alfred

You might want ot check out this URL for further information.

http://www.seoconsultants.com/robots-text-file/

If you create a custom DADA directory under your home directory, those
files would never have been indexed anyway. You should really consider
that option.

-- 
Gerard Seibert
gerard at seibercom.net



More information about the freebsd-questions mailing list