[dadadev] atom and the privacy,
multiple fields and foreign languages.
Gerard
gerard at seibercom.net
Wed Jan 4 12:22:48 PST 2006
"Alfred Vink" <alfred at alfsoft.com>
> Michael:
>
> 4. If I use the archiving of my discussion list the e-mail addresses are
> displayed doing a Google search with the keywords of the name of the person.
>
> Add a robots.txt file to the root of your site and in this textfile type:
>
> User-agent: *
> Disallow: /cgi-bin/
>
> Now your problem is gone, there are a multiple of things you can set in the
> robots.txt file to have control over how searchengines scan your site.
>
> Alfred
You might want ot check out this URL for further information.
http://www.seoconsultants.com/robots-text-file/
If you create a custom DADA directory under your home directory, those
files would never have been indexed anyway. You should really consider
that option.
--
Gerard Seibert
gerard at seibercom.net
More information about the freebsd-questions
mailing list