is there a way to auto-gather web data?
kline at tao.thought.org
Fri Sep 16 21:26:19 PDT 2005
No, I'm not trying to "steal" this info--it has been in
the public domain for cnturies. But on "the.public.foobar.com"
there is an "/cgi/author.html?id=hallaj", let's say. In order
to gleen the sayings from "hallaj" I have to click several times
before the paragraphs are displayed. wget fails on this one.
I'd like to scarf up all their sayings automagically....
Anybody know how to automate my clicking? There are at least
150 authors, each with N blurbs. :-X ...Talk about carpal-tunnel
syndrome. I've seen what spambots can do to my guestbooks, so
this may be a __black art__.
Gary Kline kline at thought.org www.thought.org Public service Unix
More information about the freebsd-questions