Fetching directories inclusive subdirectories on HTTP server via fetch or othe FreeBSD-own tools?

[Vincent Hoffman]

On 2/4/09 10:41, O. Hartmann wrote:
> Oliver Fromme wrote:
>> O. Hartmann <ohartman at zedat.fu-berlin.de> wrote:
>>  > I run into a problem I can not solve. I need to fetch a whole
>> directory  > tree from a public remote site. The top level directory
>> and its  > subdirectories are accessible via ftp:// and http:// so I
>> tried fetch,  > but fetch does only retrieve data on file basis and
>> does not copy a  > whole directory tree recursively. The remote site
>> does not offer  > sftp/sshd for that purpose.
>>  >  > Is there a simple way to perform such a task with FreeBSD's own
>> tools (I  > try to avoid installing 'wget' and sibblings)? I need to
>> keep it simple,  > task should be performed via cronjob.
>>
>> I'm afraid you can't do that with FreeBSD base tools.
>>
>> An alternative to wget would be "omi" (ports/ftp/omi)
>> which is a simple FTP mirroring tool, written in C
>> without any dependencies.  Usage is simple:
>>
>> $ omi -s server.name.com -r /remote/dir -l ./local/dir
>>
>> Note that, by default, it tries to synchronize the local
>> dir perfectly, i.e. if the remote dir is empty, it will
>> wipe out the local dir.  (The option "-P 0" will prevent
>> omi from removing anything.)
>>
>> Best regards
>>    Oliver
>>
>
> Thanks for so much answers.
>
> I tried 'omi' but I find that the tool does not travers deeper into a
> dir than level one, so subdirs seem to be left out. I will try wget,
> although this tool would not be the first choice.
>
I seem to remember that nctp3 had a decent -R recurse option to its get
(or its ncftpget non interactive mode) if you want to avoid wget.

Vince

>
> Thanks,
> Oliver
> _______________________________________________
> freebsd-questions at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-questions
> To unsubscribe, send any mail to
> "freebsd-questions-unsubscribe at freebsd.org"