distfiles / md5 / plain-text via FTP proxy

[Thomas-Martin Seck]

* Raphael H. Becker <rabe at p-i-n.com> [gmane.os.freebsd.devel.ports]:

> On Wed, Sep 28, 2005 at 10:03:28AM -0400, Kris Kennaway wrote:

>> I'd like to know one too.  This is arguably a bug in squid, since it
>> should not be rewriting content without me telling it to.

Indeed.

> No workaround, but how to repeat:
> 
> $ ftp_proxy="" fetch -o gdevlx50.c_noproxy \
>        "ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/ghostscript/gdevlx50.c"
> 
> $ ftp_proxy="http://localhost:3128/" fetch -o gdevlx50.c_proxy \
>        "ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/ghostscript/gdevlx50.c" 
> 
> $ wc -lc gdevlx50.c_*                                                              
>    2732   99428 gdevlx50.c_noproxy
>    2732  102160 gdevlx50.c_proxy
> 
> $ file gdevlx50.c_*
> gdevlx50.c_noproxy: ASCII C program text
> gdevlx50.c_proxy:   ASCII C program text, with CRLF line terminators
> 
> $ md5 gdevlx50.c_*
> MD5 (gdevlx50.c_noproxy) = 081e355c866316a56fbbff5b59f2b7cf
> MD5 (gdevlx50.c_proxy) = 06b0518d1d0aeedd61d4c7d27921cf62
> 
> $ grep gdevlx50.c /usr/ports/print/ghostscript-gnu/distinfo  
> MD5 (ghostscript/gdevlx50.c) = 081e355c866316a56fbbff5b59f2b7cf
> SIZE (ghostscript/gdevlx50.c) = 99428
> 
> All plain text distfiles fetched using ftp through squid are affected!

I can confirm this behaviour with FreeBSD's ftpd and squid-2.5.11.
I cannot however confirm this with squid + ftp/vsftpd, possibly because
vsftpd ignores ASCII requests by default.

I do not think that there is currently a way to force squid to always
request binary transfers, so you might want to file a bug report against
squid to get this feature in.