uniq truncates lines > 2048 bytes

Scot Hetzel swhetzel at gmail.com
Tue Jan 25 09:51:52 PST 2005


I noticed that if a file has lines > 2048 bytes, uniq will truncate
the line to LINE_MAX (2048 bytes). An easy way to test this is to do
the following:

cd /usr/ports/accessibility/gnomemag
make fetch-list > test.list
make fetch-list >> test.list
uniq test.list > test2.list

test2.list should be half the size of test.list, but it is 2048 bytes.

I have come up with a patch to uniq that fixes this problem.

http://www.freebsd.org/cgi/query-pr.cgi?pr=76578


More information about the freebsd-current mailing list