Fast diff command for large files?
Chuck Swiger
cswiger at mac.com
Fri Nov 4 16:23:00 GMT 2005
Kirk Strauser wrote:
> I need to routinely find the diffs between two multigigabyte text files
> (exporting a set of FoxPro tables to a PostgreSQL database without doing a
> complete dump/reload each time, in case you were wondering). GNU diff from
> the base system and from ports chokes. The textproc/2bsd-diff works OK,
> but is glacially slow.
Multigigabyte? Find another approach to solving the problem, a text-base diff
is going to require excessive resources and time. A 64-bit platform with 2 GB
of RAM & 3GB of swap requires ~1000 seconds to diff ~400MB.
--
-Chuck
More information about the freebsd-questions
mailing list